Mobile/Testing/02 15 12: Difference between revisions
Jump to navigation
Jump to search
| (13 intermediate revisions by 4 users not shown) | |||
| Line 1: | Line 1: | ||
= Previous Action Items = | = Previous Action Items = | ||
* Armen to ETA for TroboPan and Tcheckerboard deployment | * Armen to ETA for TroboPan and Tcheckerboard deployment | ||
** armenzg says late this week or early next one | |||
* Clint to build panda board OS image (blassey to support) | * Clint to build panda board OS image (blassey to support) | ||
* Joel to take care of Ts-moz-afterpaint | * Joel to take care of Ts-moz-afterpaint | ||
| Line 6: | Line 7: | ||
= Status reports = | = Status reports = | ||
== Dev team == | == Dev team == | ||
Robocop: | Robocop: | ||
* More and more tests are being written! | |||
* testBookmark fails (bug 725483) - waiting for bookmarks UI to stabilize | |||
Bug 705192 - remotexpcshelltests.py cannot execute xpcshell via SUT agent | |||
== Rel Eng == | == Rel Eng == | ||
* {{bug|723667}} talos robocop | |||
** armenzg hopes to have patches this week | |||
== A Team == | == A Team == | ||
Robocop: | Robocop: | ||
* {{bug|727354}} - need to resolve cases where fennec crashes during the test, but still reports green; | |||
** appears to be hitting OOM errors frequently on the tegras | |||
Reftests: | Reftests: | ||
* need to investigate the C1/R2/R3 failures and fix them. | |||
Talos: | Talos: | ||
* need to file ts_mozafterpaint addition | |||
* working with releng to ensure we can rollout trobopan and all the updated talos bits | |||
Upcoming work: | Upcoming work: | ||
* xpcshell in automation | |||
* [[https://wiki.mozilla.org/Mobile/PowerUsage power usage]] tests | |||
** this requires tweaking the PowerTutor tool to stop on event and dump profile to log | |||
** requires developing a power profile for hardware we will run on | |||
** will this run as CI or out of band? | |||
== S1/S2 Automation == | == S1/S2 Automation == | ||
| Line 26: | Line 43: | ||
== Panda Boards == | == Panda Boards == | ||
* Initial [[https://wiki.mozilla.org/index.php?title=ReleaseEngineering/Projects/Android_4.0_Testing wiki]] created | * Initial [[https://wiki.mozilla.org/index.php?title=ReleaseEngineering/Projects/Android_4.0_Testing wiki]] created | ||
* Tracking {{bug|725544}} created | |||
* {{bug|725846}} - 5 boards have been ordered; 5 more to be ordered; accessories still to be ordered | |||
** they are back-ordered; next delivery date (not on stone) is Feb. 29th. | |||
** estimates for large purchase is on bug as well | |||
* ctalbert/jmaher/wlach - have had minimal luck getting pandaboards to boot and run tests (mochitest and reftest samples so far). ctalbert and jmaher can't even get an image to boot. | |||
** require proper power supply | |||
** requiring building from tip of ICS | |||
** require panda video driver | |||
** possibly require specific type(s) of sdcard | |||
* concerns | |||
** the boards sometimes become unstable (much more than the tegras) | |||
** armenzg: do we have an alternative to the panda boards? | |||
*** blassey: no fallback plan | |||
== Crash Stats == | == Crash Stats == | ||
| Line 67: | Line 97: | ||
= Round Table = | = Round Table = | ||
* How do we bring up new perf tests | |||
= Action Items = | = Action Items = | ||
* Joel to take care of Ts-moz-afterpaint | |||
* armenzg to get an extra Panda ES board for blassey | |||
* finkle to give joel a list of perf tests he wants to write | |||
Latest revision as of 19:01, 15 February 2012
Previous Action Items
- Armen to ETA for TroboPan and Tcheckerboard deployment
- armenzg says late this week or early next one
- Clint to build panda board OS image (blassey to support)
- Joel to take care of Ts-moz-afterpaint
Status reports
Dev team
Robocop:
- More and more tests are being written!
- testBookmark fails (bug 725483) - waiting for bookmarks UI to stabilize
Bug 705192 - remotexpcshelltests.py cannot execute xpcshell via SUT agent
Rel Eng
- bug 723667 talos robocop
- armenzg hopes to have patches this week
A Team
Robocop:
- bug 727354 - need to resolve cases where fennec crashes during the test, but still reports green;
- appears to be hitting OOM errors frequently on the tegras
Reftests:
- need to investigate the C1/R2/R3 failures and fix them.
Talos:
- need to file ts_mozafterpaint addition
- working with releng to ensure we can rollout trobopan and all the updated talos bits
Upcoming work:
- xpcshell in automation
- [power usage] tests
- this requires tweaking the PowerTutor tool to stop on event and dump profile to log
- requires developing a power profile for hardware we will run on
- will this run as CI or out of band?
S1/S2 Automation
Eideticker
Panda Boards
- Initial [wiki] created
- Tracking bug 725544 created
- bug 725846 - 5 boards have been ordered; 5 more to be ordered; accessories still to be ordered
- they are back-ordered; next delivery date (not on stone) is Feb. 29th.
- estimates for large purchase is on bug as well
- ctalbert/jmaher/wlach - have had minimal luck getting pandaboards to boot and run tests (mochitest and reftest samples so far). ctalbert and jmaher can't even get an image to boot.
- require proper power supply
- requiring building from tip of ICS
- require panda video driver
- possibly require specific type(s) of sdcard
- concerns
- the boards sometimes become unstable (much more than the tegras)
- armenzg: do we have an alternative to the panda boards?
- blassey: no fallback plan
Crash Stats
Screenshot and data from 2/13/2012 11:28 AM PDT
Note :
- Java crashes are all reported for 13/12.
- Current top non-java bug in 13 :
- bug 721086 - Crash in mozilla::AndroidBridge::CallEglCreateWindowSurface @ nsWindow::GetThebesSurface - motorola MZ601 only
- Flash Crash
- bug 725295 Crash Report @ _ZN8SkBitmapaSERKS_ on HTC devices
- Current top java crashes in 13:
- bug 726269 - java.lang.ClassCastException: android.widget.TextView at org.mozilla.gecko.AwesomeBarTabs$AwesomeCursorViewBinder.updateFavicon(AwesomeBarTabs.java)
- bug 726270 - java.lang.NullPointerException: at android.widget.CursorTreeAdapter.setChildrenCursor(CursorTreeAdapter.java)
- Current top core bug in 13:
- libGLESv2_mali.so@0x29d36
- bug 700499 crash nssCertificate_Destroy
- Current top non-java bug in 12 :
- bug 711852 - Crash in neon_composite_over_8888_8888 or neon_composite_over_n_8_0565 or fast_composite_over_8888_0565 or arm_neon_fill @ libxul.so@0xa...
- bug 725295 - Crash Report [@ _ZN8SkBitmapaSERKS_ ] on HTC devices
- Current top java crashes in 12:
- bug 723499 - java.lang.IllegalStateException: at android.widget.ListView.layoutChildren(ListView.java)
- Current top core bug in 12:
- bug 674584 - crash [@ js::Interpret]
- bug 700583 - Crash in nsPluginFile::GetPluginInfo @ pr_FindSymbolInLib
- Socorro/Breakpad work:
- Java field to be implemented and pushed on Wednesday for production - bug 719943
- bug 726385 Please create skiplist implementation for the Java field
- bug 726693 Some java crashes are not being mapped correctly to bugs in bugzilla even though the crash signature fields have the "signatures" listed
- bug 725313 Java Crash signatures may end up pointing to bad links
- bug 672606 - Aggregate numbers and topcrashes for Nightly and Aurora channels based on build ID date instead of crash date
- bug 727234 - Crash Report [@ EMPTY: no crashing thread identified; corrupt dump ]
- bug 727286 - Incorrect messaging when failing to submit a crash report
Round Table
- How do we bring up new perf tests
Action Items
- Joel to take care of Ts-moz-afterpaint
- armenzg to get an extra Panda ES board for blassey
- finkle to give joel a list of perf tests he wants to write