Mobile/Testing/03 28 12: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(9 intermediate revisions by 5 users not shown)
Line 3: Line 3:
= Status reports =
= Status reports =
== Dev team ==
== Dev team ==
* Trying to help investigate reftest failures
* Bug 735461 Robocop: Fennec does not interpret -profile argument correctly
== Rel Eng ==
== Rel Eng ==
* enabled trobopan (success) and tcheckerboard (failing) on mozilla-central
** fixing tbpl to show the jobs
** will be enabling everywhere in the next 2 days
** tcheckerboard fails due to passing incorrect parameter (fix will be deployed today/tomorrow)
* testing some verification steps in one of the production foopies
** will be deployed to other foopies
* panda boards - nothing new - waiting on A-team to give working image


== A Team ==
== A Team ==
* Eideticker: Dashboard now provides checkerboarding daily: http://wrla.ch/eideticker/dashboard/#/checkerboarding
** Current test only measures checkerboarding after panning, working on a test case to measure checkerboarding after zooming
** Planning to have several more tests to measure checkerboarding on other, possibly more representative, sites (thinking of using nytimes, cnn, wikipedia).
* working with releng to get ts_paint, trobopan, tcheckerboard live
* {{bug|732498}} - retested the failing reftests- most of the previous tests failures pass now, 62 total failures and many look to be canvas related
* will get tprovider and tcheckerboard2 in staging later this week.
== S1/S2 Automation ==
== S1/S2 Automation ==


== Mobile Crash ==
== Mobile Crash ==
[[File:CrashStats_2012-03-19.png]]
[[File:CrashStats_2012-03-26.png]]
* Screenshot and data from 2012-03-19 at 2.25.08 PM PDT
* Screenshot and data from 2012-03-26 at 2.56 PM PDT
   
   
Top crashes:
Top crashes:
* see [https://wiki.mozilla.org/Platform/2012-03-27#Mobile_2 Stability Report 2012-03-27]
* see [https://wiki.mozilla.org/Platform/2012-03-27#Mobile_2 Stability Report 2012-03-27]
* Having the top 3 crashes fixed will reduce the crash count considerably (at least 30 %)


Note :
Note :
Line 23: Line 43:
** {{Bug|727286}} - Incorrect messaging when failing to submit a crash report
** {{Bug|727286}} - Incorrect messaging when failing to submit a crash report


* ADU for Aurora is low.  We will see spikes for Aurora.
* Beta numbers has been fixed, was a release eng issue; {{bug|737069}}
* Java field needs to be implemented for XUL Fennec
* Java field needs to be implemented for XUL Fennec: {{bug|701002}} - Put Java stacks into a separate field (not AppNotes)
* skiplist for touchbadmemory to be implemented on wed.
* skiplist for touchbadmemory to be implemented on wed.; reprocessed last friday
* Beta channel has no ADU/crash reported due to {{Bug|738316}} - No crashes found for Fennec 12.0b1 - wrong channel set
 
* Crash criteria : get less than 10 % per 100 adus
* Crash criteria : get less than 10 % per 100 adus



Latest revision as of 17:37, 28 March 2012

Previous Action Items

Status reports

Dev team

  • Trying to help investigate reftest failures
  • Bug 735461 Robocop: Fennec does not interpret -profile argument correctly

Rel Eng

  • enabled trobopan (success) and tcheckerboard (failing) on mozilla-central
    • fixing tbpl to show the jobs
    • will be enabling everywhere in the next 2 days
    • tcheckerboard fails due to passing incorrect parameter (fix will be deployed today/tomorrow)
  • testing some verification steps in one of the production foopies
    • will be deployed to other foopies
  • panda boards - nothing new - waiting on A-team to give working image

A Team

  • Eideticker: Dashboard now provides checkerboarding daily: http://wrla.ch/eideticker/dashboard/#/checkerboarding
    • Current test only measures checkerboarding after panning, working on a test case to measure checkerboarding after zooming
    • Planning to have several more tests to measure checkerboarding on other, possibly more representative, sites (thinking of using nytimes, cnn, wikipedia).
  • working with releng to get ts_paint, trobopan, tcheckerboard live
  • bug 732498 - retested the failing reftests- most of the previous tests failures pass now, 62 total failures and many look to be canvas related
  • will get tprovider and tcheckerboard2 in staging later this week.

S1/S2 Automation

Mobile Crash

CrashStats 2012-03-26.png

  • Screenshot and data from 2012-03-26 at 2.56 PM PDT

Top crashes:

Note :

  • Socorro/Breakpad work:
    • bug 726385 Please create skiplist implementation for the Java field
    • bug 726693 Some java crashes are not being mapped correctly to bugs in bugzilla even though the crash signature fields have the "signatures" listed
    • bug 672606 - Aggregate numbers and topcrashes for Nightly and Aurora channels based on build ID date instead of crash date
    • bug 727234 - Crash Report [@ EMPTY: no crashing thread identified; corrupt dump ]
    • bug 727286 - Incorrect messaging when failing to submit a crash report
  • Beta numbers has been fixed, was a release eng issue; bug 737069
  • Java field needs to be implemented for XUL Fennec: bug 701002 - Put Java stacks into a separate field (not AppNotes)
  • skiplist for touchbadmemory to be implemented on wed.; reprocessed last friday
  • Crash criteria : get less than 10 % per 100 adus

Round Table

Action Items