Mobile/Testing/07 31 13

From MozillaWiki
Jump to: navigation, search

Previous Action Items

  • [dminor] follow up with jmaher about current status of new Talos test
    • discussed in irc after last week's meeting
  • [dminor] follow up as to why rck was missing from Panda spreadsheet
    • test was removed, can be replaced with rck2

Status reports

Dev team

Rel Eng

  • Continued Investigations as to why there is an increase in Panda RETRYs in bug 897546
    • bug 898227 fixed (awaiting mozharness merge) which releases a mozpool hold if we fail to "become ready in time".
  • Tied a bow on bug 882324 to get panda reftests working properly on cedar.
  • Patch up for bug 888835 - Use slavealloc for Android
    • Important since it allows proper buildbot balancing, easier/faster disabling (by releng and sheriffs) and less tool/process divergence.

IT

  • (joduinn) financial PO waiting for signoff bug 892825

A Team

Failure Rates

  • tegra failure rate: [4.70%]
  • panda failure rate: [26.00%]
    • excluding retries, failure rate is 4.61%

Mobile Bugs in Orange Factor Top 10

  • bug 851861 Intermittent testOverscroll, testPanCorrectness, testAxisLocking, testLoad, testFlingCorrectness | Pixel at 100, 0 - Color rgba(0,0,0,255) not close enough to expected rgb(32,100,0)
  • bug 835588 Intermittent "BaseException: Failed to connect to SUT Agent and retrieve the device root."

Work in progress

  • Panda reftests are now running on Cedar
    • looking at oranges

x86 automation

  • Matching screen size and density to tegra "fixed" hundreds of reftests
  • Many robocop failures resolved: typically timing or Jellybean differences
  • armengz looking at buildbot integration

Autophone

Eideticker

  • Profiling runs now enabled. bug 799334 was being triggered frequently as a result, but is hopefully fixed now, pending review.
  • LG G2X very flakey these days. Rarely makes it through a day. wlach may investigate next week when he's down in MV.
  • Seeing various problems with Galaxy Nexus runs completely successfully as well (profiling aside). Under investigation.

Round Table

  • Automation for Jetpack tests on Android (Mossop)

Action Items

  • dminor and mossop to talk