Mobile/Testing/07 17 13

From MozillaWiki
Jump to: navigation, search

Previous Action Items

Status reports

Dev team

  • working on a new canvas perf talos test

Rel Eng

  • Remaining mozharness/mozpool regressions from Bug 829211
    • landed Bug 894512 Split mozpool managed pandas away from talos (non mozpool) pandas
    • Landed Bug 891889 (robocop thinks it uses 3 chunks, but only is aware of 2, fixes missing tests)
    • TODO:
      • Set shutdown.stamp prior to requesting a device from mozpool (no bug yet)
      • Make verify.py pass prior-to-mozpool requesting if mozpool state is "ready" Bug 889967 (requires Bug 894512)

IT

  • Tegra move - The plan is to move these into the Evelyn office.
  • We fixed a majority of the bad pandas that were failing by swapping out the SD Card
    • 893998 also previously unknown bad pandas are now alerting now that we removed the 'locked_out' state on all the pandas in mozpool
    • Jake is looking into why the sdcards failed in such a hard way that the bootloader wasn't able to be read

A Team

Failure Rates

  • tegra failure rate: [1.18%]
  • panda failure rate: [31.51%]
    • as with last week, mostly due to a large number of retrys

Mobile Bugs in Orange Factor Top 10

  • bug 835588 - Intermittent "BaseException: Failed to connect to SUT Agent and retrieve the device root."
    • according to bugzilla, pmoore had planned to look at this

Work in progress

  • Clint filed project paper work and has requested 16 Ubuntu ix machines
  • Working on bug 892569 to be able to run cppunittests from mozharness, including remote versions.
    • Added some functionality in bug 893085 to remotecppunittests.py to be able to work from apk
    • Can run the tests with a few unexpected results

x86 automation

  • See bug 891959 [Tracking] Stand up x86 Automated Testing System using Emulators
    • Run-times for most tests determined
    • Can likely run 4 concurrent emulators
    • Concentrating on test failures now

Autophone

  • Relocated router to be near phones 2013-07-17.
  • Mochitest canvas tests with SkiaGL enabled started running 2013-07-17.
    • Results available at http://brasstacks.mozilla.com/autolog/?tree=mozilla-central&source=autolog
    • Initially excluding content/canvas/test/webgl/test_webgl_conformance_test_suite.html due to crash on Motorola Atrix.
    • Initial Results
      • Motorola Atrix known to complete green during initial development
      • Samsung Galaxy S3 completed green
      • LG Revolution crashed.
    • Issues
      • Initial runs failed due to a configuration error
      • Initially missing minidump_stackwalk but will fix asap.

Will blog announcement later today when things settle down.

Eideticker

  • Working to re-enable profiling, using jchen's patches: bug 803616

Round Table

  • [dminor] current status of turning reftests on for pandaboards
  • [dividehex] solidify the process of identifying and fixing 'bad pandas'
  • [blassey (on behalf of jmaher)] ETA on bug 893949 and bug 893081

Action Items

  • [callek] follow up on current state of bug 882324
  • [callek] send email outlining new "bad panda" process
  • [callek] follow up on bug 893949 and bug 893081