Mobile/Testing/10 16 13

From MozillaWiki
Jump to: navigation, search

Previous Action Items

Status reports

Dev team

  • what do we do with no-chrome tests?
  • debug tests

Rel Eng

  • (pmoore) new panda image deployed bug 914302
  • (kmoir) robocop tests for Pandas will be split into four chunks with next reconfig bug 926991, patches to consume talos.json under review bug 920757, all pandas that were allocated to b2g now allocated to android bug 897592

IT

A Team

  • tegra failure rate: [1.7%]
  • panda failure rate: [22.85%]
    • excluding retries: 2.68
  • Mobile Bugs in Orange Factor Top 10
    • bug 922976 Intermittent TEST-UNEXPECTED-FAIL | tests/gfx/tests/crashtests/394751.xhtml | load failed: null
      • RyanVM bisected this, introduced by patch for bug 897162
    • bug 919920 Intermittent TEST-UNEXPECTED-FAIL | remotereftests.py | Timed out while waiting for server startup.
  • Working on bug 921596 to handle setting up mozbase from test package in mozharness, to enable landing bug 892569
  • Working on bug 927085 to update panda reftests manifests
    • Everything I've hit recently has been fuzzy tests that were insufficiently fuzzy.

x86 automation

  • Trying to use our own patched build of the x86 emulator to avoid crashes: bug 917562
  • Long-running reftests still a concern
  • webgl mochitests crashing
  • A few new, minor robocop issues

Autophone

  • gbrown noticed one gs3 had become unreliable since early October. I reset the phone, and retested the results and they are better behaved and agree with the other gs3. Will set up a schedule to regularly reset phones.
  • waiting on mcote's phones.
  • temporarily disabled SkiaGL canvas tests
    • Causes hangs which interfere with Autophone phonedash throbber tests
    • Will reenable when I have additional phones which I can use to partition the phones into separate pools to run the throbber and SkiaGL canvas tests.

Eideticker

  • eideticker-1 (LG G2X) upgraded to Ubuntu 12.04
    • HDMI settings need to be reset

Round Table

Action Items

  • ctalbert -> can we load a about blank and test it on fennec follow up with jmaher
  • ctalbert -> find someone to get bugs on file for individual assertions for debug tests on fennec.
  • gbrown to get armen involved to investigate the webgl crash on cedar not on loaner (seems to be environment issue).
  • bc to file bugs for phones where skiagl hangs issues.
  • kmoir to get us an ETA when the conversion of panda access logic to mozpool will be complete.