Mobile/Testing/10 02 13

From MozillaWiki
Jump to: navigation, search

Previous Action Items

Status reports

Dev team

  • tests on debug builds?
  • bug 923109 - find a more reliable way to load URLs in robocop tests

Rel Eng

  • testing patches to consume talos.json for mobile tests, enabling emulator-jb tests, other mobile fixes
  • next will look at changing reboots to be completely via mozpool and see if this reduces our retry rate

IT

A Team

  • tegra failure rate: [1.88%]
  • panda failure rate: [25.44%]
    • excluding retries: 2.42
  • Mobile Bugs in Orange Factor Top 10
    • bug 781107 Intermittent talosError: "Could not find report in browser output: [('tsformat', ('__start_report', '__end_report')), ('tpformat', ('__start_tp_report', '__end_tp_report'))] [browser_output.txt]" running Android Talos
    • bug 910106 Intermittent Android testClearPrivateData, testFindInPage, tcheck2 talosError: 'Verify HomePager is hidden: HomePager is hidden [browser_output.txt]'
    • bug 914377 Intermittent testShareLink | Exception caught - junit.framework.AssertionFailedError: View is null and can therefore not be clicked!
  • Panda jit-tests running on Cedar
    • Need to follow up with js team about failures
  • Panda reftests
    • Updated manifests, but some new failures have shown up this week
    • Adding --bootstrap made the tests run substantially faster (16 min for R1 as opposed to 41 min previously)
  • bug 892569 Run remote cpp unittests
    • Hit mozbase dependency problems, working on bug 921596 to resolve these
  • We have a contributor actively working on slave failures analysis:

x86 automation

Autophone

Eideticker

Round Table

Action Items

  • [dminor] follow up with gbrown after the summit on:
    • tests on debug builds
    • bug 923109 - find a more reliable way to load URLs in robocop tests