Mobile/Testing/11 09 11

From MozillaWiki
Jump to: navigation, search

Previous Action Items

  • RelEng to clear the bug queue that blocks a-team

Status reports

Dev team

  • bug 700847 - Birch talos pageloader tests are all failing due to
  • bug 700916 - running tests via adb don't work in Birch due to the way we build the adb command line
  • (fixed) bug 700928 - aurora tests are failing

Rel Eng

android_tier_1

bug priorities:

  • (armen) bug 697404 disable tp4m chrome for birch. This may be harder than it looks; is there a big downside if we just hide?
  • bug 695351 manifest file for android tests
  • bug 693352 stackwalk in automation
  • bug 689625 please send an email when a mobile talos suite has not reported numbers in a 24 hour period

A Team

  • with the hiding of R2 (no need to hide J1 anymore), we have 3.01% orange rate:
    • last week this was , 2.43%
    • [spreadsheet]
      • orange rate include R2 is 4.72%, last week was 5.97%
      • total failure rate is 7.22% (5.13% without R2)
    • disabled more browser-chrome tests (would bring us to 2.16% failure rate with R2 hidden)
    • should we split reftests into 3 chunks? this seemed to have fixed jsreftests and crashtests
    • should I start tracking the blue restarts we have?
  • rss for talos collection is starting to come together bug 685632
    • pageloader patch is landed
    • talos patch should be finished this week
  • native UI tests-
    • all non passing tests are hidden on tbpl/Birch; need to stop running these
    • bug 701076 - will move forward with Robotium
  • QA Startup Test automation
    • all working with warm/cold starts
    • pending work is to get results uploaded automatically to a webserver
  • future tests
    • bug 691349 - opengl for reftests on android
    • xpcshell

Round Table

  • what is needed for Native UI reftests

Action Items

  • jmaher to file bug to disable reftests, Tpan and Tzoom tests on Native UI