Mobile/Testing/06 26 13

From MozillaWiki
Jump to: navigation, search

Previous Action Items

  • Joduinn going to follow up with bmoss about his ideas on the tegra move decision
  • Jmaher and team going to keep digging into the failure rate spike, potentially rolling back the recent sutagent change
    • Rolling back sutagent change seemed to fix things
  • Bc will have an update on autophone reftest testing next week
    • Mochitests seem more promising
  • callek has on his plate this week to write up a concise plan to update the watcher across the board.
  • gbrown - will start on making a new image for the pandas to address the retry bug, and then we can use mozpool to distribute it.

Status reports

Dev team

  • liuche is landing bug 872329 - Settings UI - today: affects lots of robocop tests

Rel Eng

  • kmoir - panda android with mozharness/mozpool for non-talos tests now in production bug 829211

IT

A Team

  • tegra failure rate: [2.19%]
    • m3, m8 are the most problematic
  • panda failure rate: [16.82%]
    • rc2 is our largest offender


top orange factor bugs:

  • bug 807230 - Intermittent DMError: Automation Error: Timeout in command {ls,ps,isdir,mkdr}
  • bug 711725 - Tegras and Pandas disconnect with "remoteFailed: [Failure instance: Traceback (failure with no frames):
  • bug 845162 - Intermittent Android timeout in test_replay_metadata.html,test_playback_rate.html,test_bug495145.htm...
  • bug 689856 - Android tests intermittently just stop
  • bug 881404 - Intermittent dom/workers/test/test_closeOnGC.html | Test timed out


other features and bugs:

  • bug 877266 Flag and manifest changes for reftests on pandas landed on inbound.
  • bug 881897 Reduce amount of polling and data transfer to hopefully reduce frequency of bug 807230
    • I have a try run in place which seems promising, but more testing required.

x86 automation

Autophone

  • bc in Toronto this week. Some phones down and not recoverable until Friday night. Jobs are queued and will be processed once the phones are recovered.
  • Transitioned to new mac mini autophone server.
  • Worked on running autophone mochitests with skia enabled. Have some patches in development but delayed due to work week travel.

Eideticker

  • Figured out problem with imgur test (bug 884907), just an errant link.

Round Table

  • Can help to avoid SUTAgent deployment problems by asking RelEng to test in staging prior to deployment

Action Items

  • ctalbert, dminor, gbrown to sort out x86 ownership for Q3
  • kmoir to update patch for bug 882324 to run panda reftests