Mobile/Testing/06 26 13

Previous Action Items

• Joduinn going to follow up with bmoss about his ideas on the tegra move decision
• Jmaher and team going to keep digging into the failure rate spike, potentially rolling back the recent sutagent change
  • Rolling back sutagent change seemed to fix things
• Bc will have an update on autophone reftest testing next week
  • Mochitests seem more promising
• callek has on his plate this week to write up a concise plan to update the watcher across the board.
• gbrown - will start on making a new image for the pandas to address the retry bug, and then we can use mozpool to distribute it.

Status reports

Dev team

• liuche is landing bug 872329 - Settings UI - today: affects lots of robocop tests

Rel Eng

• kmoir - panda android with mozharness/mozpool for non-talos tests now in production bug 829211

IT

• Higher density chassis is racked in the data center.
• Tegra move - mrz is working on a proposal to present to the team for review
  • Draft https://mana.mozilla.org/wiki/display/~mzeier@mozilla.com/Tegra+-+Migration+out+of+650+Castro
  • There has been email back and forth on this, nothing is finalized yet.

A Team

• tegra failure rate: [2.19%]
  • m3, m8 are the most problematic
• panda failure rate: [16.82%]
  • rc2 is our largest offender

top orange factor bugs:

• bug 807230 - Intermittent DMError: Automation Error: Timeout in command {ls,ps,isdir,mkdr}
• bug 711725 - Tegras and Pandas disconnect with "remoteFailed: [Failure instance: Traceback (failure with no frames):
• bug 845162 - Intermittent Android timeout in test_replay_metadata.html,test_playback_rate.html,test_bug495145.htm...
• bug 689856 - Android tests intermittently just stop
• bug 881404 - Intermittent dom/workers/test/test_closeOnGC.html | Test timed out

other features and bugs:

• bug 877266 Flag and manifest changes for reftests on pandas landed on inbound.
• bug 881897 Reduce amount of polling and data transfer to hopefully reduce frequency of bug 807230
  • I have a try run in place which seems promising, but more testing required.

Autophone

• bc in Toronto this week. Some phones down and not recoverable until Friday night. Jobs are queued and will be processed once the phones are recovered.
• Transitioned to new mac mini autophone server.
• Worked on running autophone mochitests with skia enabled. Have some patches in development but delayed due to work week travel.

Eideticker

• Figured out problem with imgur test (bug 884907), just an errant link.

Round Table

• Can help to avoid SUTAgent deployment problems by asking RelEng to test in staging prior to deployment

Action Items

• ctalbert, dminor, gbrown to sort out x86 ownership for Q3
• kmoir to update patch for bug 882324 to run panda reftests