Mobile/Testing/08 19 15

From MozillaWiki
Jump to: navigation, search

Previous Action Items

Status reports

Dev team

Rel Eng

  • Stopped running Android 4.3 Debug robocop bug 1194474
  • Testing patches for bug 1195893 Change aws instance type for Android 4.3 Opt mochitests (M1..M16) to c3.xlarge
  • Had a meeting yesterday with a bunch of ateam folks, sheriffs re SETA. https://etherpad.mozilla.org/increasing-seta. The issue is that we cannot enable many new tests due to lack of capacity. To move forward with enabling bug 1183877 Increase total-chunks for Android 4.3 Debug crashtests, js-reftests, and reftests which creates 48 new jobs, I'll enable them on try and run pushes on known good changesets so we can generate data for SETA and extrapolate that data to other branches.

A Team

  • android-2-3-armv7-api9 Total failure rate: [1.49%]
    • last week 1.29%
    • total failure excluding retries 1.22%
  • android-4-3-armv7-api11 Total failure rate: [1.53%]
    • last week 2.46%
    • total failure excluding retries 0.89%

Data fetched for: 2015-08-11 08:33 — 2015-08-17 23:54

  • bug 1195514 Change Android 2.3 emulator screen size to 1024 x 1280
  • Working on enabling dom/media mochitests on Android 4.3 bug 1189784 and running the emulator from mach bug 1164596

Autophone

  • bug 1196115 Intermittent Crash Autophone S1S2Test beginning 2015-08-18
  • [bc] Before Autophone can become useful and replace Talos on Pandas, we must make it visible to the Sheriffs as at least a Tier-2 job. We currently have too many oranges due to either failure to detect measurements or due to known crashes which means Autophone is invisible to sheriffs and developers. This results in me being responsible for sheriffing and initating backouts. Autophone itself may be responsible for some of the failure to get measurements and I will make this a high priority this week. It is difficult to get traction on the crashes especially those with [unknown top frame] which is caused by the failure of minidump_stackwalk to parse the dmp files. If we are serious about using Autophone we must make a concerted effort to get it in shape to be visible on Treeherder. /rant.

Eideticker

Round Table

Action Items