Mobile/Testing/07 08 15

From MozillaWiki
Jump to: navigation, search

Previous Action Items

Status reports

Dev team

Rel Eng

A Team

  • android-2-3-armv7-api9 Total failure rate: [0.68%]
    • last week 0.85%
    • total failure excluding retries 0.63%
  • android-4-3-armv7-api11 Total failure rate: [0.97%]
    • last week 0.93%
    • total failure excluding retries 0.53%

Data fetched for: 2015-07-01 11:56 — 2015-07-07 23:37

  • adb hangs now time-out and generally throw a DMError, which is now classified as retries (blue) instead of error (orange)
  • emulator startup failures now retry also
  • bug 1085591 moved most fennec initialization off of onWindowFocusChanged; improves (eliminates?) bug 1054292 and bug 1094649
  • bug 1149164 apk (and other) file sizes displayed in treeherder (select build, check "Job details")
  • emulator startup screenshots available
  • 4.3 Debug reftests too slow -- even on c3.2xlarge with 2x memory and 2x cpu, and even on ix
    • Debug reftests are slow on desktop too:
      • OS X 10.10 opt R (12105 tests) 28 minutes
      • OS X 10.10 debug R (12105 tests) 65 minutes
      • Android 4.3 API11+ opt R1 (705 tests) 49 minutes
      • Android 4.3 API11+ debug R1 (705 tests) 120 minutes

Autophone

  • Learning Puppet deployment in preparation for Bug 1129534 - Autophone - Replace autophone.qa.mtv2.mozilla.com
  • Auto restart on USB disconnections working wonderfully.
  • Throbber Start Win
    • Bug 1167808 - chrome service worker 'read-through-caching' demo does not load correctly
  • Throbber Stop Win (Hat tip to Seth Fowler)
    • Bug 1120511 - Autophone - Twitter Throbber stop regression 2015-01-15
      • Bug 1163856 - Considering delaying the image load event until the size is available instead of performing a sync size decode
      • Bug 1174923 - Stop delaying the document load event until images are decoded
      • Bug 1180931 - Decode image headers on the main thread on single core devices (fixes regression on single core devices from bug 1163856)
  • Fixed
    • Bug 1180235 - Autophone - enable reboot on error in production
    • Bug 1179880 - Autophone - retry any exceptions when posting to treeherder
    • Bug 1177491 - Autophone - standardize custom fennec preferences and environment variables for tests
    • Bug 1155885 - Autophone - should automatically recover when devices are disconnected
    • Bug 1176014 - Autophone - increase stderrp_reject from 15 to 50% in webappstartup
    • Bug 1175594 - set pref to allow flash in S1S2Test

Eideticker

  • Still truckin'

Round Table

Action Items

  • wlach will talk to perf team about test pages and report back