Mobile/Testing/02 05 14

Previous Action Items

• snorp will verify that flash apk installed on pandas via try
• snorp will talk to jmaher about talos improvements to find gradual, long-term regressions

Status reports

IT

aws vpn/releng scl3 fw - releng looking at offloading traffic from the aws ip-sec tunnels (HG is particularly heavy). This should lighten the load on the fw.

A Team

• tegra failure rate: [6.46%]
  • last week 2.54
• panda failure rate: [16.42%]
  • last week 27.08
  • excluding retries 1%

Android 2.3 emulator

• mozharness updated
• all tests running (and failing) on Ash

Autophone

• bug 967052 Autophone - improve UI to handle large numbers of phones and repositories.
• Tested using /data/local/tmp/profile for profile locations. This appears to help reduce the variability of the measurements. See bug 852264 - [s1s2] don't hardcode URLs for local test files. Waiting for review. Since this will change the measurement values, I am taking the opportunity to clean up the Twitter test page to remove unused Javascript elasticsearch code.
• Investigated using usb networking.
  • usb reverse tethering is a possibility though support across versions is problematic. Reached out to Szymon at Google. He provided some suggestions and the following:
    • https://github.com/anirudhSK/wtcp/blob/master/TetheringOverUSB.txt
    • https://code.google.com/p/chromium/codesearch#chromium/src/tools/telemetry/telemetry/core/backends/android_rndis.py
  • snorp mentioned adb port forwarding, but I haven't been able to get this to work.
• Have the two Nexus 5 phones. Will get them online after bug 852264 lands.
• Will set up two instances of Autophone:
  • s1s2 testing with traffic shaping using mac mini host
  • mochitest canvas skia testing without traffic shaping using linux vm.

Round Table

• Android startup crashes: bug 959254, bug 957433, etc
• If we end up needing Android 2.3 on pandas for performance testing, will we need more panda infrastructure? Is the current panda infrastructure being fully utilized (efficiently)?
• SUTAgent isn't connecting to test server
• wget issue?

Action Items

• snorp will talk to jmaher about talos improvements to find gradual, long-term regressions
• gbrown will investigate slow Android 2.3 reftests
• gbrown will follow-up on startup crashes with :glandium
• jake will ask around about bug 967452