Auto-tools/B2GAutomation/Meetings/2014-01-09

From MozillaWiki
Jump to: navigation, search

Etherpad

https://etherpad.mozilla.org/b2g-automation-meeting-notes

Previous Action Items

  • jgriffin to bring up Gaia testability with devs

Status Reports

Marionette

In queue

In progress

  • [davehunt] Are we meant to be uplifting all Marionette changes to mozilla-aurora? We had a recent TBPL failure due to a missing uplift, and I can go through and make sure everything is up to date if needed.
    • [jgriffin] No, let's keep our uplifts to branches that have a lot of ongoing B2G development.

Blocked

Completed

  • [ato] Wait class to use Marionette's default time out if set to reduce boilerplate -- bug 957248
  • [ato] Variety of expected conditions for Marionette that makes tests easier to write -- bug 948075
  • [ato] The exception on timeout in Wait indicates timeout duration -- bug 957162

Eideticker

In queue

In progress

  • [wlach] - Trying to account for camera noise so we can measure animation smoothness with pointgrey cameras -- bug 917404
  • [davehunt] - Trying to get remote access to eideticker-london so I can update the CI instance and get it reporting to the dashboard -- bug 916989

Blocked

Completed

  • [wlach] / [davehunt] - Move workload population to tests (bug 942826), should make eideticker more deterministic (almost ready to go pending a few revisions)

WebQA's Jenkins Automation (gaiatest, b2gperf)

In queue

In progress

  • [davehunt] Discovered that we can't scroll using Marionette when APZ is enabled (it's now enabled by default in master) -- bug 958036

Blocked

  • Add 128MB Hamachi runs for b2gperf - bug 950691
    • blocked by lack of builds

Completed

Tests in TBPL

In queue

  • Gaia-integration enhancements
    • Frequent intermittent failure of gaia-integration tests due to npm install errors - bug 953309
    • Gaia-integration harness needs to manage its own timeouts, rather than letting buildbot do it - bug 953212
    • Gaia-integration harness needs crash handling, bug TBD
    • Gaia-integration harness not reporting passed/failed tests in format needed by TBPL - bug 953319
    • All of these need an owner, most likely gaye
  • IPC mochitests run in parent process, bug TBD

In progress

  • [jgriffin] Get debug B2G mochitests running on emulators on all trunk branches - bug 916359
    • Still chasing frequent intermittents; will follow-up with gwagner to see where we are.
  • [ahal] B2G desktop reftests running on cedar - bug 916350
    • due to many failures, going to only run reftest-sanity for now
  • [ahal] OSX B2G desktop Gu may be ready to go live across all branches soon
  • [ahal] Working to reduce log size of b2g desktop mochitests as they are reaching the limit - bug 957768
  • [ahal] Investigating lack of crash stacks in gaia ui tests - bug 949028

Blocked

Completed

Long-running Tests (endurance, MTBF, AWSY)

In queue

  • [rwood] Help Taipei team implement crash/error detection routines for MTBF that can be used in other harnesses as well
  • [rwood] Gaia-UI endurance test review

In progress

  • [rwood] Get memory tests running per-commit and reporting to AWSY - bug 899194

Blocked

Completed

Round Table

  • [jgriffin] populating items in the queue
  • [davehunt] Can we start running the Gaia UI tests against emulator? -- bug 946649

Action Items

  • [jgriffin] (carry over) discuss testability with Gaia devs
  • [jgriffin] find owner for Service Now request regarding remote access to London Eideticker machine
  • [jgriffin] figure out if we're ready to schedule gaia-ui-tests against emulators on cedar