Auto-tools/B2GAutomation/Meetings/2014-03-27

https://etherpad.mozilla.org/b2g-automation-meeting-notes

Action items from previous meeting

• jgriffin to file bug about getting gaia try server jobs to run without the builds
  • [DONE] https://bugzilla.mozilla.org/show_bug.cgi?id=986209 ; discussed with aki at b2g-cross-functional meeting, will be prioritized high, but lower than Tarako and Flame builds
• jgriffin to set up meeting with Gaia devs regarding potential "common harness" for Python and JS Marionette tests
  • [DONE] meeting on March 28
• jgriffin to file a bug to get tests turned on for 1.3T branch on TBPL
  • [DONE] but builds on that branch currently broken; will need more releng attention to get them running, and then likely some agreement on sheriffing to prevent them from rotting immediately. bajaj will follow-up here to determine course of action.

Round Table

James Lal discussed TaskCluster and how it will be a replacement for Travis and TBPL, initially only for B2G tests on b2g-inbound. The timeline for that is a little fuzzy, so it was decided to move from Travis to Gaia Tryserver temporarily, until TaskCluster/Treeherder are ready.

• jgriffin to file a bug to get github commit hook -> gaia tryserver
  • per pull request taskcluster tasks running and reporting to treeherder http://treeherder-dev.allizom.org/ui/#/jobs?repo=gaia
• gwagner to identify a Gaia resource to work on the gaia commit hook, and that resource will work with releng to implement it
• a-team to get gaia linter and build jobs in TBPL

Problem areas

• make test-perf is not reporting data to datazilla: https://bugzilla.mozilla.org/show_bug.cgi?id=987383 [owner: hub]
• the Tarako used for b2gperf tests is failing to flash: https://bugzilla.mozilla.org/show_bug.cgi?id=973046 [owner: stephend]
• gaia-integration tests in TBPL don't conform to sheriff visibility guidelines: https://bugzilla.mozilla.org/show_bug.cgi?id=986206 [owner: evanxd]
• gaia pulling head of gaia-node-modules repo; can lead to unsheriffable breakages: https://bugzilla.mozilla.org/show_bug.cgi?id=988114 [owner: hub]

Completed

• on-device Jenkins site has moved: http://selenium.qa.mtv2.mozilla.com:8080/view/B2G/
  • may need to file IT bug for access via Mozilla VPN
• Memory leak during gaia-endurance tests has been identified as coming from recent console changes; see https://bugzilla.mozilla.org/show_bug.cgi?id=976584** b2gperf bisection tool prototype is ready: https://bugzilla.mozilla.org/show_bug.cgi?id=943611 ; davehunt wrote a blog post explaining this: http://blargon7.com/2014/03/hunting-for-performance-regressions-in-firefox-os/
• Sprint 1 delivery for the FirefoxOS Branding Certification Suite: https://bugzilla.mozilla.org/show_bug.cgi?id=970615
• Make Marionette always enabled in B2G desktop builds: https://bugzilla.mozilla.org/show_bug.cgi?id=979650

In progress

• Moving on-device automation jobs to use TBPL per-commit builds, instead of nightly builds with a newer gaia flashed on top
• Get Gaia try jobs to run with a pre-existing build (joint with releng): https://bugzilla.mozilla.org/show_bug.cgi?id=986209
• Get Eideticker running against Tarako devices (ETA: ~2 weeks)
• FirefoxOS Branding Certification Suite: https://bugzilla.mozilla.org/show_bug.cgi?id=970615
• B2G AreWeSlimYet tests: https://bugzilla.mozilla.org/show_bug.cgi?id=899194 ; Waiting for AWSY dashboard to be updated for B2G data.
• Adding gaia-ui-tests on emulators on TBPL: https://bugzilla.mozilla.org/show_bug.cgi?id=916368
• Fixing bugs related to B2G manifests, see https://bugzilla.mozilla.org/show_bug.cgi?id=943326 and https://bugzilla.mozilla.org/show_bug.cgi?id=983662
• Schedule media mochitests on emulator-jb on trunk branches: https://bugzilla.mozilla.org/show_bug.cgi?id=889772
• More mach support for B2G, see https://bugzilla.mozilla.org/show_bug.cgi?id=980952
• Run gaia-integration tests on-device: https://bugzilla.mozilla.org/show_bug.cgi?id=979077
• Add mach target for gaia-ui-tests: https://bugzilla.mozilla.org/show_bug.cgi?id=987746