Auto-tools/Meetings/2013-07-08

Notices, Highlights, Roundtable

Mozbase workweek

• Two weeks ago, jgriffin, ahal, jhammel, wlach, ctalbert, chmanchester, mihneahdb, and gps gathered in SF to roadmap / plan the next steps for mozbase
• We now have a vision statement / elevator pitch for mozbase: "A mozilla-centered standard library to help us (and you!) build things faster"
• Moving away from emphasis in Q3 from "refactor all harnesses to mozbase" to "make it easier to bring up automation for new platforms using mozbase"
  • So for example, this means that refactoring the fennec automation in m-c to use mozbase is less important. So we're not going to do that in Q3. But work to finish B2G refactoring to use mozrunner continues to be a priority, as the work there will form an example that will hopefully make bringing up things like Mochitest on new platforms easier.
• Other mozbase work in Q3: Bugfixing / mirroring improvements (jhammel), unit tests (ffledging), documentation (wlach), structured logging (chmanchester).
• Lots more notes here (thanks ahal): https://wiki.mozilla.org/Auto-tools/Projects/Mozbase/Automation-Refactor/Meetings/2013-07-02
• Brief summary of Summit Planning Assembly by mcote

Goals

• Goal: Improve Developer/QA ergonomics around running and debugging automation by:
  • Add debugger support to B2G testrunners
  • Improve patch review experience on bugzilla/Make bugzilla more user-centric
  • Replace graph server with Datazilla for all desktop Talos tests
  • Create a project branch view of B2G builds/tests that tracks commits per target, rather than per repo (all commits to any repo for unagi for instance) joint with releng

• Goal: Improve stability, reliability, and scalability of automation platforms by:
  • Addressing all P1 B2G automation stability issues
  • Complete native REST interface for Bugzilla
  • Complete Mochitest to Mozbase port
  • Create POC Microbenchmark suite to get feedback from developers for its usefulness
  • Reduce orange factor to 5 or lower (for the last three weeks of the quarter) by driving awareness among developers, following up with assignees, and fixing intermittent automation failures.
  • Update pulse so that its dependent (client side) libraries are current for its use in Tree Herder
  • Create a prototype and a specification for a rig to power cycle real phones. Have a vendor selected to build the rig by end of quarter.

• Goal: Build toward our future by:
  • Deploy a minimally viable TBPL replacement by end of quarter, aim to switch over mid-Q3
  • Release a mozmill 2 and work with contributor community to drive toward a 2.1
  • Automate a scrolling fps test using camera Eideticker measurements for Contacts, Email, Settings, and Message apps
  • Create and Deploy BMO user profile data for community building and education
  • Create a solid net and filter system to build a bugmaster community
  • Identify 5 things we can do to increase our infrastructure capacity by 10% through more streamlined usage and bringing new capacity online. (joint with releng)
  • Enable performance and test automation to run on Android x86 hardware, investigate Android 2.3.x support on Pandas.

Deep Dives

Tools (2nd Monday)

Tinderboxpushlog

• [edmorley] New things in production: https://bugzil.la/875323,886823
• [edmorley] Patches:
  • bug 886838 - mcMerge's getFlags.php should set |Access-Control-Allow-Origin: *|
  • bug 883218 - Stop submitting starred bug comments to the metrics ES instance now we've transitioned off of it
  • Misc: https://bugzil.la/886823

War on Orange

• OrangeFactor on trunk for last 7 days: 4.14

Performance (3rd Monday)

Eideticker

• [wlach] - Android profiling runs re-enabled for Galaxy Nexus to help diagnose startup perf issues
• [wlach] - Had a meeting FirefoxOS perf team lead. Seems very interested in work-to-date (http://eideticker.mozilla.org/b2g).
• [wlach] - Working on ability to do responsiveness type tests for B2G and Android -- requires synchronized clocks, etc. See: bug 888102

General Framework Support (4th Monday)

In-tree Automation/Harnesses

• [edmorley] Patch to prevent leakstats from failing the build job on OS X if the log file was incomplete (bug 887234).

Process (4th Monday)

Sheriffing & Trees

• Gaia commit permissions have been given to {edmorley, KWierso, Tomcat} (RyanVM already had them) so we're now able to back out gaia commits upstream, if they caused breakage when the in-tree manifest was updated by the gaia auto-committer bot.
• [edmorley] A vpn_sheriff LDAP group has been created with members {edmorley, KWierso, philor, RyanvM, Tomcat}, which grants use of the RelEng slavealloc dashboard & access to the buildbot masters using the new unified MozillaVPN (see bug 886078, bug 887033 & bug 887450). This allows sheriffs to view the live stdout of running jobs (see bookmarklet in bug 809908 for making this quick from TBPL), control runaway buildslaves & perform more specific job retriggering.
• [edmorley] Patch to fix the mercurial commit message hook for gaia.json auto-commits (bug 887184).

Treestatus

• [edmorley] New things in production: https://bugzil.la/882124

Holidays and Trips

• [edmorley] Was on PTO the last week, updates above are from the week before.