Auto-tools/Meetings/2013-04-08

Notices, Highlights, Roundtable

• A new quarter, a new format! <-- take this line out of template next week
• Next steps, updating the project links and the project links all over the wiki.

Goals

• Goal: Improve Developer/QA ergonomics around running and debugging automation by:
  • Add debugger support to B2G testrunners
    • [ON TRACK] Half way through milestone 1
  • Improve patch review experience on bugzilla/Make bugzilla more user-centric
    • [ON TRACK] Half way through milestone 1
  • Replace graph server with Datazilla for all desktop Talos tests
    • [ON TRACK] Half way through milestone 1?
  • Create a project branch view of B2G builds/tests that tracks commits per target, rather than per repo (all commits to any repo for unagi for instance) joint with releng
    • Not started: getting agreement from releng

• Goal: Improve stability, reliability, and scalability of automation platforms by:
  • Addressing all P1 B2G automation stability issues
    • [ON TRACK] Halfway through milestone 1
  • Complete native REST interface for Bugzilla
    • Not started (not in milestone 1)
  • Complete Mochitest to Mozbase port
    • Milestone 1 STARTS!
  • Create POC Microbenchmark suite to get feedback from developers for its usefulness - waiting on confirmation from perf team on this priority
    • Not started: planned start: April 22
  • Reduce orange factor to 5 or lower (for the last three weeks of the quarter) by driving awareness among developers, following up with assignees, and fixing intermittent automation failures.
    • [ON TRACK] On track, following up on panda intermittent reboot issues
  • Update pulse so that its dependent (client side) libraries are current for its use in Tree Herder
  • Create a prototype and a specification for a rig to power cycle real phones. Have a vendor selected to build the rig by end of quarter.
    • [DONE] Milestone 1? Update?
• Goal: Build toward our future by:
  • Deploy a minimally viable TBPL replacement by end of quarter, aim to switch over mid-Q3
    • [DONE] Milestone 1? Update?
  • Release a mozmill 2 and work with contributor community to drive toward a 2.1
    • Milestone 1 starts!
  • Automate a scrolling fps test using camera Eideticker measurements for Contacts, Email, Settings, and Message apps
    • Status?
  • Create and Deploy BMO user profile data for community building and education
    • Not started: not in milestone 1
  • Create a solid net and filter system to build a bugmaster community
    • [ON TRACK] Milestone 1 underway
  • Identify 5 things we can do to increase our infrastructure capacity by 10% through more streamlined usage and bringing new capacity online. (joint with releng)
    • Milestone 1 starts
  • Enable performance and test automation to run on Android x86 hardware, investigate Android 2.3.x support on Pandas.
    • Milestone 1 starts

Deep Dives

Mobile (1st Monday)

B2G Automation

• Checktests for m-c desktop B2G builds will be enabled with the next RelEng reconfig \o/.
  • Will be enabling B2G ARM checktests on Cedar to see what their state is next.

Tools (2nd Monday)

Tinderboxpushlog

• [edmorley] New things in production: https://bugzil.la/857541,857535,857531,856004,841316
• [edmorley] Patches: https://bugzil.la/856004,857531,857535,857541
• [edmorley] Reviewed bug 857708.

War on Orange

• OrangeFactor on trunk for last 7 days: 6.86
• [edmorley], [mcote] Committed and deployed two fixes: bug 853635, bug 849951.
• [RyanVM] Ongoing efforts to engage developers and managers over top oranges.

Performance (3rd Monday)

Talos

• [edmorley] Patch for bug 857039.

General Framework Support (4th Monday)

In-tree Automation/Harnesses

• [edmorley] Patch to correct log parsing regex for crashes/leaks (bug 857636).

Process (4th Monday)

Sheriffing & Trees

• [edmorley] 4-day week due to public holiday.
• [edmorley] Made adjustments to Sheriffing/Job_Visibility_Policy in response to dev.tree-management discussions.
• [edmorley] Trychooser: Reviewed bug 855797, bug 855591.
• [edmorley] qimportbz: Patch for bug 858031.
• [edmorley] bzexport: Patch for bug 858053.

Treestatus

• [edmorley] Completed the switch to the Mozilla-controlled Github account (bug 823637).

Holidays and Trips

• [edmorley] PTO today (Monday 8th) for house moving prep.
• [mcote] out Tuesday, Wednesday, and Thursday for a funeral.