games

• http://clb.demon.fi:8112/waterfall

Automation and Tools Project Tracking Central

Goals

2013Q4

Verify and Track

• Graydon's Android and b2g testing in emualtors on VMs: bug 910092

B2G

• B2G tests and automation: https://bugzilla.mozilla.org/showdependencytree.cgi?id=916356&hide_resolved=1
• B2G Desktop specific bugs: https://bugzilla.mozilla.org/showdependencytree.cgi?id=916127&hide_resolved=1
• B2G - Performance test tracking: https://wiki.mozilla.org/B2G/Performance#Test_Coverage
• B2G Reftests out of process - bug 922680
• B2G Details: https://wiki.mozilla.org/Auto-tools/Projects/B2G_Automation
• fix make-test-perf: bug 916017
• memory consumption tests (addition to endurance? Need to dive in and see if this is reinventing the wheel) bug 917717
• https://etherpad.mozilla.org/b2g-automation-meeting-notes
• Make B2G Desktop working Gaia Dev Environment: https://bugzilla.mozilla.org/show_bug.cgi?id=816961
• Dashboards: http://charts.mozilla.org/ffos/

SteepleChase

• https://bugzilla.mozilla.org/showdependencytree.cgi?id=894559&hide_resolved=1

Structured Logging

• Structured logging tracking bug: https://bugzilla.mozilla.org/showdependencytree.cgi?id=916295&hide_resolved=1

Talos

• Understanding what the hell us up with Talos running faster on weekends: https://bugzilla.mozilla.org/show_bug.cgi?id=908888#c25
• Figuring out how to run a no-chrome test on modern fennec: bug 908810

Datazilla

• Wire up eideticker to datazilla (bug??)
• Datazilla papercuts, going to need to buckle down and do these or find community contributors (and make it possible for them to do these) bug 913726

Performance

• Power usage investigation (on desktop, requires specific hardware. Jmaher and bc pursuing )
• Real world benchmarking tool for the JS team: https://github.com/jmaher/livemetrics ; see also https://etherpad.mozilla.org/js-benchmarking

Android

• Complete x86 automation tracking bug: bug 891959
  • bug 917562 - intermittent crash on x86 emulated builds

Top Goals for next quarter

Goals list for next quarter

Other Projects and ongoing maintenance

• Symbols not being processed due to networking issues in colo: bug 913864
• bug 863834 Review test types and failures to see what correlations there are between test types (and whether any can be turned off, as well as whether or not we need to run every test on every push)

Other team's Projects we depend on

• bug 910379 - Shepherd project from jlal & co.
• bug 917375 - power draw test harness from b2g perf team
• bug 793989 - able to schedule jobs provided just the artifacts (schedule jobs that never happened in the first place) - depending on for bisect in the cloud, running tests intermittently etc
• bug 749421 - upload files from test slaves - code coverage and structured logging depend on this support
• bug 881389 - gecko logging improvements - could be a boon across all test frameworks, especially if we can find a way to get developers the ability to do a printf and a logging statement that doesn't go into logcat on b2g/android (so that it doesn't get eaten by the circular logger)
  • possibly related: https://www.kernel.org/doc/ols/2009/ols2009-pages-39-46.pdf
• Gaia Try Infrastructure (mostly releng) depends on: bug 914632
• Build System Goals: https://etherpad.mozilla.org/build-system-goals
• Games Benchmarking Results - https://drive.google.com/folderview?id=0B4oIhk2zTox4NEpQTWxmMDdtQ1E&usp=sharing&usp=sharing#
• Nice to have: trees to accept try syntax: bug 925797
• Nice to have: possibly redundant if we take over test slaves and scheduling: defining a smoke test before running full tests: bug 863838

Things to keep an eye on

• Phabricator - http://gregoryszorc.com/blog/2013/10/14/phabricator-is-awesome/
• http://www.windowsazure.com/en-us/pricing/details/virtual-machines/
• http://blogs.scalablelogic.com/2012/11/running-10000-node-grid-engine-cluster.html
• http://dev.treeherder.mozilla.org/ui/#/jobs :-)

QA

One and done

• https://wiki.mozilla.org/QA/Taskboard/Version1-Milestone1
• https://quality.mozilla.org/2013/10/qa-taskboard-development-call-for-participation/
• https://github.com/mozilla/oneanddone

Community

• https://wiki.mozilla.org/QA/Community_Champions

Projects Impacting Quality

B2G

• Touch Events: https://bugzilla.mozilla.org/show_bug.cgi?id=891882
• B2G Desktop OOP: https://bugzilla.mozilla.org/show_bug.cgi?id=845161
• Tarako memory usage tracking: https://bugzilla.mozilla.org/show_bug.cgi?id=917717
• APZC: https://bugzilla.mozilla.org/show_bug.cgi?id=950841
• js-integration/gaia ui oranges: https://bugzilla.mozilla.org/show_bug.cgi?id=952611
• Paper cuts and quality issues
  • https://bugzilla.mozilla.org/show_bug.cgi?id=949551 fx os papercuts
  • https://bugzilla.mozilla.org/show_bug.cgi?id=950779 - phone switchers
  • https://bugzilla.mozilla.org/show_bug.cgi?id=950779 magic fairy dust

Gfx

• https://docs.google.com/a/mozilla.com/spreadsheet/ccc?key=0AnKFEBp1-VyqdFNfRlZmV0ExM0VvZGMxNThWX0d6LWc&usp=drive_web#gid=0

User Reported Bugs and Bugzilla Dashboard metrics

• https://bugzilla.mozilla.org/show_bug.cgi?id=949275
• https://etherpad.mozilla.org/bugzilla-questions
• https://etherpad.mozilla.org/bugzilla-dashboard

Web QA

• Engagement web projects: https://docs.google.com/a/mozilla.com/spreadsheets/d/1X5kUBkEAicEe2unDaaLGTYzAJbphWFoaJYBTasHrcHQ/edit#gid=1030506488

Overall projects

• EOL rev 3 minis: https://bugzilla.mozilla.org/show_bug.cgi?id=864866
  • Run b2g emulators on AWS: https://bugzilla.mozilla.org/show_bug.cgi?id=850105