Auto-tools/Meetings/2012-07-02

Goals Progress

Below are our top level goals. Beneath each goal, note any progress made towards that goal this week.

• [DONE] Extend Mobile Platform Automation for B2G and Fennec Native to extend our automation systems to work with specific phone hardware and new development boards for both products.

• [DONE] Datazilla: Provide generic interfaces/web app plugability for new harnesses to reuse the same infrastructure backend
  • We now have error-tracking in place that will make it easier to track down issues with data we are getting from test harnesses.

• [DONE] Datazilla: Ensure that new UI is based on extensible statistics package that can be used both by developers and the graphserver UI.
  • NOTE: Revised deliverable in light of developer feedback and changed course mid-quarter to deliver a system that would turn TBPL orange/green based on per-patch regression detection, this means we won't deliver the UI by end of quarter, but we'll still land datazilla on production hardware in end of Q2/early Q3 (waiting on hardware to arrive)
    • Hardware has arrived, IT is working on setting everything up, security review meeting will be this week.

• [DONE] Signal From Noise Phase II - Make the same noise-reduction changes we made on Tp5 on all the other page-load tests and ensure all performance tests are sending raw observations to Datazilla.

• [DONE] Refactor how rapid-release tracking flags are implemented for improved performance and maintainability
  • Code complete, just needs testing (and lots of it).
  • May schedule for after 4.2 so that we don't have to retest with 4.2.

• [AT RISK] Upgrade bugzilla.mozilla.org to Bugzilla version 4.2
  • [glob+dkl] Testing of BMO 4.2 code and debugging and fixing of several issues such as HTML email, SecureMail, etc.
  • SecureMail raising more issues than expected.
  • Expect test systems to be sanitised and open early this week.
  • Hopefully aiming for release around July 23.

• [DONE] Reduce android test automation instability and make it easier for the web QA and desktop QA teams to write and run automated tests.

Highlights

This is a place for people to put announcements or to describe activities that they'd like to highlight. It's not the responsibility of the MC to find things to put here.

In-Depth Project Discussion

Pick one project/presenter per week who will give a detail presentation on their project.

The Overview

Progress, notes, problems, and other statuses about current projects. Add any new projects to this template!

Bughunter

[bc] Working on testing Flash crashiness, developing test cases and testing updates to crash reporter

Bugzilla

• http://globau.wordpress.com/2012/06/28/happy-bmo-push-day-3/
• [glob+dkl] bmo/4.2 testing and fixing
• [dkl+glob] various upstream reviews and patches
• [dkl] securemail updates for 4.2
• [glob] qa-migration scheduling
• [glob] improvements to bmo/4.2's bugmail
• [dkl] component search now everywhere!
• [dkl+glob] bmo administrative work, as always

Jetperf

• [jhammel] need to serialize addons for datazilla upload
• [jhammel] jetperf config files WIP

Marionette

• [mdas] updated b2g build times, updated b2g perf test code and test runner, currently investigating why marionette on emulator is broken.
• [mdas] fixed one regression (bug 761202) but bug 753490 is proving to be difficult, need to spend more time on this next week.

Mobile Evangelism Site-Scraping Tool

• [samliu, carljm] - spider successfully crawls the list of 18,000 sites with multiple UA strings, following links one level deep, and storing all HTML/CSS/JS

MozBase

• [henrik] MozInstall 1.1 has been released (no assert in is_installer() anymore)

Mozmill

• [henrik] A couple more of refactoring patches for Mozmill have been landed (PEP8, --restart)
• [henrik] We now use pprint-color as default logging format (Mutt takes that too)
• [henrik] Transformed our mozmill-automation scripts to a real Python package
• [henrik] Added support for functional, remote, and l10n testruns to mozmill-automation for Mozmill 2

MozTrap

• [camd] completed the results API feature and tests
• [carljm] figured out broken result-api test and reviewed and merged result-api branch to master
• [camd] created a 1.1.X branch and requested it be pulled to staging (moztrap.allizom.org)

New Graphserver (Datazilla)

• [jeads] Putting the finishing touches on a two legged Oauth implementation in datazilla. This is in preparation for the datazilla security review this week.
• [carljm] implemented error-tracking for data ingestion, so when data is missing we have a record of exactly why it failed to ingest
• [carljm] increased test coverage of core data model code from 30% to 85% (full coverage of data ingestion code, missing coverage of UI-support code)
• [samliu] completed implementation of objectstore branch, separating acceptance of data via REST endpoint from actual data ingestion

Talos

[jhammel] talos now serializes for datazilla using simplejson/json

Sheriffing & Trees

• [edmorley] Day-to-day sheriffing of the trees.
• [edmorley] Infra/tree closure issues:
  • Tracking down >5x increase in previously unseen intermittent failures.
• [edmorley] More m-cMerge testing, filed: #10, #11, #12 & #13.
• [edmorley] Discussions with peterbe about the changes in direction for the new Sheriff Duty site.

Tinderboxpushlog

• [edmorley] More papercuts filed: https://bugzil.la/767915,768386
• [edmorley] Patches to fix the reftest analyser for both local testing and prod.
• [edmorley] Reviewed bug 768386 & bug 769018.
• [edmorley] Deployed: https://bugzil.la/768474,768386,769018

War on Orange

• [edmorley] Reviewed bug 765193.
• [edmorley] OrangeFactor patches:
  • Document testing the OrangeFactor UI from the local filesystem.
  • Lower the default number of days displayed to 7.
  • Add a new default 'Trunk' tree that combines mozilla-central & inbound.
  • Clean up index.html.

Upcoming Events

Standing weekly meeting related to our projects should go here

Round Table

Put your questions and things to raise with the entire team here

Misc

Find something you think is cool, interesting, funny, or exciting and put it here