Auto-tools/Meetings/2012-09-17

Goals Progress

Below are our top level goals. Beneath each goal, note any progress made towards that goal this week.

• [ON TRACK] Support the B2G and platform team by moving existing automation to that platform as well as expanding automation on B2G and B2G devices for basecamp deliverables.
  • [jgriffin] Marionette is now run on debug Firefox on TBPL, for now hidden and only on try while we work a few bugs out.
  • [mcote, mihneadb] SUTAgent has heartbeat channel and passes all the tests.
• [ON TRACK] Expand Mobile testing platforms for B2G and Fennec Native to include user devices and NEON Chipsets (panda boards).
• [ON TRACK] Establish new Datazilla system as a useful tool for capturing and diagnosing talos performance regressions on a per-push basis, as well as capturing data for network and B2G performance tests.
  • NOTE: This is largely a change to the data harvesting and analysis side of the Talos system (even though some changes are required to the test harness and tests themselves). We will not be replacing existing Talos data harvesting system in Q3. By the end of Q3, we want to have the new performance data harvesting and analysis system Datazilla to a point at which it can shadow the old system and we can use Q4 to verify that the new approach captures just as many regressions as the old system does. Potential timeframe for conversion of the old system to the new Datazilla system is in Q1 2013 (earliest "thumb in the wind" estimate).
• [ON TRACK] Upgrade BMO to 4.2, deploy tracking flags optimizations, UX improvements (comment tagging, mid-air resolution)
• [ON TRACK] Make TBPL More Orange aware to make it easier to file intermittent orange bugs, and so that we can more adequately track (and therefore address) issues around android-related and memory leak intermittent failures
• [ON TRACK] Enable QA and contributors to increase their skills and participation by crafting automated tests for B2G and desktop smoketests by providing examples, mentoring, and documentation
  • [davehunt] New documentation overview pages for frameworks and tools. Please check to see if there is anything missing. The intention is to have an overview page for each item by the end of the quarter. I will be contacting people to help get this done.

Check out Pivotal Tracker

Highlights

This is a place for people to put announcements or to describe activities that they'd like to highlight. It's not the responsibility of the MC to find things to put here.

• [ahal] did talk at uwaterloo on b2g automation efforts (see http://people.mozilla.com/~ahalberstadt/presentation/slideshow.html)

In-Depth Project Discussion

Pick one project/presenter per week who will give a detail presentation on their project.

The Overview

Progress, notes, problems, and other statuses about current projects. Add any new projects to this template!

Bugzilla

• push: http://globau.wordpress.com/2012/09/13/happy-bmo-push-day-13/
• [glob] fixed more profanivore and securemail issues
• [glob] lots of "comment tagging" work
• [dkl] NEEDINFO extension work
• [dkl] ongoing "project review form"

Eideticker

• [wlach] - Blogged about new Eideticker features (profiling + startup tests) - http://wrla.ch/blog/2012/09/more-eideticker-happenings-profiling-and-startup-testing/

Marionette

• [mdas] worked on bug 746031 so iframe switching works with single chrome&content process, but fails with multiple content processes. Jgriffin will look into it this week.

Mobile Automation

• reftest in 4 chunks, fixed some svg tests to be faster
• panda smoketest is uncovering odd problems on the panda/os
• investigating the reftest failures on new tegras
• [ahal] did some work on reftest resolution, talked to layout folks, jmaher getting in touch with other browser vendors
• [ahal] did talk at uwaterloo on b2g automation efforts (see http://people.mozilla.com/~ahalberstadt/presentation/slideshow.html)
• [ahal] investigating why reftests don't work when run oop
• [mihneadb] add exec tests to SUT_tests
• [mihneadb] some minor improvements on SUTAgent

Mobile Evangelism Site-Scraping Tool

• [mihneadb] changed CSS data processing logic
• [mihneadb] changed UA sniffing processing logic
• [mihneadb] other minor improvements suggested in the feedback

New Graphserver (Datazilla)

• [jeads] Ran into some issues with talos data. Some test replicate values have a standard deviation of zero, this causes a divide by zero error in the t test. Added extensive error handling to detect this and log it in a new database table that we're using for an application log.
• [jeads] This issue delayed filing the bug to roll out new datazilla repository last week.
• [jeads] Finishing web service branch started by camd, should land early this week.

Talos

• xperf is now live and reporting properly to graph server

Sheriffing & Trees

• [edmorley] Day-to-day sheriffing of the trees.
• [edmorley] Email discussions about android tegra load due to the request to run both android and android-no-ion.
• [edmorley] Meeting with joduinn about multiple inbounds proposal.
• [edmorley] Patch for bug 781290 - Remove talos v8 support now that it is included in the dromaeojs suite.
• [edmorley] Non-TBPL patches for "Make TBPL More Orange Aware" goal:
  • bug 790613 - Make sut_tools prefix failures with "Automation Error:" or "Remote Device Error:" so TBPL's parser can recognise them
  • bug 790960 - Catch IOErrors of the form in bug 572127 and output with the TBPL compatible "talosError:" prefix
  • Started looking at bug 790595 but blocked on bug 781341.

Automation Development

[rwood] Developing more WebTelephony WebAPI tests; WebSMS to follow

Upcoming Events

Standing weekly meeting related to our projects should go here

Round Table

• [wlach] - mozbase documentation hackfest at work week?
  • A clear deficiency in mozbase (compare https://wiki.mozilla.org/Auto-tools/Projects/MozBase to e.g. http://socorro.readthedocs.org/en/latest/)
  • Something we could hack on with the volunteers who are coming to the workweek (relatively low barrier to entry) -- we could even allow remote participation and/or bring in entirely new people from the Python community in Toronto.
  • Documenting is a great way of learning how something works!
• [davehunt] - Documentation overhaul - https://ateam.etherpad.mozilla.org/4
• [ctalbert] - Q4 Goals
  • Take notes on the etherpad

Holidays and Trips

• jmaher PTO this upcoming Friday the 21st

Misc

Find something you think is cool, interesting, funny, or exciting and put it here