Auto-tools/Meetings/2012-09-17

Goals Progress

Below are our top level goals. Beneath each goal, note any progress made towards that goal this week.

• [ON TRACK] Support the B2G and platform team by moving existing automation to that platform as well as expanding automation on B2G and B2G devices for basecamp deliverables.
  • [jgriffin] Marionette is now run on debug Firefox on TBPL, for now hidden and only on try while we work a few bugs out.
  • [mcote, mihneadb] SUTAgent has heartbeat channel and passes all the tests.
• [ON TRACK] Expand Mobile testing platforms for B2G and Fennec Native to include user devices and NEON Chipsets (panda boards).
• [ON TRACK] Establish new Datazilla system as a useful tool for capturing and diagnosing talos performance regressions on a per-push basis, as well as capturing data for network and B2G performance tests.
  • NOTE: This is largely a change to the data harvesting and analysis side of the Talos system (even though some changes are required to the test harness and tests themselves). We will not be replacing existing Talos data harvesting system in Q3. By the end of Q3, we want to have the new performance data harvesting and analysis system Datazilla to a point at which it can shadow the old system and we can use Q4 to verify that the new approach captures just as many regressions as the old system does. Potential timeframe for conversion of the old system to the new Datazilla system is in Q1 2013 (earliest "thumb in the wind" estimate).
• [ON TRACK] Upgrade BMO to 4.2, deploy tracking flags optimizations, UX improvements (comment tagging, mid-air resolution)
• [ON TRACK] Make TBPL More Orange aware to make it easier to file intermittent orange bugs, and so that we can more adequately track (and therefore address) issues around android-related and memory leak intermittent failures
  • [edmorley] Sorted through logs for the top "manual starring" cases in meta bug 778688.
  • [edmorley] TBPL patches:
    • https://bugzil.la/718632,790889,790602,790618,790639,790963
  • [edmorley] Non-TBPL patches:
    • https://bugzil.la/790613,790960
    • Started looking at bug 790595 but blocked on bug 781341.
• [ON TRACK] Enable QA and contributors to increase their skills and participation by crafting automated tests for B2G and desktop smoketests by providing examples, mentoring, and documentation
  • [davehunt] New documentation overview pages for frameworks and tools. Please check to see if there is anything missing. The intention is to have an overview page for each item by the end of the quarter. I will be contacting people to help get this done.

Check out Pivotal Tracker

Highlights

This is a place for people to put announcements or to describe activities that they'd like to highlight. It's not the responsibility of the MC to find things to put here.

• [ahal] did talk at uwaterloo on b2g automation efforts (see http://people.mozilla.com/~ahalberstadt/presentation/slideshow.html)

In-Depth Project Discussion

Pick one project/presenter per week who will give a detail presentation on their project.

The Overview

Progress, notes, problems, and other statuses about current projects. Add any new projects to this template!

Bugzilla

• push: http://globau.wordpress.com/2012/09/13/happy-bmo-push-day-13/
• [glob] fixed more profanivore and securemail issues
• [glob] lots of "comment tagging" work
• [dkl] NEEDINFO extension work
• [dkl] ongoing "project review form"

Eideticker

• [wlach] - Blogged about new Eideticker features (profiling + startup tests) - http://wrla.ch/blog/2012/09/more-eideticker-happenings-profiling-and-startup-testing/

Marionette

• [mdas] worked on bug 746031 so iframe switching works with single chrome&content process, but fails with multiple content processes. Jgriffin will look into it this week.

Mobile Automation

• reftest in 4 chunks, fixed some svg tests to be faster
• panda smoketest is uncovering odd problems on the panda/os
• investigating the reftest failures on new tegras
• [ahal] did some work on reftest resolution, talked to layout folks, jmaher getting in touch with other browser vendors
• [ahal] did talk at uwaterloo on b2g automation efforts (see http://people.mozilla.com/~ahalberstadt/presentation/slideshow.html)
• [ahal] investigating why reftests don't work when run oop
• [mihneadb] add exec tests to SUT_tests
• [mihneadb] some minor improvements on SUTAgent

Mobile Evangelism Site-Scraping Tool

• [mihneadb] changed CSS data processing logic
• [mihneadb] changed UA sniffing processing logic
• [mihneadb] other minor improvements suggested in the feedback

New Graphserver (Datazilla)

• [jeads] Ran into some issues with talos data. Some test replicate values have a standard deviation of zero, this causes a divide by zero error in the t test. Added extensive error handling to detect this and log it in a new database table that we're using for an application log.
• [jeads] This issue delayed filing the bug to roll out new datazilla repository last week.
• [jeads] Finishing web service branch started by camd, should land early this week.

Talos

• xperf is now live and reporting properly to graph server

Sheriffing & Trees

• [edmorley] Day-to-day sheriffing of the trees.
• [edmorley] Email discussions about android tegra load due to the request to run both android and android-no-ion.
• [edmorley] Meeting with joduinn about multiple inbounds proposal.
• [edmorley] Patch for bug 781290 - Remove talos v8 support now that it is included in the dromaeojs suite.
• [edmorley] Non-TBPL patches for "Make TBPL More Orange Aware" goal:
  • https://bugzil.la/790613,790960
  • Started looking at bug 790595 but blocked on bug 781341.

Tinderboxpushlog

• [edmorley] Reviewed https://bugzil.la/791029,778231 and gave feedback on bug 774942.
• [edmorley] Several more hours of working through the TBPL codebase in order to be able to help a new contributor with bug 683833; I'm learning a lot myself! :-)
• [edmorley] Posted to dev.platform with list of recent TBPL changes.
• [edmorley] Debugging of log timeouts after prefetching landed (bug 790889).
• [edmorley] Created POA for switching intermittent failures to using a keyword, instead of whiteboard '[orange]', for faster bzapi searches (bug 790571).
• [edmorley] Patches for "Make TBPL More Orange Aware" goal:
  • https://bugzil.la/718632,790889,790602,790618,790639,790963
• [edmorley] Other patches:
  • https://bugzil.la/788020,790895,790939,791259

Automation Development

[rwood] Developing more WebTelephony WebAPI tests; WebSMS to follow

Upcoming Events

Standing weekly meeting related to our projects should go here

Round Table

• [wlach] - mozbase documentation hackfest at work week?
  • A clear deficiency in mozbase (compare https://wiki.mozilla.org/Auto-tools/Projects/MozBase to e.g. http://socorro.readthedocs.org/en/latest/)
  • Something we could hack on with the volunteers who are coming to the workweek (relatively low barrier to entry) -- we could even allow remote participation and/or bring in entirely new people from the Python community in Toronto.
  • Documenting is a great way of learning how something works!
• [davehunt] - Documentation overhaul - https://ateam.etherpad.mozilla.org/4
• [ctalbert] - Q4 Goals
  • Take notes on the etherpad

Holidays and Trips

• jmaher PTO this upcoming Friday the 21st
• [edmorley] Booked on a "first aid in the workplace" course Tues 18th to Thurs 20th.

Misc

Find something you think is cool, interesting, funny, or exciting and put it here