Auto-tools/Meetings/2012-09-17

From MozillaWiki
Jump to: navigation, search

Goals Progress

Below are our top level goals. Beneath each goal, note any progress made towards that goal this week.

  • [ON TRACK] Support the B2G and platform team by moving existing automation to that platform as well as expanding automation on B2G and B2G devices for basecamp deliverables.
    • [jgriffin] Marionette is now run on debug Firefox on TBPL, for now hidden and only on try while we work a few bugs out.
    • [mcote, mihneadb] SUTAgent has heartbeat channel and passes all the tests.
  • [ON TRACK] Expand Mobile testing platforms for B2G and Fennec Native to include user devices and NEON Chipsets (panda boards).
  • [ON TRACK] Establish new Datazilla system as a useful tool for capturing and diagnosing talos performance regressions on a per-push basis, as well as capturing data for network and B2G performance tests.
    • NOTE: This is largely a change to the data harvesting and analysis side of the Talos system (even though some changes are required to the test harness and tests themselves). We will not be replacing existing Talos data harvesting system in Q3. By the end of Q3, we want to have the new performance data harvesting and analysis system Datazilla to a point at which it can shadow the old system and we can use Q4 to verify that the new approach captures just as many regressions as the old system does. Potential timeframe for conversion of the old system to the new Datazilla system is in Q1 2013 (earliest "thumb in the wind" estimate).
  • [ON TRACK] Upgrade BMO to 4.2, deploy tracking flags optimizations, UX improvements (comment tagging, mid-air resolution)
  • [ON TRACK] Make TBPL More Orange aware to make it easier to file intermittent orange bugs, and so that we can more adequately track (and therefore address) issues around android-related and memory leak intermittent failures
  • [ON TRACK] Enable QA and contributors to increase their skills and participation by crafting automated tests for B2G and desktop smoketests by providing examples, mentoring, and documentation
    • [davehunt] New documentation overview pages for frameworks and tools. Please check to see if there is anything missing. The intention is to have an overview page for each item by the end of the quarter. I will be contacting people to help get this done.

Check out Pivotal Tracker

Highlights

This is a place for people to put announcements or to describe activities that they'd like to highlight. It's not the responsibility of the MC to find things to put here.

In-Depth Project Discussion

Pick one project/presenter per week who will give a detail presentation on their project.

The Overview

Progress, notes, problems, and other statuses about current projects. Add any new projects to this template!

AutoPhone/Noah's Ark

Bughunter

Bugzilla

Eideticker

Firebug Testing

Jetperf

Marionette

  • [mdas] worked on bug 746031 so iframe switching works with single chrome&content process, but fails with multiple content processes. Jgriffin will look into it this week.

Mobile Automation

  • reftest in 4 chunks, fixed some svg tests to be faster
  • panda smoketest is uncovering odd problems on the panda/os
  • investigating the reftest failures on new tegras
  • [ahal] did some work on reftest resolution, talked to layout folks, jmaher getting in touch with other browser vendors
  • [ahal] did talk at uwaterloo on b2g automation efforts (see http://people.mozilla.com/~ahalberstadt/presentation/slideshow.html)
  • [ahal] investigating why reftests don't work when run oop
  • [mihneadb] add exec tests to SUT_tests
  • [mihneadb] some minor improvements on SUTAgent

Mobile Evangelism Site-Scraping Tool

  • [mihneadb] changed CSS data processing logic
  • [mihneadb] changed UA sniffing processing logic
  • [mihneadb] other minor improvements suggested in the feedback

Mochitest

MozBase

Mozmill

MozTrap

New Graphserver (Datazilla)

  • [jeads] Ran into some issues with talos data. Some test replicate values have a standard deviation of zero, this causes a divide by zero error in the t test. Added extensive error handling to detect this and log it in a new database table that we're using for an application log.
  • [jeads] This issue delayed filing the bug to roll out new datazilla repository last week.
  • [jeads] Finishing web service branch started by camd, should land early this week.

Open Web Apps

Peptest

Powerball

Pulse

Signal From Noise

Speedtests

Systems

Talos

  • xperf is now live and reporting properly to graph server

Sheriffing & Trees

  • [edmorley] Day-to-day sheriffing of the trees.
  • [edmorley] Email discussions about android tegra load due to the request to run both android and android-no-ion.
  • [edmorley] Meeting with joduinn about multiple inbounds proposal.
  • [edmorley] Patch for bug 781290 - Remove talos v8 support now that it is included in the dromaeojs suite.
  • [edmorley] Non-TBPL patches for "Make TBPL More Orange Aware" goal:

Treestatus

Tinderboxpushlog

War on Orange

Web QA

Automation Development

[rwood] Developing more WebTelephony WebAPI tests; WebSMS to follow

Upcoming Events

Standing weekly meeting related to our projects should go here

Round Table

Take notes here and copy and paste them to this section afterwards.

Notes

Holidays and Trips

  • jmaher PTO this upcoming Friday the 21st
  • [edmorley] Booked on a "first aid in the workplace" course Tues 18th to Thurs 20th.

Next week MC

Misc

Find something you think is cool, interesting, funny, or exciting and put it here