Auto-tools/Meetings/2012-12-03

From MozillaWiki
Jump to: navigation, search

Goals Progress

Below are our top level goals. Beneath each goal, note any progress made towards that goal this week.

  • Ensure B2G has all test automation available to prepare for launch
    • [ON TRACK] Deploy B2G Test Automation into TBPL running on Emulator and Panda platforms. Specifically we are turning on:
      • [DONE] Mochitest-plain (emulator first, panda second)
      • [SKIPPED] Mochitest-chome (emulator first, panda second)
      • [DONE] Reftest (emulator first, panda second
      • [ON TRACK] xpcshell (panda)
      • [DONE] webAPI (emulator only
      • [ON TRACK] webQA - gaia front end tests emulator and panda
      • [ON TRACK] gaia dev integration/unit tests emulator and panda
    • [ON TRACK] Maintain B2G dog food update server as well as builds for development and QA while working to hand them off to releng
    • [ON TRACK] Ensure all webAPIs testable through the emulator have comprehensive automated tests
    • [ON TRACK] Continue to aid QA in creating automated tests for B2G
  • Expand and stabilize Test Automation on new and existing device platforms for NEON and ARMv6 support.
    • [AT RISK] Have APC.io (ARMv6)boards smoketest ready - rooted, working, plugged into Autophone
    • [ON TRACK] Monitor deployment of large scale android and B2G panda board testing, aid with bug investigations
    • [DONE] Implement a new pool-based approach for device management in automation to increase stability on all mobile device testing
      • Version 1.0 released. Mozharness script using mozpool is in review.
    • [ON TRACK] Deploy Autophone (Noah's Ark) mochitest and robocop test abilities.
  • Create and deploy performance automation for desktop, fennec, and B2G product benchmarks
    • [ON TRACK] Create Eideticker tests for B2G on panda boards and run them once a day
    • [ON TRACK] Monitor Datazilla webservices and ensure our accuracy in detecting performance regressions on a per-push basis
    • [ON TRACK] Deploy Datazilla per-push UI to make it easier for developers to dig into the causes of performance regressions
  • Update our bugzilla instance to 4.2 providing many benefits from UI to helping people keep track of bugs/projects from within Bugzilla.
    • [DEFER] Deploy 4.2 version of Bugzilla
      • Deferred due to conflict with B2G.
    • [ON TRACK] Ensure that bug migration tools are in place for B2G so that we can share bugs with outside services and partners.
    • [ON TRACK] Complete the 'Sandstone' CSS update
    • [DEFER] Rework browserID <--> BMO integration
      • Deferred due to B2G-related distractions.
    • [ON TRACK] Deliver user and product dashboards
    • [DEFER] Deploy tracking flags extension database optimization
      • Deferred due to conflict with B2G.
  • Make the process of sheriffing easier by updating TBPL and helping make it easier to handle the intermittent test problem
    • [ON TRACK] Aid with B2G changes so that B2G oranges tracked in Orange factor, B2g tests show up in TBPL
      • See Sheriffing/TBPL/War on Orange sections below for progress this week. See Smartsheet for overall progress.
    • [ON TRACK] Make it easier to sheriff and diagnose issues through better notification and automatic suggestions of issues for intermittent failures
      • See Sheriffing/TBPL/War on Orange sections below for progress this week. See Smartsheet for overall progress.
    • [DONE] Split mochitest browser-chrome from mochitest-other to improve parallelism and overall turnaround time.
    • [ON TRACK] Make orange factor update more than once a day to help make it easier to see changes over time
    • [ON TRACK] Assist with getting Datazilla's UI integrated with TBPL, phase 1
  • Expand and Modernize the QA Automation framework as well as make it easier and more clear how to write automated tests for QA.
    • [ON TRACK] Re-organize and improve the automated testing documentation at MDN
    • [ON TRACK] Develop first round of unit tests for WebRTC
    • [ON TRACK] Ensure all B2G device WebAPIs testable through emulators have comprehensive low level test coverage

Highlights

This is a place for people to put announcements or to describe activities that they'd like to highlight. It's not the responsibility of the MC to find things to put here.

  • [edmorley] The top frame of crashes is now shown in TBPL's annotated summary (bug 813650), making it easier to identify crashes without opening the full logs \o/

In-Depth Project Discussion

Pick one project/presenter per week who will give a detail presentation on their project.

The Overview

Progress, notes, problems, and other statuses about current projects. Add any new projects to this template!

AutoPhone/Noah's Ark

Bughunter

Bugzilla

  • https://globau.wordpress.com/2012/11/28/happy-bmo-push-day-21/
  • upgrade of bmo to 4.2 deferred to Q1 2013 to minimise disruption to b2g work
  • [glob] loads of performance related investigation and measurements, resulting in a few updates
  • [dkl] significant work on the 4.2 dashboards
  • [dkl] work on sandstone skin for bmo
  • [dkl+glob] quite a few upstream reviews

Eideticker

Firebug Testing

Jetperf

Marionette

Mobile Automation

  • [ahal] B2G xpcshell tests close to being enabled on cedar (bug 809233)
  • [mcote] & [dustin] from RelOps: mozpool 1.0 released.

Mobile Evangelism Site-Scraping Tool

Mochitest

MozBase

Mozmill

MozTrap

  • [camd] - Added new features for 1.3. Should push this out today.

New Graphserver (Datazilla)

Open Web Apps

Peptest

Powerball

Pulse

Signal From Noise

Speedtests

Systems

Talos

Sheriffing & Trees

  • [edmorley] Day-to-day sheriffing of the trees.
  • [edmorley] More sorting through Tegras to find chronically failing ones that have come back to life or aren't as fixed after recovery as believed.
  • [edmorley Cleaning up loose ends from the switch from [orange] to keyword = intermittent-failure. Set up & documented half a dozen whines to replace the functionality of the alias=randomorange bug.
  • [edmorley] Interview for the new sheriff position.
  • [edmorley] Patches:
  • [edmorley] Reviewed bug 809753.

Treestatus

Tinderboxpushlog

War on Orange

  • [edmorley] Compared OrangeFactor reported failures against intermittent-failure bugs to see what is missing. Filed bugs to resolve gaps in coverage (bug 817268 and dependants).
  • [edmorley] Ongoing backouts of newly introduced flaky tests, disabling chronic top-oranges & backporting orange fixes to aurora/beta/esr.

Web QA

Automation Development

  • [rwood] Updated patch for bug 794301 [WebAPI] WebSMS: Develop a test to verify marking an SMS message read/unread
  • [rwood] Finished two tests for MobileConnection WebAPI, awaiting developer feedback (bug 811580)
  • [rwood] Now looking at Screen Orientation WebAPI

Upcoming Events

Standing weekly meeting related to our projects should go here

Round Table

  • Q4 goals, 2 weeks left (considering holiday and vacation time)
  • Q1 Goals - write them down before somebody else does
  • Unit Test Reading, Writing and 'Rithmatic [bc]

Take notes here and copy and paste them to this section afterwards.

Notes

Holidays and Trips

  • [mcote], [glob], and [dkl] in San Francisco from Dec 10-14.
  • [jgriffin] on jury duty the week of Dec 10.

Next week MC

Misc

Find something you think is cool, interesting, funny, or exciting and put it here

Retrieved from "https://wiki.mozilla.org/index.php?title=Auto-tools/Meetings/2012-12-03&oldid=491697"