QA/Test Automation/2011-03-09

From MozillaWiki
Jump to: navigation, search

previous meeting | Meetings | next meeting »

Dial in

 # 650-903-0800 or 650-215-1282 x92 Conf# 315 (US/INTL)
 # 1-800-707-2533 (pin 369) Conf# 315 (US)
 # #mozmill for backchannel


  • ashughes - away at dentist

Last weeks action Items

  • [DONE] Document failed test process from henrik's email at appropriate place
  • [DONE] Send mail to qa-auto for proposal of mozmill-tests refactor (bug 637306)
  • [DONE] Send mail for possible qa automation work week
  • [DONE] Talk with IT to get the shadow server setup

Goals Overview

Risky Goals

Project Status

On-demand update tests (Geo/Henrik)

  • Plan for deployment on qa-set done
  • Will deploy in parallel copies of the script directories to isolate from current scripts
  • Delaying deployment onto Linux due to already-existing VM problems
  • notes
    • Still working on it
    • need to discover
    • linux vms are broken on qahorus
    • poised to get on qaset

Endurance Tests (Dave/Anthony)

  • Add-ons patches landed last week (run with add-ons, download add-ons, report add-ons)
  • Memory leak discovered during testday when Greasemonkey is installed. bug 639515

  • Notes
    • good feadback and tons of results from testday, 1000's of tests
      • have checked these results?
      • sometime this week for reviewing the results

Panorama Tests (Anthony/Al)

  • 12 tests blocked by bug 629165 due to drag & drop dependencies
  • 8 tests currently being developed
  • 1 test remaining to be picked up by someone
  • 1 test checked-in
  • Targeting completion of all unblocked tests by next automation meeting

  • Notes
    • all but 1 tests is assigned
    • get the rest checked in within the next few weeks

Redesign Shared Modules (Geo/Henrik)

  • Finishing up Milestone 1
  • Currently in Refactor Round, speeding through many small fixes to get code polished and aligned with current standards.
  • Discussions continue with A-Team re: upstreaming shared modules. They've agreed to adopt the assertion model and some form of the basic Element class (still working out final structure). Plans are to upstream all Widget classes, though schedule is still being determined.

  • Notes
    • sprint 1 complete
    • negotiating with A-team regarding structure and format. Concerned that they may slow us down.

Shadow web server (Al/Henrik)

  • Virtual machine was provisioned at Rackspace this morning.
    • Still needs to be configured for net access by Phong.
    • Naked server (despite request) so Al gets to go re-learn how to get Apache up and running securely!
    • Hope to have everything up and running within next few days and cron job for cloning data from hg configured.

  • Notes
    • yeah, we have the machine
    • Matt owns the domain and needs to transfer to new machine
    • naked machine, Al needs to install everything
      • not sure what OS distro it is
    • certs on sub-domains
    • Al will come up with a provision plan
    • hg clone of files from litmus
      • 15min clone process
    • could use hudson
      • lets just use cron for now


Mozmill Crowd

  • Fixed a problem with the test environment on all platforms which didn't let us specify more than 9 options for the run script
  • Investigating a way how to distribute Mercurial pre-installed in test environments without requiring the user to install Xtools on OS X (bug 545432)

  • Notes
    • should have things resolved next week


  • Fix for the l10n view to distinct between fatal and non-fatal assertions

  • Notes
    • version 2 now

On Demand Provisioning (Cloud Automation) (Al/Henrik)

  • Waiting for physical server to arrive and be deployed at PHX colo.
    • Last update on March 1 from Phong: "I am going to order a new blade for this and put this in PHX."

  • Notes
    • waiting for machine to be installed in PHX colo

Tests / Shared Modules

General (Henrik)
Broken Tests
  • A couple of failures have been fixed by copying the Ubuntu 10.10 machine from qa-set to qa-horus (Linux VM's still sluggish, probably kernel incompatibilities with vmware tools)

Automation Scripts / Infrastructure (Henrik)

  • Rewrite of the automation scripts will start in this week; has to be ready for testday on March 25th

  • Notes

Personal Status

For the personal status please check the weekly status updates:


  • bug 637306: Final decision for refactoring the mozmill-tests repository
Refactor Milestone 1 Review

  • Notes
    • need agreement on directory structure
    • Dave proposal looks great
    • should files directory become data
    • review of milestone 1
      • see etherpad above for a comprehensive description

Meeting Notes

Action items