QA/Test Automation/2011-03-09

previous meeting | Meetings | next meeting »

Dial in

 # 650-903-0800 or 650-215-1282 x92 Conf# 315 (US/INTL)
 # 1-800-707-2533 (pin 369) Conf# 315 (US)
 # irc.mozilla.org #mozmill for backchannel

Attendees

• ashughes - away at dentist

Last weeks action Items

Geo

• [DONE] Document failed test process from henrik's email at appropriate place
  • Added instructions to disable/re-enable Litmus to Fixing Broken Tests

Henrik

• [DONE] Send mail to qa-auto for proposal of mozmill-tests refactor (bug 637306)
• [DONE] Send mail for possible qa automation work week

Matt

• [DONE] Talk with IT to get the shadow server setup

Goals Overview

• Q1 goals

Project Status

On-demand update tests (Geo/Henrik)

• Plan for deployment on qa-set done
• Will deploy in parallel copies of the script directories to isolate from current scripts
• Delaying deployment onto Linux due to already-existing VM problems
• notes
  • Still working on it
  • need to discover
  • linux vms are broken on qahorus
  • poised to get on qaset

Endurance Tests (Dave/Anthony)

• Add-ons patches landed last week (run with add-ons, download add-ons, report add-ons)
• Memory leak discovered during testday when Greasemonkey is installed. bug 639515

• Notes
  • good feadback and tons of results from testday, 1000's of tests
    • have checked these results?
    • sometime this week for reviewing the results

Panorama Tests (Anthony/Al)

• 12 tests blocked by bug 629165 due to drag & drop dependencies
• 8 tests currently being developed
• 1 test remaining to be picked up by someone
• 1 test checked-in
• Targeting completion of all unblocked tests by next automation meeting

Redesign Shared Modules (Geo/Henrik)

• Finishing up Milestone 1
• Currently in Refactor Round, speeding through many small fixes to get code polished and aligned with current standards.
• Discussions continue with A-Team re: upstreaming shared modules. They've agreed to adopt the assertion model and some form of the basic Element class (still working out final structure). Plans are to upstream all Widget classes, though schedule is still being determined.

Shadow web server (Al/Henrik)

• Virtual machine was provisioned at Rackspace this morning.
  • Still needs to be configured for net access by Phong.
  • Naked server (despite request) so Al gets to go re-learn how to get Apache up and running securely!
  • Hope to have everything up and running within next few days and cron job for cloning data from hg configured.

Others

Mozmill Crowd

• Fixed a problem with the test environment on all platforms which didn't let us specify more than 9 options for the run script
• Investigating a way how to distribute Mercurial pre-installed in test environments without requiring the user to install Xtools on OS X (bug 545432)

Dashboard

• Fix for the l10n view to distinct between fatal and non-fatal assertions

On Demand Provisioning (Cloud Automation) (Al/Henrik)

• Waiting for physical server to arrive and be deployed at PHX colo.
  • Last update on March 1 from Phong: "I am going to order a new blade for this and put this in PHX."

Tests / Shared Modules

General (Henrik)

• Check-ins in the last two weeks

Broken Tests

• A couple of failures have been fixed by copying the Ubuntu 10.10 machine from qa-set to qa-horus (Linux VM's still sluggish, probably kernel incompatibilities with vmware tools)

Automation Scripts / Infrastructure (Henrik)

• Rewrite of the automation scripts will start in this week; has to be ready for testday on March 25th

Personal Status

For the personal status please check the weekly status updates:

• 110228 - 110304
• 110307 - 110311

Roundtable

General

• bug 637306: Final decision for refactoring the mozmill-tests repository

Refactor Milestone 1 Review

• Milestone review etherpad