QA/Test Automation/2010-08-11

From MozillaWiki
Jump to: navigation, search

previous meeting | Meetings | next meeting »


  • Matt, Anthony, Geo, Henrik, Aaron, Al, Adrian

Last weeks action Items

  • [DONE] Henrik: Ask Clint, if there are plans for another beta release => Yes, by end of this week
  • [DONE] Henrik: Make sure that we differentiate between builds <3.6.9 and >=3.6.9 (Tracking on bug 567258)
  • [DONE] Henrik: Update index page of the couchapp to make sure no lags exist
  • [DONE] Henrik: Make sure that the Bugzilla component gets created
  • [DONE] Geo, Al: Feedback for Django vs. CouchApp
  • [DONE] Geo, Al: Feedback for database separation (release vs. crowd + archive)


Mozmill (Henrik)
  • Mozmill 1.4.2 Beta3 released last Friday
  • One more week of testing - file any bug you see!
  • WaitForPageLoad works with error pages now.
  • Testday] on Friday 13th
Test creation / shared modules (Henrik)
  • L10n support for Mozmill tests for older branches will land later this week
  • Start to collect possible tests for Add-ons Manager subgroup
Local Test Data (Anthony)
  • Simplest test pages landed: 11 pages
    • login form, web form, popup, 8 clones
  • Test conversion has begun
    • 31 on file: 26 NEW, 4 ASSIGNED, 1 FIXED
    • 7 complex (to be worked on later)
    • 15 remain remote (due to Mozmill limitations)
Broken Tests
  • Firefox 4.0 (Geo)
    • No update since last meeting. Will be fixing three known issues and scraping test results for more across next two weeks.
  • Firefox 3.5/3.6 (Anthony)
    • No update
Update Tests (Henrik)
  • Working with Rob Strong to get updates working on trunk and 1.9.2
MozMill Crowd extension (Henrik)
  • no update
Add-ons Testing (Henrik)
  • no update
Automation (Henrik)
  • Automation scripts have to be updated to be executable with Mozmill 1.4.2
  • Updating scripts and test-runs to send the necessary data to brasstacks
Result / Dashboard (Henrik)
  • Hope to have a first draft by end of this week for discussion

Risky Goals


  • Last two weeks
    • A couple of complex patches for Mozmill
    • Started on updating the automation scripts to make those compatible with Mozmill 1.4.2
    • Started to compile a list of possible Mozmill tests for the add-ons manager
  • Next two weeks
    • 1 week vacation
    • Create shared module for add-ons manager and finalize list of tests
    • Update all automation scripts to be compatible with Mozmill 1.4.2
    • Update the software update script to send full reports to brasstacks
    • Finalize specs for Web dashboard
    • Continue work on the crowd extension
  • Last two weeks
    • [DONE] Create local test pages for mozmill-tests
    • [DONE] Get commit access
  • Next two weeks
    • Complete conversion of 31 tests to use local-data
  • Last two weeks
    • Looked at script for Bug 553618 briefly and did some thinking on script for bug 553617.
    • Moved the plugin tests and geolocation pages into the Litmus repo (which may be useful for later scripts).
  • Next two weeks
    • Get script for Bug 553618 re-fixed and submitted.
    • Figure out what we can do with microsummary restrictions.
  • Last two weeks:
  • Next two weeks:
    • Continuing with Shared API Refactor project
    • Fixes for bug 573582, bug 573584, bug 575250
    • Reviewing test results for any additional breakage
    • Help with 1.4.2 beta release as needed
  • Last two weeks:
    • Verifying and working with Henrik on test related 1.4.2 beta bugs
    • Working with Anthony in efforts to convert tests to use local-data
    • Continuing efforts on resolving broken test fails
    • 1.4.2 Bespin IDE testing
  • Next two weeks:
    • Help with the 1.4.2 release
    • Continue conversion of tests to use local-data
    • Continue investigating Linux VM failures (qa-mozmill/horus)
  • Last two weeks:
  • Next two weeks:
    • L10n support in existing tests backport to 1.9.1
    • work on L10nAPI

Contributor Status

  • Name


  • When updating qa lab machines (Mozmill 1.4.2)
    • Updates will happen 1-2 weeks after the release of Mozmill 1.4.2
  • First QA Automation team video (creation during the work week)
    • Workweek: Introductory + team members
    • 1st level: Global overview (for recruiting community members)
    • 2nd level: Howto for major automation goals by team members
  • Mozmill: Updating the event API to see if events have been processed not approved for Mozmill 1.4.2 (bug 583604)

Action Items

  • [DONE] Henrik: Send testday invitation to mozmill-dev and planet
  • Henrik: We need a bug for Mozmill 2.0 to allow usage of different web servers
  • Henrik: Create outline proposal for team video
  • Matt: Check what limits test harnesses on buildbot to use other local webservers
  • Matt: Discuss with Marcia the length of each video for teams
  • Geo: We need feedback from Clint about the scope and feature set for Mozmill 2.0
  • All: Check the proposed docs for the shared module refactoring from Geo