QA/Test Automation/2011-01-26

From MozillaWiki
Jump to navigation Jump to search

previous meeting | Meetings | next meeting »

Dial in

 # 650-903-0800 or 650-215-1282 x92 Conf# 315 (US/INTL)
 # 1-800-707-2533 (pin 369) Conf# 315 (US)
 # irc.mozilla.org #mozmill for backchannel

Attendees

Last weeks action Items

  • Geo: Update documentation for handling of failing Mozmill tests
    • Did not update this, but the handling is somewhat up in the air right now. After the roundtable from this meeting should know better how to proceed.
  • [DONE] Anthony: Update coding styles and keep discussion on-going to get remaining important rules defined

Goals Overview

Risky Goals

Project Status

On-demand update (bft) tests (Geo/Henrik)

  • Short updates

Endurance Tests (Dave/Anthony)

  • Tracking bug created. bug 629065
  • Patch uploaded for shared-module and initial test snippet. bug 629069
  • Patch uploaded for endurance testrunner. bug 629077
  • Created branch for endurance tests reports in Mozmill dashboard. bug 629083 repository
  • Reports have been generated using the current patches and published to a cloudone account:

Panorama Tests (Anthony/Al)

  • Community contributor (uyclay) has 4 tests which are nearly ready to checkin
  • Drag&Drop issue bug 515776 "resolved"
  • All tests should now be non-blocked, in theory
  • Will be putting a call out soon to team for assignments (stay tuned)
  • If you want to get a jump on it, see the list and assign something to yourself

Redesign Shared Modules (Geo/Henrik)

  • Short updates

Shadow test server (Al/?)

  • Short updates

Others

Mozmill Crowd

  • Mozmill Crowd 0.1 and an improved version 0.1.1 has been released
  • We already have some daily users (81 downloads, 8 active users)
  • Working on project page updates and milestones for this quarter
  • Next planned version of Mozmill Crowd by next week
  • Mozmill Crowd talk during FOSDEM 2011 on Sunday, Feb 6th

Dashboard

  • Working on project updates and milestones for this quarter
  • Implementation of necessary views for l10n tests earlier this week

Tests / Shared Modules

General (Henrik)
  • No progress - first Panorama tests still under review
Broken Tests
  • Firefox 4.0
    • Landed a lot of fixes; down to one single test failure on Linux
  • Firefox 3.5/3.6 (Anthony/Aaron)
    • Bug with window.close() not being properly handled (bug 626674) - fix should be landed today after branch release work, eliminating failures related to windows hanging around
    • Bug with testPasteLocationBar (bug 624682) - reverted from new controller MenuAPI to using the old controller click access of popup menu items, revealed another issue on 3.5 with keypress copying

Automation Scripts / Infrastructure (Henrik)

  • Download script for builds has been finished and can be used
  • Work happens now on the wrapper script to auto-start download and the test-run.

Personal Status

For the personal status please check the weekly status updates:

Roundtable

General
  • Testing of 32bit builds on Ubuntu 64?
  • Value of the execution of Mozmill tests for all locales (Henrik)
    • l10: A huge amount of issues has been covered by the testrun
    • Update: 1 crasher bug has been identified for 3 locales (bug 628829)
    • Pros vs. Cons
      • Check stability and quality of all localized builds
      • No need for manual update spot checks
      • Limited number of machines (what about the new order?)
      • We should test from Tier1 -> Tier3 (limit to Tier1 for smoketests and test channels?)
      • What about BFT tests? A single test-run for a locale will take about 12 minutes. We could run in parallel while Waverly tests manually
Issues

Meeting Notes

Action items

Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Test_Automation/2011-01-26&oldid=280338"