canmove, Confirmed users, Bureaucrats and Sysops emeriti
4,747
edits
QA/Test Automation/2010-08-11: Difference between revisions
m
→Action Items
m (→Action Items) |
|||
| (22 intermediate revisions by 6 users not shown) | |||
| Line 2: | Line 2: | ||
=Attendees= | =Attendees= | ||
* Matt, Anthony, Geo, Henrik, Aaron, Al, Adrian | |||
=Last weeks action Items= | =Last weeks action Items= | ||
* {{done|}} Henrik: Ask Clint, if there are plans for another beta release => Yes, by end of this week | * {{done|}} Henrik: Ask Clint, if there are plans for another beta release => Yes, by end of this week | ||
* {{done|}} Henrik: Make sure that we differentiate between builds <3.6.9 and >=3.6.9 (Tracking on bug 567258) | * {{done|}} Henrik: Make sure that we differentiate between builds <3.6.9 and >=3.6.9 (Tracking on bug 567258) | ||
* Henrik: Update index page of the couchapp to make sure no lags exist | * {{done|}}Henrik: Update index page of the couchapp to make sure no lags exist | ||
* {{done|}} Henrik: Make sure that the Bugzilla component gets created | * {{done|}} Henrik: Make sure that the Bugzilla component gets created | ||
* Geo, Al: Feedback for Django vs. CouchApp | * {{done|}} Geo, Al: Feedback for Django vs. CouchApp | ||
* Geo, Al: Feedback for database separation (release vs. crowd) | * {{done|}} Geo, Al: Feedback for database separation (release vs. crowd + archive) | ||
=Projects= | =Projects= | ||
;Mozmill (Henrik) | ;Mozmill (Henrik) | ||
* Mozmill 1.4.2 Beta3 released last Friday | |||
* One more week of testing - file any bug you see! | |||
* WaitForPageLoad works with error pages now. | |||
* [http://quality.mozilla.org/events/2010/08/11/testday-mozmill-firefox-sync-and-tab-candy-friday-august-13th/ Testday]] on Friday 13th | |||
;Test creation / shared modules (Henrik) | ;Test creation / shared modules (Henrik) | ||
* L10n support for Mozmill tests for older branches will land later this week | * L10n support for Mozmill tests for older branches will land later this week | ||
* Start to collect possible tests for Add-ons Manager subgroup | |||
* | |||
;Local Test Data (Anthony) | ;Local Test Data (Anthony) | ||
| Line 26: | Line 27: | ||
** login form, web form, popup, 8 mozilla.org clones | ** login form, web form, popup, 8 mozilla.org clones | ||
* Test conversion has begun | * Test conversion has begun | ||
** [https://bugzilla.mozilla.org/buglist.cgi?status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=litmus-data&component=Mozmill%20Tests&product=Testing 31 on file] | ** [https://bugzilla.mozilla.org/buglist.cgi?status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=litmus-data&component=Mozmill%20Tests&product=Testing 31 on file]: 26 NEW, 4 ASSIGNED, 1 FIXED | ||
** 7 complex (to be worked on later) | ** 7 complex (to be worked on later) | ||
** 15 remain remote (due to Mozmill limitations) | ** 15 remain remote (due to Mozmill limitations) | ||
;Broken Tests | |||
* Firefox 4.0 (Geo) | |||
** No update since last meeting. Will be fixing three known issues and scraping test results for more across next two weeks. | |||
* Firefox 3.5/3.6 (Anthony) | |||
** No update | |||
;Update Tests (Henrik) | ;Update Tests (Henrik) | ||
* Working with Rob Strong to get updates working on trunk and 1.9.2 | |||
;MozMill Crowd extension (Henrik) | ;MozMill Crowd extension (Henrik) | ||
| Line 39: | Line 46: | ||
* no update | * no update | ||
; | ;Automation (Henrik) | ||
* | * Automation scripts have to be updated to be executable with Mozmill 1.4.2 | ||
* Updating scripts and test-runs to send the necessary data to brasstacks | |||
;Result / Dashboard (Henrik) | ;Result / Dashboard (Henrik) | ||
* Hope to have a first draft by end of this week for discussion | |||
=Risky Goals= | =Risky Goals= | ||
| Line 49: | Line 58: | ||
;Henrik | ;Henrik | ||
* Last two weeks | * Last two weeks | ||
** | ** A couple of complex patches for Mozmill | ||
** | ** Started on updating the automation scripts to make those compatible with Mozmill 1.4.2 | ||
** | ** Started to compile a list of possible Mozmill tests for the add-ons manager | ||
** | |||
* Next two weeks | * Next two weeks | ||
** 1 week vacation | |||
** Create shared module for add-ons manager and finalize list of tests | |||
** Update all automation scripts to be compatible with Mozmill 1.4.2 | |||
** Update the software update script to send full reports to brasstacks | |||
** Finalize specs for Web dashboard | |||
** Continue work on the crowd extension | |||
;Anthony | ;Anthony | ||
| Line 64: | Line 79: | ||
;Al | ;Al | ||
* Last two weeks | * Last two weeks | ||
** Looked at script for [https://bugzilla.mozilla.org/show_bug.cgi?id=553618 Bug 553618] briefly and did some thinking on script for [https://bugzilla.mozilla.org/show_bug.cgi?id=553617 bug 553617]. | |||
** Moved the plugin tests and geolocation pages into the Litmus repo (which may be useful for later scripts). | |||
* Next two weeks | * Next two weeks | ||
** Get script for [https://bugzilla.mozilla.org/show_bug.cgi?id=553618 Bug 553618] re-fixed and submitted. | |||
** Figure out what we can do with microsummary restrictions. | |||
;Geo | ;Geo | ||
* Last two weeks: | * Last two weeks: | ||
** Verifying 1.4.2 beta fixes | |||
** Getting [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Shared_Modules_Refactor Shared API Refactor] project off the ground | |||
* Next two weeks: | * Next two weeks: | ||
** Continuing with Shared API Refactor project | |||
** Fixes for {{bug|573582}}, {{bug|573584}}, {{bug|575250}} | |||
** Reviewing test results for any additional breakage | |||
** Help with 1.4.2 beta release as needed | |||
;Aaron | ;Aaron | ||
* Last two weeks: | * Last two weeks: | ||
** Verifying and working with Henrik on test related 1.4.2 beta bugs | ** Verifying and working with Henrik on test related 1.4.2 beta bugs | ||
** Working with Anthony | ** Working with Anthony in efforts to convert tests to use local-data | ||
** Continuing efforts on broken test fails | ** Continuing efforts on resolving broken test fails | ||
** 1.4.2 Bespin IDE testing | |||
* Next two weeks: | * Next two weeks: | ||
** Help with the 1.4.2 release | |||
** Continue conversion of tests to use local-data | |||
** Continue investigating Linux VM failures (qa-mozmill/horus) | |||
;Adrian | ;Adrian | ||
* Last two weeks: | * Last two weeks: | ||
** L10n support in existing tests backported to 1.9.2 (review pending) | |||
** started a repository for the work on the L10nAPI ( http://bitbucket.org/adrianer/mozmill-tests/ ) | |||
* Next two weeks: | * Next two weeks: | ||
** L10n support in existing tests backport to 1.9.1 | |||
** work on L10nAPI | |||
=Contributor Status= | =Contributor Status= | ||
| Line 86: | Line 119: | ||
=Roundtable= | =Roundtable= | ||
;General | ;General | ||
* When updating qa lab machines (Mozmill 1.4.2) | |||
** Updates will happen 1-2 weeks after the release of Mozmill 1.4.2 | |||
* First QA Automation team video (creation during the work week) | |||
** Workweek: Introductory + team members | |||
** 1st level: Global overview (for recruiting community members) | |||
** 2nd level: Howto for major automation goals by team members | |||
;Issues | ;Issues | ||
* Mozmill: Updating the event API to see if events have been processed not approved for Mozmill 1.4.2 ({{bug|583604}}) | |||
=Action Items= | =Action Items= | ||
* {{done|}} Henrik: Send testday invitation to mozmill-dev and planet | |||
* Henrik: We need a bug for Mozmill 2.0 to allow usage of different web servers | |||
* Henrik: Create outline proposal for team video | |||
* Matt: Check what limits test harnesses on buildbot to use other local webservers | |||
* Matt: Discuss with Marcia the length of each video for teams | |||
* Geo: We need feedback from Clint about the scope and feature set for Mozmill 2.0 | |||
* All: Check the proposed docs for the shared module refactoring from Geo | |||