Confirmed users
651
edits
QA/Desktop Firefox/Test Plan Templates/Firefox ESR: Difference between revisions
QA/Desktop Firefox/Test Plan Templates/Firefox ESR (view source)
Revision as of 23:10, 27 November 2012
, 27 November 2012→Update Testing
Mwobensmith (talk | contribs) |
|||
| (4 intermediate revisions by 2 users not shown) | |||
| Line 48: | Line 48: | ||
Softvision will fill out the ''assignee'' and ''results'' columns in the table. | Softvision will fill out the ''assignee'' and ''results'' columns in the table. | ||
=== Subsection: Update Testing === | |||
This section details the results of automated update testing. These tests need to be triggered manually by uploading a plain-text configuration file to the mozmill-ondemand server (details available upon request from ahughes@mozilla.com). | |||
Update tests are run on all supported platforms, 3 previous versions (usually the two most recent versions and the oldest version receiving the update), and 2 locales (usually en-US and one random locale). | |||
Before we give the go-ahead to release the build we run tests on ''releasetest'' channel. After we've given the go-ahead to release, RelEng pushes the snippets to the live channel and we run the tests again on the ''esr'' channel. | |||
In terms of evaluating the results, a '''PASS''' means the builds successfully applied the correct update. Try to spotcheck one or two results per platform (no need to check every single result). | |||
* any versions listed in ''Partial'' should receive a partial or partial+fallback update | |||
* any versions listed in ''Complete'' should receive a complete or complate+fallback update | |||
* the target build ID should match that of the release you are signing off | |||
=== Subsection: Bug Fix Verifications === | |||
This section details the bug fixes which must be verified before we sign off a release. List any bugs using the bugzilla template, changing '''status''' to '''verified''' when the bug has been tested and signed-off. | |||
=== Subsection: Issues === | |||
This section details any bugs found during testing this release or known to affect this release. For the most part, Softvision will fill out both of these tables. We need to evaluate the list of '''New''' issues for potential blocker regressions. Once reviewed and deemed non-critical, move the bug to the '''Known''' issues list. | |||
== Firefox ''version'' ESR == | == Firefox ''version'' ESR == | ||
| Line 78: | Line 96: | ||
| class="header" style="width:20%" | Platform | | class="header" style="width:20%" | Platform | ||
| class="header" style="width:30%" | Results: [http://link_to_mozmill_ci_report report] | | class="header" style="width:30%" | Results: [http://link_to_mozmill_ci_report report] | ||
|- | |- | ||
| Windows XP | | Windows XP | ||
| Line 92: | Line 107: | ||
|- | |- | ||
| Windows 7 64-bit | | Windows 7 64-bit | ||
| '''result''' - YYYY-MM-DD | |||
|- | |||
| Windows 8 32-bit | |||
| '''result''' - YYYY-MM-DD | |||
|- | |||
| Windows 8 64-bit | |||
| '''result''' - YYYY-MM-DD | | '''result''' - YYYY-MM-DD | ||
|- | |- | ||
| Line 98: | Line 119: | ||
|- | |- | ||
| Mac OS X 10.7 | | Mac OS X 10.7 | ||
| '''result''' - YYYY-MM-DD | |||
|- | |||
| Mac OS X 10.8 | |||
| '''result''' - YYYY-MM-DD | | '''result''' - YYYY-MM-DD | ||
|- | |- | ||
| Line 117: | Line 141: | ||
| class="header" | Result: [https://link_to_moztrap_report report] | | class="header" | Result: [https://link_to_moztrap_report report] | ||
|- | |- | ||
| Windows | | Windows 8 32-bit | ||
| tester | | tester | ||
| '''result''' - YYYY-MM-DD | | '''result''' - YYYY-MM-DD | ||
| Line 143: | Line 167: | ||
| class="header" | Releasetest: [https://link_to_mozmill_ondemand_report report] | | class="header" | Releasetest: [https://link_to_mozmill_ondemand_report report] | ||
| class="header" | ESR: [https://link_to_mozmill_ondemand_report report] | | class="header" | ESR: [https://link_to_mozmill_ondemand_report report] | ||
|- | |- | ||
| Windows XP | | Windows XP | ||
| Line 161: | Line 181: | ||
|- | |- | ||
| Windows 7 64-bit | | Windows 7 64-bit | ||
| '''result''' - YYYY-MM-DD | |||
| '''result''' - YYYY-MM-DD | |||
|- | |||
| Windows 8 32-bit | |||
| '''result''' - YYYY-MM-DD | |||
| '''result''' - YYYY-MM-DD | |||
|- | |||
| Windows 8 64-bit | |||
| '''result''' - YYYY-MM-DD | | '''result''' - YYYY-MM-DD | ||
| '''result''' - YYYY-MM-DD | | '''result''' - YYYY-MM-DD | ||
| Line 169: | Line 197: | ||
|- | |- | ||
| Mac OS X 10.7 | | Mac OS X 10.7 | ||
| '''result''' - YYYY-MM-DD | |||
| '''result''' - YYYY-MM-DD | |||
|- | |||
| Mac OS X 10.8 | |||
| '''result''' - YYYY-MM-DD | | '''result''' - YYYY-MM-DD | ||
| '''result''' - YYYY-MM-DD | | '''result''' - YYYY-MM-DD | ||