QA/Desktop Firefox/Test Plan Templates/Firefox ESR: Difference between revisions

QA/Desktop Firefox/Test Plan Templates/Firefox ESR (view source)

1,167 bytes added , 5 November 2012

Confirmed users

14,525

edits

@@ Line 48: / Line 48: @@
 Softvision will fill out the ''assignee'' and ''results'' columns in the table.
+=== Subsection: Update Testing ===
+This section details the results of automated update testing. These tests need to be triggered manually by uploading a plain-text configuration file to the mozmill-ondemand server (details available upon request from ahughes@mozilla.com).
+Update tests are run on all supported platforms, 3 previous versions (usually the two most recent versions and the oldest version receiving the update), and 2 locales (usually en-US and one random locale).
+Before we give the go-ahead to release the build we run tests on ''releasetest'' channel. After we've given the go-ahead to release, RelEng pushes the snippets to the live channel and we run the tests again on the ''esr'' channel.
+In terms of evaluating the results, a '''PASS''' means the builds successfully applied the correct update. Try to spotcheck one or two results per platform (no need to check every single result).
+* any versions listed in ''Partial'' should receive a partial or partial+fallback update
+* any versions listed in ''Complete'' should receive a complete or complate+fallback update
+* the target build ID should match that of the release you are signing off
 == Firefox ''version'' ESR ==