Releases/Firefox 11/Test Plan: Difference between revisions

Releases/Firefox 11/Test Plan (view source)

Revision as of 22:40, 10 March 2012

4,213 bytes added , 10 March 2012

→‎Beta 7

Ashughes

Confirmed users

14,525

edits

@@ Line 2,102: / Line 2,102: @@
   | '''PASS''' - 2012-03-09
   | '''PASS''' - 2012-03-09
+ |}
+; Issues
+* Some failures due to slow mirrors
+=== Issues ===
+; New
+{|class="querytable"
+ |class="header" style="width:60%" | Bug
+ |class="header" style="width:40%" | Status
+ |-
+ |}
+==Beta 8==
+Builds: [ftp://ftp.mozilla.org/pub/firefox/nightly/11.0b8-candidates/build1/ FTP], [http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/11.0b8-candidates/build1/ HTTP]<br/>
+Litmus: [https://litmus.mozilla.org/run_tests.cgi?test_run_id=439 testrun], [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=439 report]<br/>
+Checklist
+* {{ |}} Functional automated tests, synced to Litmus
+* {{ |}} Manual tests
+* {{ |}} Bug fix verifications
+* {{ |}} Updates on releasetest
+* {{ |}} Peer sign-off
+* {{ |}} Updates on beta
+=== Automated Tests ===
+The following are the detailed results of the automated BFT test runs.
+{|class="querytable" style="width:50%"
+ |-
+ | class="header" | Platform
+ | class="header" | Result: [ report]
+ |-
+ | Windows 2000
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Windows XP
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Windows Vista
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Windows 7 32-bit
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Windows 7 64-bit
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Mac OS X 10.6
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Mac OS X 10.7
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Ubuntu 11.10 32-bit
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Ubuntu 11.10 64-bit
+ | '''result''' - YYYY-MM-DD
+ |}
+; Test Failures
+=== Manual Tests ===
+==== Smoketests ====
+The following are the detailed results of the manual [https://litmus.mozilla.org/run_tests.cgi?test_run_id=439 Smoketests] tests.
+{|class="querytable" style="width:60%"
+ |-
+ | class="header" | Platform
+ | class="header" | Assignee
+ | class="header" | Result: [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=439 report]
+ |-
+ | Windows 2000
+ | tester
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Windows XP
+ | tester
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Windows Vista
+ | tester
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Windows 7 32-bit
+ | tester
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Windows 7 64-bit
+ | tester
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Mac OS X 10.6.8
+ | tester
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Mac OS X 10.7.3
+ | tester
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Ubuntu 11.10 32-bit
+ | tester
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Ubuntu 11.10 64-bit
+ | tester
+ | '''result''' - YYYY-MM-DD
+ |}
+=== Bug Fix Verifications ===
+The following are the detailed results of verifications of bug fixes landed in Beta.
+* Any fix you very should have the status-firefox11 flag set to ''verified''
+* If the fix has been verified on all affected versions of Firefox, change [qa+] in the whiteboard to [qa!]
+* Softvision verifications [http://bit.ly/xHNBSM spreadsheet]
+; Queries
+* [http://bit.ly/xwQt8u QA+]: non-security bugs needing verification (0 / 1 VERIFIED)
+* [http://bit.ly/AFc2jn QA+ SG]: security bugs which need verification (0 / 13 VERIFIED)
+* [http://bit.ly/ydK4Jt status-firefox11:fixed]: bugs needing triage for QA+ (7 / 7 TRIAGED)
+* [http://bit.ly/wps2eJ UNCO]: unconfirmed bugs filed during Firefox 11 (0 / 39 TRIAGED)
+=== Update Tests ===
+The following are details of update verifications
+''Note: {{bug|717214}} disables new updates for 9.0b6 and earlier -- they update to 11.0b2 then get 11.0b2->11.0b7. This is a temporary stop-gap to ease burden on RelEng resources.''
+{|class="querytable" style="width:60%"
+ |-
+ | class="header" | Platform
+ | class="header" | Releasetest: [ report]
+ | class="header" | Beta: [ report]
+ |-
+ | Windows 2000
+ | '''result''' - YYYY-MM-DD
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Windows XP
+ | '''result''' - YYYY-MM-DD
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Windows Vista
+ | '''result''' - YYYY-MM-DD
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Windows 7 32-bit
+ | '''result''' - YYYY-MM-DD
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Windows 7 64-bit
+ | '''result''' - YYYY-MM-DD
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Mac OS X 10.6
+ | '''result''' - YYYY-MM-DD
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Mac OS 10.7
+ | '''result''' - YYYY-MM-DD
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Ubuntu 11.10 32-bit
+ | '''result''' - YYYY-MM-DD
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Ubuntu 11.10 64-bit
+ | '''result''' - YYYY-MM-DD
+ | '''result''' - YYYY-MM-DD
   |}