Releases/Firefox 20/Test Plan: Difference between revisions

Jump to navigation Jump to search

Releases/Firefox 20/Test Plan (view source)

Revision as of 22:36, 27 March 2013

8,299 bytes added ,  27 March 2013
no edit summary
No edit summary
Line 2,137: Line 2,137:
==== Known Issues ====
==== Known Issues ====
* NEW {{bug|742394}} Firefox Not Keeping The Default Browser Setting for Linux 64-bit (Virgil)
* NEW {{bug|742394}} Firefox Not Keeping The Default Browser Setting for Linux 64-bit (Virgil)
== Release Candidate 1 ==
{| class="querytable" style="width:50%"
| style="width:10%" | '''Builds'''
| [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/20.0-candidates/build1/ FTP], [http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/20.0-candidates/build1/ HTTP]
|-
| '''ID'''
| 20130326150557
|-
| '''Changeset'''
| [http://hg.mozilla.org/releases/mozilla-beta/rev/c90d44bfa96c c90d44bfa96c] ([http://hg.mozilla.org/releases/mozilla-release/pushloghtml?changeset=c90d44bfa96c pushlog])
|}
; Checklist
* {{|}} Functional Automation
* {{|}} Manual Testing
* {{|}} Bug Triage
* {{|}} Update Automation on betatest channel
* {{|}} Update Automation on releasetest channel - skipping for this beta period
* {{|}} Final sign-off sent and updates qualified on Beta channel
=== Automated Testing ===
The following are the detailed results of the automated Mozmill test runs.
{|class="querytable" style="width:60%"
|-
| class="header" style="width:20%" | Platform
| class="header" style="width:20%" | Functional Results
| class="header" style="width:20%" | Restart Results
|-
| Windows XP
| {{ok|}} [http://mozmill-ci.blargon7.com/#/functional/reports?branch=20.0&platform=Windows%20NT&from=2013-03-27&to=2013-03-27 0 Fails]
| {{ok|}} [http://mozmill-ci.blargon7.com/#/functional/reports?branch=20.0&platform=Windows%20NT&from=2013-03-27&to=2013-03-27 0 Fails]
|-
| Windows Vista
| {{ok|}} [http://mozmill-ci.blargon7.com/#/functional/reports?branch=20.0&platform=Windows%20NT&from=2013-03-27&to=2013-03-27 0 Fails]
| {{ok|}} [http://mozmill-ci.blargon7.com/#/functional/reports?branch=20.0&platform=Windows%20NT&from=2013-03-27&to=2013-03-27 0 Fails]
|-
| Windows 7 32-bit
| {{ok|}} [http://mozmill-ci.blargon7.com/#/functional/reports?branch=20.0&platform=Windows%20NT&from=2013-03-27&to=2013-03-27 0 Fails]
| {{ok|}} [http://mozmill-ci.blargon7.com/#/functional/reports?branch=20.0&platform=Windows%20NT&from=2013-03-27&to=2013-03-27 0 Fails]
|-
| Windows 7 64-bit
| {{ok|}} [http://mozmill-ci.blargon7.com/#/functional/reports?branch=20.0&platform=Windows%20NT&from=2013-03-27&to=2013-03-27 0 Fails]
| {{ok|}} [http://mozmill-ci.blargon7.com/#/functional/reports?branch=20.0&platform=Windows%20NT&from=2013-03-27&to=2013-03-27 0 Fails]
|-
| Windows 8 32-bit
| {{ok|}} [http://mozmill-ci.blargon7.com/#/functional/reports?branch=20.0&platform=Windows%20NT&from=2013-03-27&to=2013-03-27 1 Failure]
| {{ok|}} [http://mozmill-ci.blargon7.com/#/functional/reports?branch=20.0&platform=Windows%20NT&from=2013-03-27&to=2013-03-27 0 Fails]
|-
| Windows 8 64-bit
| {{ok|}} [http://mozmill-ci.blargon7.com/#/functional/reports?branch=20.0&platform=Windows%20NT&from=2013-03-27&to=2013-03-27 0 Fails]
| {{ok|}} [http://mozmill-ci.blargon7.com/#/functional/reports?branch=20.0&platform=Windows%20NT&from=2013-03-27&to=2013-03-27 0 Fails]
|-
| Mac OS X 10.6
| {{ok|}} [http://mozmill-ci.blargon7.com/#/functional/reports?branch=20.0&platform=Mac&from=2013-03-27&to=2013-03-27 0 Fails]
| {{ok|}} [http://mozmill-ci.blargon7.com/#/functional/reports?branch=20.0&platform=Mac&from=2013-03-27&to=2013-03-27 0 Fails]
|-
| Mac OS X 10.7
| {{ok|}} [http://mozmill-ci.blargon7.com/#/functional/reports?branch=20.0&platform=Mac&from=2013-03-27&to=2013-03-27 0 Fails]
| {{ok|}} [http://mozmill-ci.blargon7.com/#/functional/reports?branch=20.0&platform=Mac&from=2013-03-27&to=2013-03-27 0 Fails]
|-
| Mac OS X 10.8
| {{ok|}} [http://mozmill-ci.blargon7.com/#/functional/reports?branch=20.0&platform=Mac&from=2013-03-27&to=2013-03-27 0 Fails]
| {{ok|}} [http://mozmill-ci.blargon7.com/#/functional/reports?branch=20.0&platform=Mac&from=2013-03-27&to=2013-03-27 0 Fails]
|-
| Ubuntu 12.04 32-bit
| {{ok|}} [http://mozmill-ci.blargon7.com/#/functional/reports?branch=20.0&platform=Linux&from=2013-03-27&to=2013-03-27 0 Fails]
| {{ok|}} [http://mozmill-ci.blargon7.com/#/functional/reports?branch=20.0&platform=Linux&from=2013-03-27&to=2013-03-27 0 Fails]
|-
| Ubuntu 12.04 64-bit
| {{ok|}} [http://mozmill-ci.blargon7.com/#/functional/reports?branch=20.0&platform=Linux&from=2013-03-27&to=2013-03-27 0 Fails]
| {{ok|}} [http://mozmill-ci.blargon7.com/#/functional/reports?branch=20.0&platform=Linux&from=2013-03-27&to=2013-03-27 0 Fails]
|}
; Test Failures ([https://bugzilla.mozilla.org/buglist.cgi?list_id=3007328;status_whiteboard_type=allwordssubstr;query_format=advanced;status_whiteboard=mozmill-test-failure;bug_status=NEW;bug_status=ASSIGNED;component=Mozmill%20Tests;product=Mozilla%20QA known bugs])
=== Manual Testing ===
Report any bugs found during exploratory testing in Bugzilla and add them to the [[Releases/Firefox_20/Test_Plan#Issues_Found|Issues Found]] section below.
{| class="querytable"
| class="header" style="width:50%" | Focus Area
| class="header" | Windows XP
| class="header" | Windows 7 64bit
| class="header" | Mac OSX 10.8
| class="header" | Ubuntu 12.10 32bit
|-
| '''Regression Tests:''' <br> Run the [https://moztrap.mozilla.org/runtests/environment/942/ Firefox 20.0b6 Regression Tests] in MozTrap. Do some exploratory testing around the testcases to try to exercise some edge-cases.
| {{ok|}} <br> tester <br> X Bugs
| {{ok|}} <br> tester <br> X Bugs
| {{ok|}} <br> tester <br> X Bugs
| {{ok|}} <br> tester <br> X Bugs
|}
=== Update Testing ===
Results of running the Mozmill update automation.<br>
20.0b5 should get a partial update, <= 20.0b4 should get a complete update.''
{|class="querytable" style="width:100%"
|-
| class="header" | Platform
| class="header" | [http://mozmill-ondemand.blargon7.com/#/update/detail?branch=20.0&channel=betatest&from=2013-03-27&to=2013-03-27&target=20.0 Betatest] (2013-03-27)
| class="header" | [http://mozmill-ondemand.blargon7.com/#/update/detail?branch=20.0&channel=releasetest&from=2013-04-01&to=2013-04-01&target=20.0 Releasetest]
| class="header" | [http://mozmill-ondemand.blargon7.com/#/update/detail?branch=20.0&channel=beta&from=2013-04-01&to=2013-04-02&target=20.0 Release] (2013-04-02)
|-
| Windows XP
| {{ok|}}: x Fails
| {{ok|}}: x Fails
| {{ok|}}: x Fails
|-
| Windows Vista
| {{ok|}}: x Fails
| {{ok|}}: x Fails
| {{ok|}}: x Fails
|-
| Windows 7 32-bit
| {{ok|}}: x Fails
| {{ok|}}: x Fails
| {{ok|}}: x Fails
|-
| Windows 7 64-bit
| {{ok|}}: x Fails
| {{ok|}}: x Fails
| {{ok|}}: x Fails
|-
| Windows 8 32-bit
| {{ok|}}: x Fails
| {{ok|}}: x Fails
| {{ok|}}: x Fails
|-
| Windows 8 64-bit
| {{ok|}}: x Fails
| {{ok|}}: x Fails
| {{ok|}}: x Fails
|-
| Mac OS X 10.6
| {{ok|}}: x Fails
| {{ok|}}: x Fails
| {{ok|}}: x Fails
|-
| Mac OS X 10.7
| {{ok|}}: x Fails
| {{ok|}}: x Fails
| {{ok|}}: x Fails
|-
| Mac OS X 10.8
| {{ok|}}: x Fails
| {{ok|}}: x Fails
| {{ok|}}: x Fails
|-
| Ubuntu 12.04 32-bit
| {{ok|}}: x Fails
| {{ok|}}: x Fails
| {{ok|}}: x Fails
|-
| Ubuntu 12.04 64-bit
| {{ok|}}: x Fails
| {{ok|}}: x Fails
| {{ok|}}: x Fails
|}
=== Bug Triage ===
==== [https://bugzilla.mozilla.org/buglist.cgi?keywords=qawanted%2C%20;query_format=advanced;keywords_type=allwords;list_id=5736583;field0-0-0=cf_tracking_firefox20;type0-0-0=equals;value0-0-0=%2B QAWANTED] ====
{| class="querytable"
| class="header" | Bugs: Test to find steps to reproduce, regression range, or testcases
| class="header" | Status
|-
|}
==== [http://bit.ly/fx20b-verifyme-normal NORMAL FIXES] ====
{| class="querytable"
| class="header" | Bugs: Verify these fixes in the latest release candidate
| class="header" | Status
|-
|}
==== [http://bit.ly/fx20b-verifyme-security SECURITY FIXES] ====
{| class="querytable"
| class="header" | Bugs: Verify these fixes in the latest release candidate (requires privileged access)
| class="header" | Status
|-
|}
==== [http://bit.ly/fx20b-topcrash TOPCRASH FIXES] ====
Verify these signatures are no longer present on crashstats in the current RC
* N/A
==== [http://bit.ly/fx20b-unconfirmed UNCONFIRMED] ====
{| class="querytable"
| class="header" | Bugs: Triage unconfirmed bugs for potential incoming regressions.
| class="header" | Status
|-
|}
=== Issues Found ===
{| class="querytable"
| class="header" | Bugs: New issues found during testing the Beta candidate
| class="header" | Status
|-
|}
''Items in '''bold''' are BLOCKER bugs''
Jbecerra
canmove, Confirmed users
7,810

edits

Retrieved from "https://wiki.mozilla.org/Special:MobileDiff/642039"

Navigation menu