MozillaWiki

Releases/Firefox 18/Test Plan: Difference between revisions

Page Discussion

Releases/Firefox 18/Test Plan (view source)

Revision as of 01:03, 5 February 2013

829 bytes added ,  5 February 2013
→‎18.0.2
 
(17 intermediate revisions by 6 users not shown)
Line 1,626: Line 1,626:


; Checklist
; Checklist
* {{ |}} Automated Testing
* {{done|}} Automated Testing
* {{ |}} Manual Testing
* {{done|}} Manual Testing
* {{ |}} Update Testing
* {{done|}} Update Testing - betatest
* {{ |}} Bug Fix Verifications
* {{done|}} Bug Fix Verifications - By looking at crash-stats
* {{ |}} Final sign-off sent and updates qualified on release channel
* {{ok|}} Final sign-off sent and updates qualified on release channel


=== Automated Testing ===
=== Automated Testing ===
Line 1,636: Line 1,636:
  |-
  |-
  | class="header" style="width:20%" | Platform
  | class="header" style="width:20%" | Platform
  | class="header" style="width:30%" | [ Build #1 Results] (YYYY-MM-DD)
  | class="header" style="width:30%" | [http://mozmill-ci.blargon7.com/#/functional/reports?branch=18.0&platform=All&from=2013-02-01&to=2013-02-01 Build #1 Results] (2013-02-01)
|-
| Windows XP
| '''PASS''' - 2013-02-01
|-
| Windows Vista
| '''PASS''' - 2013-02-01
|-
| Windows 7 32-bit
| '''PASS''' - 2013-02-01
  |-
  |-
  | Windows 7 64-bit
  | Windows 7 64-bit
  | '''RESULT''' - YYYY-MM-DD
  | '''PASS''' - 2013-02-01
|-
| Windows 8 32-bit
| '''PASS''' - 2013-02-01
|-
| Windows 8 64-bit
| '''PASS''' - 2013-02-01
  |-
  |-
  | Mac OS X 10.7
  | Mac OS X 10.7
  | '''RESULT''' - YYYY-MM-DD
  | '''PASS''' - 2013-02-01
|-
| Mac OS X 10.8
| '''PASS''' - 2013-02-01
|-
| Ubuntu 12.04 32-bit
| '''PASS''' - 2013-02-01
  |-
  |-
  | Ubuntu 12.04 64-bit
  | Ubuntu 12.04 64-bit
  | '''RESULT''' - YYYY-MM-DD
  | '''PASS''' - 2013-02-01
  |}
  |}


=== Manual Testing ===
=== Manual Testing ===
Run the [https://moztrap.mozilla.org/manage/cases/?filter-suite=114 Desktop Firefox Regression Tests] in MozTrap and report the results below. Do some exploratory testing around the testcases to try to exercise some edge-cases.
Run the [https://moztrap.mozilla.org/runtests/environment/726/ Desktop Firefox Regression Tests] in MozTrap and report the results below. Do some exploratory testing around the testcases to try to exercise some edge-cases.


{|class="querytable"
{|class="querytable"
Line 1,658: Line 1,678:
  |-
  |-
  | Windows 7  
  | Windows 7  
  | tester
  | Manuela
  | '''RESULT''' - YYYY-MM-DD
  | '''PASS''' - 2013-02-04
  |-
  |-
  | Windows 8
  | Windows 8
  | tester
  | Simona
  | '''RESULT''' - YYYY-MM-DD
  | '''PASS''' - 2013-02-04
  |-
  |-
  | Mac OSX 10.7
  | Mac OSX 10.7
  | tester
  | Paul
  | '''RESULT''' - YYYY-MM-DD
  | '''PASS''' - 2013-02-04
  |-
  |-
  | Mac OSX 10.8
  | Mac OSX 10.8
  | tester
  | Virgil
  | '''RESULT''' - YYYY-MM-DD
  | '''PASS''' - 2013-02-04
  |-
  |-
  | Ubuntu 12.04  
  | Ubuntu 12.04  
  | tester
  | Bogdan
  | '''RESULT''' - YYYY-MM-DD
  | '''PASS''' - 2013-02-04
  |}
  |}


==== Bug Fix Verifications ====
=== Bug Fix Verifications ===
Drivers:
Drivers:
* {{bug|806820}} Crash in SuppressDeletedPropertyHelper (fixed by {{bug|831626}})
** We don't have good steps to reproduce either bug but Facebook is highly correlated


Ride-alongs:
Ride-alongs:


Exploratory testing around Facebook - [https://etherpad.mozilla.org/18-0-2-Facebook etherpad]


=== Update Testing ===
=== Update Testing ===
Line 1,691: Line 1,714:
  |-
  |-
  | class="header" | Platform
  | class="header" | Platform
  | class="header" | Betatest ([ report])
  | class="header" | Betatest ([http://mozmill-ondemand.blargon7.com/#/update/reports?branch=18.0&platform=All&from=2013-02-05&to=2013-02-05 report])
  | class="header" | Releasetest ([ report])
  | class="header" | Releasetest ([ report])
  | class="header" | Release ([ report])
  | class="header" | Release ([ report])
  |-
  |-
  | Windows XP
  | Windows XP
  | '''RESULT''' - YYYY-MM-DD
  | '''PASS''' - 2013-02-05
  | '''RESULT''' - YYYY-MM-DD
  | '''RESULT''' - YYYY-MM-DD
  | '''RESULT''' - YYYY-MM-DD
  | '''RESULT''' - YYYY-MM-DD
  |-
  |-
  | Windows Vista
  | Windows Vista
  | '''RESULT''' - YYYY-MM-DD
  | '''PASS''' - 2013-02-05
  | '''RESULT''' - YYYY-MM-DD
  | '''RESULT''' - YYYY-MM-DD
  | '''RESULT''' - YYYY-MM-DD
  | '''RESULT''' - YYYY-MM-DD
  |-
  |-
  | Windows 7 32-bit
  | Windows 7 32-bit
  | '''RESULT''' - YYYY-MM-DD
  | '''PASS''' - 2013-02-05
  | '''RESULT''' - YYYY-MM-DD
  | '''RESULT''' - YYYY-MM-DD
  | '''RESULT''' - YYYY-MM-DD
  | '''RESULT''' - YYYY-MM-DD
  |-
  |-
  | Windows 7 64-bit
  | Windows 7 64-bit
  | '''RESULT''' - YYYY-MM-DD
  | '''PASS''' - 2013-02-05
  | '''RESULT''' - YYYY-MM-DD
  | '''RESULT''' - YYYY-MM-DD
  | '''RESULT''' - YYYY-MM-DD
  | '''RESULT''' - YYYY-MM-DD
  |-
  |-
  | Windows 8 32-bit
  | Windows 8 32-bit
  | '''RESULT''' - YYYY-MM-DD
  | '''PASS''' - 2013-02-05
  | '''RESULT''' - YYYY-MM-DD
  | '''RESULT''' - YYYY-MM-DD
  | '''RESULT''' - YYYY-MM-DD
  | '''RESULT''' - YYYY-MM-DD
  |-
  |-
  | Windows 8 64-bit
  | Windows 8 64-bit
  | '''RESULT''' - YYYY-MM-DD
  | '''PASS''' - 2013-02-05
  | '''RESULT''' - YYYY-MM-DD
  | '''RESULT''' - YYYY-MM-DD
  | '''RESULT''' - YYYY-MM-DD
  | '''RESULT''' - YYYY-MM-DD
  |-
  |-
  | Mac OS X 10.6
  | Mac OS X 10.6
  | '''RESULT''' - YYYY-MM-DD
  | '''PASS''' - 2013-02-05
  | '''RESULT''' - YYYY-MM-DD
  | '''RESULT''' - YYYY-MM-DD
  | '''RESULT''' - YYYY-MM-DD
  | '''RESULT''' - YYYY-MM-DD
  |-
  |-
  | Mac OS X 10.7
  | Mac OS X 10.7
  | '''RESULT''' - YYYY-MM-DD
  | '''PASS''' - 2013-02-05
  | '''RESULT''' - YYYY-MM-DD
  | '''RESULT''' - YYYY-MM-DD
  | '''RESULT''' - YYYY-MM-DD
  | '''RESULT''' - YYYY-MM-DD
  |-
  |-
  | Mac OS X 10.8
  | Mac OS X 10.8
  | '''RESULT''' - YYYY-MM-DD
  | '''PASS''' - 2013-02-05
  | '''RESULT''' - YYYY-MM-DD
  | '''RESULT''' - YYYY-MM-DD
  | '''RESULT''' - YYYY-MM-DD
  | '''RESULT''' - YYYY-MM-DD
  |-
  |-
  | Ubuntu 12.04 32-bit
  | Ubuntu 12.04 32-bit
  | '''RESULT''' - YYYY-MM-DD
  | '''PASS''' - 2013-02-05
  | '''RESULT''' - YYYY-MM-DD
  | '''RESULT''' - YYYY-MM-DD
  | '''RESULT''' - YYYY-MM-DD
  | '''RESULT''' - YYYY-MM-DD
  |-
  |-
  | Ubuntu 12.04 64-bit
  | Ubuntu 12.04 64-bit
  | '''RESULT''' - YYYY-MM-DD
  | '''PASS''' - 2013-02-05
  | '''RESULT''' - YYYY-MM-DD
  | '''RESULT''' - YYYY-MM-DD
  | '''RESULT''' - YYYY-MM-DD
  | '''RESULT''' - YYYY-MM-DD
Jbecerra
canmove, Confirmed users
7,810

edits

Retrieved from "https://wiki.mozilla.org/Special:MobileDiff/511029...512523"