Releases/Firefox 15/Test Plan: Difference between revisions

 
(7 intermediate revisions by the same user not shown)
Line 2,159: Line 2,159:
* {{done|}} [[Releases/Firefox_15/Test_Plan#Automated_Tests_9|Automated tests]]
* {{done|}} [[Releases/Firefox_15/Test_Plan#Automated_Tests_9|Automated tests]]
* {{done|}} [[Releases/Firefox_15/Test_Plan#Manual_Testing|Manual Testing]]
* {{done|}} [[Releases/Firefox_15/Test_Plan#Manual_Testing|Manual Testing]]
* {{ok|}} [[Releases/Firefox_15/Test_Plan#Update_Testing_8|Update Testing]]
* {{done|}} [[Releases/Firefox_15/Test_Plan#Update_Testing_8|Update Testing]]
* {{ |}} Final sign-off sent and updates qualified on Release channel
* {{done|}} Final sign-off sent and updates qualified on Release channel


=== Automated Tests ===
=== Automated Tests ===
Line 2,288: Line 2,288:
=== Update Testing ===
=== Update Testing ===
* Partial: 13.0.1, 14.0.1, 15.0
* Partial: 13.0.1, 14.0.1, 15.0
* Complete: 13.0, 14.0
* Complete: 12.0, 13.0


{|class="querytable" style="width:60%"
{|class="querytable" style="width:60%"
  |-
  |-
  | class="header" | Platform
  | class="header" | Platform
  | class="header" | Releasetest: [http://mozmill-ondemand.blargon7.com/#/update/overview?branch=15.0&channel=releasetest&from=2012-09-06&to=2012-09-07 report]
  | class="header" | Releasetest: [http://mozmill-ondemand.blargon7.com/#/update/detail?branch=15.0&channel=releasetest&from=2012-09-06&to=2012-09-07&target=15.0.1 report]
  | class="header" | Release: [ report]
  | class="header" | Release: [http://mozmill-ondemand.blargon7.com/#/update/detail?branch=15.0&channel=release&from=2012-09-06&to=2012-09-07&target=15.0.1 report]
  |-
  |-
  | Windows XP
  | Windows XP
  | '''result''' - YYYY-MM-DD
  | '''PASS''' - 2012-09-06
  | '''result''' - YYYY-MM-DD
  | '''PASS''' - 2012-09-06
  |-
  |-
  | Windows Vista
  | Windows Vista
  | '''result''' - YYYY-MM-DD
  | '''PASS''' - 2012-09-06
  | '''result''' - YYYY-MM-DD
  | '''PASS''' - 2012-09-06
  |-
  |-
  | Windows 7 32-bit
  | Windows 7 32-bit
  | '''result''' - YYYY-MM-DD
  | '''PASS''' - 2012-09-06
  | '''result''' - YYYY-MM-DD
  | '''PASS''' - 2012-09-06
  |-
  |-
  | Windows 7 64-bit
  | Windows 7 64-bit
  | '''result''' - YYYY-MM-DD
  | '''PASS''' - 2012-09-06
  | '''result''' - YYYY-MM-DD
  | '''PASS''' - 2012-09-06
  |-
  |-
  | Mac OS X 10.6
  | Mac OS X 10.6
  | '''result''' - YYYY-MM-DD
  | '''PASS''' - 2012-09-06
  | '''result''' - YYYY-MM-DD
  | '''PASS''' - 2012-09-06
  |-
  |-
  | Mac OS X 10.7
  | Mac OS X 10.7
  | '''result''' - YYYY-MM-DD
  | '''PASS''' - 2012-09-06
  | '''result''' - YYYY-MM-DD
  | '''PASS''' - 2012-09-06
  |-
  |-
  | Mac OS X 10.8
  | Mac OS X 10.8
  | '''result''' - YYYY-MM-DD
  | '''PASS''' - 2012-09-06
  | '''result''' - YYYY-MM-DD
  | '''PASS''' - 2012-09-06
  |-
  |-
  | Ubuntu 11.10 32-bit
  | Ubuntu 12.04 32-bit
  | '''result''' - YYYY-MM-DD
  | '''PASS''' - 2012-09-06
  | '''result''' - YYYY-MM-DD
  | '''PASS''' - 2012-09-06
  |-
  |-
  | Ubuntu 11.10 64-bit
  | Ubuntu 12.04 64-bit
  | '''result''' - YYYY-MM-DD
  | '''PASS''' - 2012-09-06
  | '''result''' - YYYY-MM-DD
  | '''PASS''' - 2012-09-06
  |}
  |}


; Issues
; Issues
== Hotfix ==
Hotfix to turn off Background Updates (see {{bug|790096}}).
=== Test Case ===
Hotfix installs for:
* Firefox 15 - 18 users on...
* Mac & Linux with...
* add-ons installed in the app-bundle (how do you do this????) -- ex. Comcast software
Hotfixed is active if:
* Hotfix add-on appears in Addons Manager
* Background Update pref is turned off
Updates to check:
* Updates not found via background update
* Updates found via manual check for updates
Questions:
* How do you install add-ons in the app-bundle? What is an app-bundle? and are there specific add-ons?
* Hotfix installer dialog?
* Background Update pref?
* Expectation of pave-over install with "affected" version?
* Expectation of pave-over install with "unaffected" version?
Expectations:
* 15.0.1 release: hotfix applies, won't be able to test updates since none available
* 15.0 release: hotfix applies, no background updates to 15.0.1
* 15.0b6 beta: hotfix applies, no background updates to 16.0b3
* 15.0a2 aurora: hotfix applies, no background updates to 17.0a2, hotfix removed after update
* 16.0b2 beta: hotfix applies, no background updates to 16.0b3
* 17.0a2 aurora: hotfix applies for those with app-bundle add-ons
* 18.0a1 nightly: hotfix applies for those with app-bundle add-ons


== Beta Feature Sign-off ==
== Beta Feature Sign-off ==
Confirmed users
14,525

edits