Releases/Firefox 3.0.9/Test Plan: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(22 intermediate revisions by 4 users not shown)
Line 1: Line 1:
== [[Firefox:3.0.8:Test_Plan | General Firefox 3.0.8 Test Plan]] ==
== [[Firefox:3.0.9:Test_Plan | General Firefox 3.0.9 Test Plan]] ==
This is the basic set of tests we run for every security & maintenance release.
This is the basic set of tests we run for every security & maintenance release.


== Description of Release ==
== Description of Release ==
 
3.0.9 is a normal security release for Firefox.
3.0.8 is a chemspill, accelerated, release. It will have a minimal change set from 3.0.7. All fixes that were intended for 3.0.8, before the vulnerabilities were known, will land in a to-be-released 3.0.9.


== Specific Test Plan for this Release ==
== Specific Test Plan for this Release ==


We need to make sure the couple of bugs that prompted this chemspill are verified fixed.
Nothing specific for this release.


== Assumptions ==
== Assumptions ==
The patches fix the issues in question and are sufficiently robust, and no other problems are found as a result of this.


== Current Tasks ==
== Current Tasks ==
Line 21: Line 18:
This is an estimated schedule as a normal security release.
This is an estimated schedule as a normal security release.


* Tree opens: March 26 (as needed)
* Tree opens: 2/17 (or so)
* Code freeze: March 26 (wee hours of the morning)
* Code freeze: 3/17 11:59pm
* QA starts: March 26
* QA starts: 3/18
* Builds start: March 26
* Builds start: 4/6
* QA with builds start: March 26
* QA with builds start: 4/7
** Smoketests: March 26 - 2 people
** Smoketests: 4/7 - 4/8 - 3 people
** BFTs: 3/26 - 3/27 - 2 people
** BFTs: 4/9 - 3 people
** l10n Testing: November 3/27 - 2 people
** l10n Testing: November 4/10 - 3 people
** Betatest & Beta Channel Testing: We won't have a beta period for this release.
** Betatest & Beta Channel Testing: 4/14 - 3 people
* Release to beta channel: No beta period.
* Release to beta channel: 4/14
** Releasetest & Release Channel Testing: targeted for 4/1
** Releasetest & Release Channel Testing: 4/21 - 3 people
* Final release: 4/1
* Final release: 4/21


Test Assignments:
Test Assignments:
* Smoketests, BFT
* Smoketests, BFT
** juanb
** juanb
** abillings
** ???
** ???
* l10n Testing
* l10n Testing
** juanb
** juanb
** abillings
** ???
* Betatest/Beta updates
** juanb
** abillings
** ???
** ???
* Betatest/Beta updates - NA
* Releasetest/Release updates
* Releasetest/Release updates
** juanb
** juanb
** abillings
** ???
** ???


== Builds ==  
== Builds ==  
* [http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/3.0.8-candidates/build2/ Build 2]
* [http://ftp.mozilla.org/pub/firefox/nightly/3.0.9-candidates/build1/ Build 1]
* [http://ftp.mozilla.org/pub/firefox/nightly/3.0.9-candidates/build2/ Build 2]


== Test Results ==
== Test Results ==
Line 55: Line 59:
|-
|-
!  
!  
! style="background:#ffdead;" | '''Firefox 3.0.8 Build 1'''
! style="background:#ffdead;" | '''Firefox 3.0.9'''
|-
| style="background:#ffdead;" | '''Smoketests - Build 1'''
| Team '''PASS'''
|-
|-
| style="background:#ffdead;" | '''Smoketests'''
| style="background:#ffdead;" | '''Smoketests - Build 2'''
| Team '''RESULT'''
| Team '''PASS'''
|-
|-
| style="background:#ffdead;" | '''BFTs'''
| style="background:#ffdead;" | '''BFTs'''
| Team '''RESULT'''
| Team '''PASS'''
|-
|-
| style="background:#ffdead;" | '''l10n'''
| style="background:#ffdead;" | '''l10n'''
| Team '''RESULT'''
| Team '''PASS'''
|-
|-
|}
|}




* [[Releases/Firefox 3.0.8/Test Plan:Smoketests | Smoketests & BFTs]]
* [[Releases/Firefox 3.0.9/Test Plan:Smoketests | Smoketests & BFTs]]
* [[Releases/Firefox 3.0.8/Test Plan:l10n | l10n related testing]]
* [[Releases/Firefox 3.0.9/Test Plan:l10n | l10n related testing]]
* [[Releases/Firefox 3.0.8/Test Plan:Software Update | Updates Testing]]
* [[Releases/Firefox 3.0.9/Test Plan:Software Update | Updates Testing]]


== Bug Verifications ==
== Bug Verifications ==
Line 77: Line 84:
'''When you verify the bug is fixed:'''
'''When you verify the bug is fixed:'''
* If you test on Trunk, resolve it as VERIFIED FIXED
* If you test on Trunk, resolve it as VERIFIED FIXED
* If you test on 1.9.0.x branch, replace the fixed1.9.0.8 keyword with verified1.9.0.8
* If you test on 1.9.0.x branch, replace the fixed1.9.0.9 keyword with verified1.9.0.9
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&keywords_type=anywords&keywords=fixed1.9.0.8&op_sys=All&op_sys=Windows+95&op_sys=Windows+98&op_sys=Windows+ME&op_sys=Windows+NT&op_sys=Windows+2000&op_sys=Windows+XP&op_sys=Windows+Server+2003&op_sys=Windows+Vista&op_sys=Windows+CE&op_sys=Windows+Mobile+6+Standard&op_sys=Windows+Mobile+6+Professional&op_sys=Mac+System+7&op_sys=Mac+System+7.5&op_sys=Mac+System+7.6.1&op_sys=Mac+System+8.0&op_sys=Mac+System+8.5&op_sys=Mac+System+8.6&op_sys=Mac+System+9.x&op_sys=Mac+OS+X&op_sys=Linux&op_sys=Other&chfieldto=Now&negate0=1&field0-0-0=product&type0-0-0=anywordssubstr&value0-0-0=Thunderbird+Camino+Mozilla+Calendar&field1-0-0=component&type1-0-0=notequals&value1-0-0=XForms Unverified Fixed Bugs for 3.0.8]
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&keywords_type=anywords&keywords=fixed1.9.0.9&op_sys=All&op_sys=Windows+95&op_sys=Windows+98&op_sys=Windows+ME&op_sys=Windows+NT&op_sys=Windows+2000&op_sys=Windows+XP&op_sys=Windows+Server+2003&op_sys=Windows+Vista&op_sys=Windows+CE&op_sys=Windows+Mobile+6+Standard&op_sys=Windows+Mobile+6+Professional&op_sys=Mac+System+7&op_sys=Mac+System+7.5&op_sys=Mac+System+7.6.1&op_sys=Mac+System+8.0&op_sys=Mac+System+8.5&op_sys=Mac+System+8.6&op_sys=Mac+System+9.x&op_sys=Mac+OS+X&op_sys=Linux&op_sys=Other&chfieldto=Now&negate0=1&field0-0-0=product&type0-0-0=anywordssubstr&value0-0-0=Thunderbird+Camino+Mozilla+Calendar&field1-0-0=component&type1-0-0=notequals&value1-0-0=XForms Unverified Fixed Bugs for 3.0.9]
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=anywords&keywords=verified1.9.0.8&op_sys=All&op_sys=Windows+95&op_sys=Windows+98&op_sys=Windows+ME&op_sys=Windows+NT&op_sys=Windows+2000&op_sys=Windows+XP&op_sys=Windows+Server+2003&op_sys=Windows+Vista&op_sys=Windows+CE&op_sys=Windows+Mobile+6+Standard&op_sys=Windows+Mobile+6+Professional&op_sys=Mac+System+7&op_sys=Mac+System+7.5&op_sys=Mac+System+7.6.1&op_sys=Mac+System+8.0&op_sys=Mac+System+8.5&op_sys=Mac+System+8.6&op_sys=Mac+System+9.x&op_sys=Mac+OS+X&op_sys=Linux&op_sys=Other&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&negate0=1&field0-0-0=product&type0-0-0=anywordssubstr&value0-0-0=Thunderbird+Camino+Mozilla+Calendar&field1-0-0=component&type1-0-0=notequals&value1-0-0=XForms Verified Bugs for 3.0.8]
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=anywords&keywords=verified1.9.0.9&op_sys=All&op_sys=Windows+95&op_sys=Windows+98&op_sys=Windows+ME&op_sys=Windows+NT&op_sys=Windows+2000&op_sys=Windows+XP&op_sys=Windows+Server+2003&op_sys=Windows+Vista&op_sys=Windows+CE&op_sys=Windows+Mobile+6+Standard&op_sys=Windows+Mobile+6+Professional&op_sys=Mac+System+7&op_sys=Mac+System+7.5&op_sys=Mac+System+7.6.1&op_sys=Mac+System+8.0&op_sys=Mac+System+8.5&op_sys=Mac+System+8.6&op_sys=Mac+System+9.x&op_sys=Mac+OS+X&op_sys=Linux&op_sys=Other&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&negate0=1&field0-0-0=product&type0-0-0=anywordssubstr&value0-0-0=Thunderbird+Camino+Mozilla+Calendar&field1-0-0=component&type1-0-0=notequals&value1-0-0=XForms Verified Bugs for 3.0.9]
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=anywords&keywords=verified1.9.0.8+fixed1.9.0.8&op_sys=All&op_sys=Windows+95&op_sys=Windows+98&op_sys=Windows+ME&op_sys=Windows+NT&op_sys=Windows+2000&op_sys=Windows+XP&op_sys=Windows+Server+2003&op_sys=Windows+Vista&op_sys=Windows+CE&op_sys=Windows+Mobile+6+Standard&op_sys=Windows+Mobile+6+Professional&op_sys=Mac+System+7&op_sys=Mac+System+7.5&op_sys=Mac+System+7.6.1&op_sys=Mac+System+8.0&op_sys=Mac+System+8.5&op_sys=Mac+System+8.6&op_sys=Mac+System+9.x&op_sys=Mac+OS+X&op_sys=Linux&op_sys=Other&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&negate0=1&field0-0-0=product&type0-0-0=anywordssubstr&value0-0-0=Thunderbird+Camino+Mozilla+Calendar&field1-0-0=component&type1-0-0=notequals&value1-0-0=XForms All Fixed and Verified Bugs for 3.0.8]
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=anywords&keywords=verified1.9.0.9+fixed1.9.0.9&op_sys=All&op_sys=Windows+95&op_sys=Windows+98&op_sys=Windows+ME&op_sys=Windows+NT&op_sys=Windows+2000&op_sys=Windows+XP&op_sys=Windows+Server+2003&op_sys=Windows+Vista&op_sys=Windows+CE&op_sys=Windows+Mobile+6+Standard&op_sys=Windows+Mobile+6+Professional&op_sys=Mac+System+7&op_sys=Mac+System+7.5&op_sys=Mac+System+7.6.1&op_sys=Mac+System+8.0&op_sys=Mac+System+8.5&op_sys=Mac+System+8.6&op_sys=Mac+System+9.x&op_sys=Mac+OS+X&op_sys=Linux&op_sys=Other&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&negate0=1&field0-0-0=product&type0-0-0=anywordssubstr&value0-0-0=Thunderbird+Camino+Mozilla+Calendar&field1-0-0=component&type1-0-0=notequals&value1-0-0=XForms All Fixed and Verified Bugs for 3.0.9]


Tips:
Tips:
Line 87: Line 94:
=== '''Target Bugs to Verify''' ===
=== '''Target Bugs to Verify''' ===


Limited to two(?) bugs.
None


==== '''Dependent Bugs to Verify''' ====
==== '''Dependent Bugs to Verify''' ====


None
None

Latest revision as of 23:37, 13 April 2009

General Firefox 3.0.9 Test Plan

This is the basic set of tests we run for every security & maintenance release.

Description of Release

3.0.9 is a normal security release for Firefox.

Specific Test Plan for this Release

Nothing specific for this release.

Assumptions

Current Tasks

  • Ongoing: Waiting for Builds

Schedule

This is an estimated schedule as a normal security release.

  • Tree opens: 2/17 (or so)
  • Code freeze: 3/17 11:59pm
  • QA starts: 3/18
  • Builds start: 4/6
  • QA with builds start: 4/7
    • Smoketests: 4/7 - 4/8 - 3 people
    • BFTs: 4/9 - 3 people
    • l10n Testing: November 4/10 - 3 people
    • Betatest & Beta Channel Testing: 4/14 - 3 people
  • Release to beta channel: 4/14
    • Releasetest & Release Channel Testing: 4/21 - 3 people
  • Final release: 4/21

Test Assignments:

  • Smoketests, BFT
    • juanb
    • abillings
    • ???
  • l10n Testing
    • juanb
    • abillings
    • ???
  • Betatest/Beta updates
    • juanb
    • abillings
    • ???
  • Releasetest/Release updates
    • juanb
    • abillings
    • ???

Builds

Test Results

Builds
Firefox 3.0.9
Smoketests - Build 1 Team PASS
Smoketests - Build 2 Team PASS
BFTs Team PASS
l10n Team PASS


Bug Verifications

When you verify the bug is fixed:

Tips:

  • If you don't see an easy way to verify or need further clarification add a comment to the bug or add "[needs testcase]" (without quotes) to the bug's Status Whiteboard.

Target Bugs to Verify

None

Dependent Bugs to Verify

None

Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_3.0.9/Test_Plan&oldid=139756"