Firefox:2.0.0.15:Test Plan: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(New page: == General Firefox 2.0.0.15 Test Plan == This is the basic set of tests we run for every security & maintenance release. == Description of Release == 2.0...)
 
 
(5 intermediate revisions by the same user not shown)
Line 21: Line 21:
* Code freeze: June 6
* Code freeze: June 6
* Builds start: June 9
* Builds start: June 9
* QA starts: June 10
* QA starts: June 12
** Smoketests: June 10 - 3 people
** Smoketests: June 12 - 3 people
** BFTs and Bug Verification: June 11 to 13 - 3 people
** BFTs and Bug Verification: June 13 - 3 people
** l10n Testing: June 16 - 3 people
** l10n Testing: June 16 - 3 people
** Betatest & Beta Channel Testing: June 17 - 3 people
** Betatest & Beta Channel Testing: June 18 - 3 people
* Release to beta channel: June 17
* Release to beta channel: June 18
** Update Build IDs on [[QA/Talkback/Build IDs]]: June 17
** Update Build IDs on [[QA/Talkback/Build IDs]]: June 18
** Releasetest & Release Channel Testing: June 24 - 3 people
** Releasetest & Release Channel Testing: June 25 - 3 people
* Final Release: June 24
* Final Release: June 25


Test Assignments:
Test Assignments:
Line 50: Line 50:


== Builds ==  
== Builds ==  
* [http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/2.0.0.15-candidates/rc1/ RC1 Build]
* [http://ftp.mozilla.org/pub/firefox/nightly/2.0.0.15-candidates/build2/ Build 2]
* [http://ftp.mozilla.org/pub/firefox/nightly/2.0.0.15-candidates/build3/ Build 3]


== Test Results ==
== Test Results ==


{| border="1" cellpadding="5" cellspacing="0" align="center"
{| border="1" cellpadding="5" cellspacing="0" align="center"
|+'''Daily Builds'''
|+'''Builds'''
|-
|-
!  
!  
! style="background:#ffdead;" | '''Firefox 2.0.0.15 RC1'''
! style="background:#ffdead;" | '''Firefox 2.0.0.15 Build 2'''
|-
|-
| style="background:#ffdead;" | '''Smoketests'''
| style="background:#ffdead;" | '''Smoketests'''
| Team '''RESULT'''
| Team '''PASS'''
|-
|-
| style="background:#ffdead;" | '''BFTs'''
| style="background:#ffdead;" | '''BFTs'''
| Team '''RESULT'''
| Team '''PASS'''
|-
|-
|}


{| border="1" cellpadding="5" cellspacing="0" align="center"
!
! style="background:#ffdead;" | '''Firefox 2.0.0.15 Build 3'''
|-
| style="background:#ffdead;" | '''Smoketests'''
| Team '''PASS'''
|-
|}
|}


Line 81: Line 91:
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&keywords_type=anywords&keywords=fixed1.8.1.15&op_sys=All&op_sys=Windows+95&op_sys=Windows+98&op_sys=Windows+ME&op_sys=Windows+NT&op_sys=Windows+2000&op_sys=Windows+XP&op_sys=Windows+Server+2003&op_sys=Windows+Vista&op_sys=Windows+CE&op_sys=Windows+Mobile+6+Standard&op_sys=Windows+Mobile+6+Professional&op_sys=Mac+System+7&op_sys=Mac+System+7.5&op_sys=Mac+System+7.6.1&op_sys=Mac+System+8.0&op_sys=Mac+System+8.5&op_sys=Mac+System+8.6&op_sys=Mac+System+9.x&op_sys=Mac+OS+X&op_sys=Linux&op_sys=Other&chfieldto=Now&negate0=1&field0-0-0=product&type0-0-0=anywordssubstr&value0-0-0=Thunderbird+Camino+Mozilla+Calendar&field1-0-0=component&type1-0-0=notequals&value1-0-0=XForms Unverified Fixed Bugs for 2.0.0.15]
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&keywords_type=anywords&keywords=fixed1.8.1.15&op_sys=All&op_sys=Windows+95&op_sys=Windows+98&op_sys=Windows+ME&op_sys=Windows+NT&op_sys=Windows+2000&op_sys=Windows+XP&op_sys=Windows+Server+2003&op_sys=Windows+Vista&op_sys=Windows+CE&op_sys=Windows+Mobile+6+Standard&op_sys=Windows+Mobile+6+Professional&op_sys=Mac+System+7&op_sys=Mac+System+7.5&op_sys=Mac+System+7.6.1&op_sys=Mac+System+8.0&op_sys=Mac+System+8.5&op_sys=Mac+System+8.6&op_sys=Mac+System+9.x&op_sys=Mac+OS+X&op_sys=Linux&op_sys=Other&chfieldto=Now&negate0=1&field0-0-0=product&type0-0-0=anywordssubstr&value0-0-0=Thunderbird+Camino+Mozilla+Calendar&field1-0-0=component&type1-0-0=notequals&value1-0-0=XForms Unverified Fixed Bugs for 2.0.0.15]
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=anywords&keywords=verified1.8.1.15&op_sys=All&op_sys=Windows+95&op_sys=Windows+98&op_sys=Windows+ME&op_sys=Windows+NT&op_sys=Windows+2000&op_sys=Windows+XP&op_sys=Windows+Server+2003&op_sys=Windows+Vista&op_sys=Windows+CE&op_sys=Windows+Mobile+6+Standard&op_sys=Windows+Mobile+6+Professional&op_sys=Mac+System+7&op_sys=Mac+System+7.5&op_sys=Mac+System+7.6.1&op_sys=Mac+System+8.0&op_sys=Mac+System+8.5&op_sys=Mac+System+8.6&op_sys=Mac+System+9.x&op_sys=Mac+OS+X&op_sys=Linux&op_sys=Other&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&negate0=1&field0-0-0=product&type0-0-0=anywordssubstr&value0-0-0=Thunderbird+Camino+Mozilla+Calendar&field1-0-0=component&type1-0-0=notequals&value1-0-0=XForms Verified Bugs for 2.0.0.15]
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=anywords&keywords=verified1.8.1.15&op_sys=All&op_sys=Windows+95&op_sys=Windows+98&op_sys=Windows+ME&op_sys=Windows+NT&op_sys=Windows+2000&op_sys=Windows+XP&op_sys=Windows+Server+2003&op_sys=Windows+Vista&op_sys=Windows+CE&op_sys=Windows+Mobile+6+Standard&op_sys=Windows+Mobile+6+Professional&op_sys=Mac+System+7&op_sys=Mac+System+7.5&op_sys=Mac+System+7.6.1&op_sys=Mac+System+8.0&op_sys=Mac+System+8.5&op_sys=Mac+System+8.6&op_sys=Mac+System+9.x&op_sys=Mac+OS+X&op_sys=Linux&op_sys=Other&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&negate0=1&field0-0-0=product&type0-0-0=anywordssubstr&value0-0-0=Thunderbird+Camino+Mozilla+Calendar&field1-0-0=component&type1-0-0=notequals&value1-0-0=XForms Verified Bugs for 2.0.0.15]
* [https://bugzilla.mozilla.org/buglist.cgi?bug_file_loc=&bug_file_loc_type=allwordssubstr&bug_id=&bugidtype=include&chfieldfrom=&chfieldto=Now&chfieldvalue=&email1=&email2=&emailtype1=substring&emailtype2=substring&field-1-0-0=op_sys&field-1-1-0=keywords&field0-0-0=product&field1-0-0=component&keywords=verified1.8.1.15%20fixed1.8.1.15&keywords_type=anywords&long_desc=&long_desc_type=allwordssubstr&negate0=1&op_sys=All&op_sys=Windows%2095&op_sys=Windows%2098&op_sys=Windows%20ME&op_sys=Windows%20NT&op_sys=Windows%202000&op_sys=Windows%20XP&op_sys=Windows%20Server%202003&op_sys=Windows%20Vista&op_sys=Windows%20CE&op_sys=Windows%20Mobile%206%20Standard&op_sys=Windows%20Mobile%206%20Professional&op_sys=Mac%20System%207&op_sys=Mac%20System%207.5&op_sys=Mac%20System%207.6.1&op_sys=Mac%20System%208.0&op_sys=Mac%20System%208.5&op_sys=Mac%20System%208.6&op_sys=Mac%20System%209.x&op_sys=Mac%20OS%20X&op_sys=Linux&op_sys=Other&query_format=advanced&remaction=&short_desc=&short_desc_type=allwordssubstr&status_whiteboard=&status_whiteboard_type=allwordssubstr&type-1-0-0=anyexact&type-1-1-0=anywords&type0-0-0=anywordssubstr&type1-0-0=notequals&value-1-0-0=All%2CWindows%2095%2CWindows%2098%2CWindows%20ME%2CWindows%20NT%2CWindows%202000%2CWindows%20XP%2CWindows%20Server%202003%2CWindows%20Vista%2CWindows%20CE%2CWindows%20Mobile%206%20Standard%2CWindows%20Mobile%206%20Professional%2CMac%20System%207%2CMac%20System%207.5%2CMac%20System%207.6.1%2CMac%20System%208.0%2CMac%20System%208.5%2CMac%20System%208.6%2CMac%20System%209.x%2CMac%20OS%20X%2CLinux%2COther&value-1-1-0=verified1.8.1.15%20fixed1.8.1.15&value0-0-0=Thunderbird%20Camino%20Mozilla%20Calendar&value1-0-0=XForms&votes=&query_based_on= All Fixed and Verified Bugs for 2.0.0.15]
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=anywords&keywords=verified1.8.1.15+fixed1.8.1.15&op_sys=All&op_sys=Windows+95&op_sys=Windows+98&op_sys=Windows+ME&op_sys=Windows+NT&op_sys=Windows+2000&op_sys=Windows+XP&op_sys=Windows+Server+2003&op_sys=Windows+Vista&op_sys=Windows+CE&op_sys=Windows+Mobile+6+Standard&op_sys=Windows+Mobile+6+Professional&op_sys=Mac+System+7&op_sys=Mac+System+7.5&op_sys=Mac+System+7.6.1&op_sys=Mac+System+8.0&op_sys=Mac+System+8.5&op_sys=Mac+System+8.6&op_sys=Mac+System+9.x&op_sys=Mac+OS+X&op_sys=Linux&op_sys=Other&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&negate0=1&field0-0-0=product&type0-0-0=anywordssubstr&value0-0-0=Thunderbird+Camino+Mozilla+Calendar&field1-0-0=component&type1-0-0=notequals&value1-0-0=XForms All Fixed and Verified Bugs for 2.0.0.15]


Tips:
Tips:

Latest revision as of 16:52, 24 June 2008

General Firefox 2.0.0.15 Test Plan

This is the basic set of tests we run for every security & maintenance release.

Description of Release

2.0.0.15 is a normal security release for Firefox.

Specific Test Plan for this Release

Nothing specific for this release.

Assumptions

Current Tasks

  • Ongoing: Bug Reproduction

Schedule

This is an estimated schedule as a normal security release.

  • Code freeze: June 6
  • Builds start: June 9
  • QA starts: June 12
    • Smoketests: June 12 - 3 people
    • BFTs and Bug Verification: June 13 - 3 people
    • l10n Testing: June 16 - 3 people
    • Betatest & Beta Channel Testing: June 18 - 3 people
  • Release to beta channel: June 18
    • Update Build IDs on QA/Talkback/Build IDs: June 18
    • Releasetest & Release Channel Testing: June 25 - 3 people
  • Final Release: June 25

Test Assignments:

  • Smoketests, BFT
    • abillings
    • juanb
    • hali
  • l10n Testing
    • abillings
    • juanb
    • hali
  • Betatest/Beta updates
    • abillings
    • juanb
    • hali
  • Releasetest/Release updates
    • abillings
    • juanb
    • hali

Builds

Test Results

Builds
Firefox 2.0.0.15 Build 2
Smoketests Team PASS
BFTs Team PASS


Firefox 2.0.0.15 Build 3
Smoketests Team PASS


Bug Verifications

When you verify the bug is fixed:

Tips:

  • If you don't see an easy way to verify or need further clarification add a comment to the bug or add "[needs testcase]" (without quotes) to the bug's Status Whiteboard.

Target Bugs to Verify

Dependent Bugs to Verify

Bug List Here