Firefox:2.0.0.12:Test Plan: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(New page: == General Firefox 2.0.0.12 Test Plan == This is the basic set of tests we run for every security & maintenance release. == Description of Release == 2.0...)
 
 
(21 intermediate revisions by 3 users not shown)
Line 15: Line 15:


== Schedule ==
== Schedule ==
* Code freeze: January 18
* Code freeze: January 25
* Bug Verifications: January 18
* Bug Verifications: January 25
* Build starts: January 21
* Build starts: January 28
* QA
* QA
** Smoketests: January 22 - 4 people
** Smoketests: January 29 - 4 people
** l10n Testing: January 23 - 4 people
** l10n Testing: January 30 - 4 people
** BFTs: January 24 - 4 people
** BFTs: January 31 - 4 people
** Betatest & Beta Channel Testing: January 29 - 4 people
** Betatest & Beta Channel Testing: Feburary 5 - 4 people
* Release to beta channel: January 29
* Release to beta channel: February 5
** * Update Build IDs on [[QA/Talkback/Build IDs]]: January 29
** * Update Build IDs on [[QA/Talkback/Build IDs]]: February 5
** Releasetest & Release Channel Testing: February 5 - 4 people
** Releasetest & Release Channel Testing: February 12 - 4 people
* Final release: February 5
* Final release: February 12


Test Assignments:
Test Assignments:
* Smoketests and Bug Verification - 1/18 - 1/22
* Smoketests, BFT - 1/29 - 1/30
** abillings
** abillings
** tester
** stephend
** tester
** tracy
** tester
** juanb
* l10n Testing - 1/23
* l10n Testing - 1/30
** abillings
** abillings
** tester
** stephend
** tester
** tracy
** tester
** juanb
* Betatest/Beta updates - 1/29
* Betatest/Beta updates - 1/31
** abillings
** abillings
** tester
** stephend
** tester
** tracy
** tester
** juanb
* Releasertest/Release updates - 2/5
* Releasertest/Release updates - 2/5
** abillings
** abillings
** tester
** stephend
** tester
** tester
** tester
** tester


== Builds ==  
== Builds ==  
* [url_here RC1 Build]
* [http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/2.0.0.12-candidates/rc1/ RC1 Build]
* [http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/2.0.0.12-candidates/rc2/ RC2 Build]
* [http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/2.0.0.12-candidates/rc3/ RC3 Build]
* [http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/2.0.0.12-candidates/rc4/ RC4 Build]


== Test Results ==
== Test Results ==
Line 61: Line 64:
! style="background:#ffdead;" | '''Smoketests'''
! style="background:#ffdead;" | '''Smoketests'''
|-
|-
| style="background:#ffdead;" | '''Firefox 2.0.0.12'''
| style="background:#ffdead;" | '''Firefox 2.0.0.12 RC1'''
| Team '''RESULT'''
| Team '''PASS'''
|-
|-
| style="background:#ffdead;" | '''Firefox 2.0.0.12 RC2'''
| Team '''STOPPED'''
|-
| style="background:#ffdead;" | '''Firefox 2.0.0.12 RC3'''
| Team '''PASS'''
|-
| style="background:#ffdead;" | '''Firefox 2.0.0.12 RC4'''
| Team '''PASS'''
|-
|}
|}




* [[Firefox:2.0.0.12:Test_Plan:Smoketests | Smoketests]]
* [[Firefox:2.0.0.12:Test_Plan:Smoketests | Smoketests & BFTs]]
* [[Firefox:2.0.0.12:Test_Plan:l10n | l10n related testing]]
* [[Firefox:2.0.0.12:Test_Plan:l10n | l10n related testing]]
* [[Firefox:2.0.0.12:Test_Plan:a11y | Accessibility testing]]
* [[Firefox:2.0.0.12:Test_Plan:Software Update | Updates Testing]]
* [[Firefox:2.0.0.12:Test_Plan:Software Update | Updates Testing]]


Line 77: Line 89:
* If you test on Trunk, resolve it as VERIFIED FIXED
* If you test on Trunk, resolve it as VERIFIED FIXED
* If you test on 1.8.1.x branch, replace the fixed1.8.1.12 keyword with verified1.8.1.12
* If you test on 1.8.1.x branch, replace the fixed1.8.1.12 keyword with verified1.8.1.12
* [https://bugzilla.mozilla.org/buglist.cgi?keywords_type=anywords&keywords=fixed1.8.1.12%2Cverified1.8.1.12&negate0=1&field0-0-0=product&type0-0-0=anywordssubstr&value0-0-0=Thunderbird+Camino+Mozilla Total Fixed Bugs for 2.0.0.12]
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&keywords_type=anywords&keywords=fixed1.8.1.12&op_sys=All&op_sys=Windows+95&op_sys=Windows+98&op_sys=Windows+ME&op_sys=Windows+NT&op_sys=Windows+2000&op_sys=Windows+XP&op_sys=Windows+Server+2003&op_sys=Windows+Vista&op_sys=Windows+CE&op_sys=Windows+Mobile+6+Standard&op_sys=Windows+Mobile+6+Professional&op_sys=Mac+System+7&op_sys=Mac+System+7.5&op_sys=Mac+System+7.6.1&op_sys=Mac+System+8.0&op_sys=Mac+System+8.5&op_sys=Mac+System+8.6&op_sys=Mac+System+9.x&op_sys=Mac+OS+X&op_sys=Linux&op_sys=Other&chfieldto=Now&negate0=1&field0-0-0=product&type0-0-0=anywordssubstr&value0-0-0=Thunderbird+Camino+Mozilla+Calendar&field1-0-0=component&type1-0-0=notequals&value1-0-0=XForms Unverified Fixed Bugs for 2.0.0.12]
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=anywords&keywords=fixed1.8.1.12&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&negate0=1&field0-0-0=product&type0-0-0=anywordssubstr&value0-0-0=Thunderbird+Camino+Mozilla Unverified Fixed Bugs for 2.0.0.12]
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=anywords&keywords=verified1.8.1.12&op_sys=All&op_sys=Windows+95&op_sys=Windows+98&op_sys=Windows+ME&op_sys=Windows+NT&op_sys=Windows+2000&op_sys=Windows+XP&op_sys=Windows+Server+2003&op_sys=Windows+Vista&op_sys=Windows+CE&op_sys=Windows+Mobile+6+Standard&op_sys=Windows+Mobile+6+Professional&op_sys=Mac+System+7&op_sys=Mac+System+7.5&op_sys=Mac+System+7.6.1&op_sys=Mac+System+8.0&op_sys=Mac+System+8.5&op_sys=Mac+System+8.6&op_sys=Mac+System+9.x&op_sys=Mac+OS+X&op_sys=Linux&op_sys=Other&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&negate0=1&field0-0-0=product&type0-0-0=anywordssubstr&value0-0-0=Thunderbird+Camino+Mozilla+Calendar&field1-0-0=component&type1-0-0=notequals&value1-0-0=XForms Verified Bugs for 2.0.0.12]
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=anywords&keywords=verified1.8.1.12&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&negate0=1&field0-0-0=product&type0-0-0=anywordssubstr&value0-0-0=Thunderbird+Camino+Mozilla Verified Bugs for 2.0.0.12]


Tips:
Tips:

Latest revision as of 22:58, 3 February 2008

General Firefox 2.0.0.12 Test Plan

This is the basic set of tests we run for every security & maintenance release.

Description of Release

2.0.0.12 is a normal security release for Firefox.

Specific Test Plan for this Release

Assumptions

Current Tasks

  • Ongoing: Bug Verifications

Schedule

  • Code freeze: January 25
  • Bug Verifications: January 25
  • Build starts: January 28
  • QA
    • Smoketests: January 29 - 4 people
    • l10n Testing: January 30 - 4 people
    • BFTs: January 31 - 4 people
    • Betatest & Beta Channel Testing: Feburary 5 - 4 people
  • Release to beta channel: February 5
    • * Update Build IDs on QA/Talkback/Build IDs: February 5
    • Releasetest & Release Channel Testing: February 12 - 4 people
  • Final release: February 12

Test Assignments:

  • Smoketests, BFT - 1/29 - 1/30
    • abillings
    • stephend
    • tracy
    • juanb
  • l10n Testing - 1/30
    • abillings
    • stephend
    • tracy
    • juanb
  • Betatest/Beta updates - 1/31
    • abillings
    • stephend
    • tracy
    • juanb
  • Releasertest/Release updates - 2/5
    • abillings
    • stephend
    • tester
    • tester

Builds

Test Results

Daily Builds
Smoketests
Firefox 2.0.0.12 RC1 Team PASS
Firefox 2.0.0.12 RC2 Team STOPPED
Firefox 2.0.0.12 RC3 Team PASS
Firefox 2.0.0.12 RC4 Team PASS


Bug Verifications

When you verify the bug is fixed:

Tips:

  • If you don't see an easy way to verify or need further clarification add a comment to the bug or add "[needs testcase]" (without quotes) to the bug's Status Whiteboard.

Target Bugs to Verify

Bug List Here

Dependent Bugs to Verify

Bug List Here