Firefox:1.5.0.10-2.0.0.2:Test Plan: Difference between revisions
Jump to navigation
Jump to search
| Line 59: | Line 59: | ||
Tips: | Tips: | ||
* Verify on both 1.8.0.10 and 1.8.1.2 for bugs fixed on both branches | * Verify on both 1.8.0.10 and 1.8.1.2 for bugs fixed on both branches | ||
* If you don't see an easy way to verify or need further clarification add a comment to the bug or add "[needs testcase]" (without quotes) to the bug's Status Whiteboard. | * If you don't see an easy way to verify or need further clarification add a comment to the bug or add "[needs testcase]" (without quotes) to the bug's Status Whiteboard. | ||
'''Fixed''' | '''Fixed''' | ||
*[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=fixed1.8.0.10+fixed1.8.1.2&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=keywords&type0-0-0=notsubstring&value0-0-0=&field0-1-0=product&type0-1-0=notsubstring&value0-1-0=Camino&field0-2-0=product&type0-2-0=notsubstring&value0-2-0=Localizations&field0-3-0=product&type0-3-0=nowordssubstr&value0-3-0=Thunderbird&field0-4-0=component&type0-4-0=notsubstring&value0-4-0=XForms BOTH fixed1.8.1.2 AND fixed1.8.0.10] | *[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=anywords&keywords=fixed1.8.0.10+fixed1.8.1.2&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=keywords&type0-0-0=notsubstring&value0-0-0=&field0-1-0=product&type0-1-0=notsubstring&value0-1-0=Camino&field0-2-0=product&type0-2-0=notsubstring&value0-2-0=Localizations&field0-3-0=product&type0-3-0=nowordssubstr&value0-3-0=Thunderbird&field0-4-0=component&type0-4-0=notsubstring&value0-4-0=XForms ALL fixed1.8.1.2 OR fixed1.8.0.10] | ||
*[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=fixed1.8.0.10&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=keywords&type0-0-0=notsubstring&value0-0-0=fixed1.8.1.2&field0-1-0=product&type0-1-0=notsubstring&value0-1-0=Camino&field0-2-0=product&type0-2-0=notsubstring&value0-2-0=Localizations&field0-3-0=product&type0-3-0=nowordssubstr&value0-3-0=Thunderbird&field0-4-0=component&type0-4-0=notsubstring&value0-4-0=XForms fixed1.8.0.10 (1.5.0.10) only] | ** Refined bug lists for quick reference fo what's fixed where: | ||
*[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=fixed1.8.1.2&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=keywords&type0-0-0=notsubstring&value0-0-0=fixed1.8.0.10&field0-1-0=product&type0-1-0=notsubstring&value0-1-0=Camino&field0-2-0=product&type0-2-0=notsubstring&value0-2-0=Localizations&field0-3-0=product&type0-3-0=nowordssubstr&value0-3-0=Thunderbird&field0-4-0=component&type0-4-0=notsubstring&value0-4-0=XForms fixed1.8.1.2 (2.0.0.2) only] | ***[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=fixed1.8.0.10+fixed1.8.1.2&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=keywords&type0-0-0=notsubstring&value0-0-0=&field0-1-0=product&type0-1-0=notsubstring&value0-1-0=Camino&field0-2-0=product&type0-2-0=notsubstring&value0-2-0=Localizations&field0-3-0=product&type0-3-0=nowordssubstr&value0-3-0=Thunderbird&field0-4-0=component&type0-4-0=notsubstring&value0-4-0=XForms BOTH fixed1.8.1.2 AND fixed1.8.0.10] | ||
***[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=fixed1.8.0.10&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=keywords&type0-0-0=notsubstring&value0-0-0=fixed1.8.1.2&field0-1-0=product&type0-1-0=notsubstring&value0-1-0=Camino&field0-2-0=product&type0-2-0=notsubstring&value0-2-0=Localizations&field0-3-0=product&type0-3-0=nowordssubstr&value0-3-0=Thunderbird&field0-4-0=component&type0-4-0=notsubstring&value0-4-0=XForms fixed1.8.0.10 (1.5.0.10) only] | |||
***[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=fixed1.8.1.2&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=keywords&type0-0-0=notsubstring&value0-0-0=fixed1.8.0.10&field0-1-0=product&type0-1-0=notsubstring&value0-1-0=Camino&field0-2-0=product&type0-2-0=notsubstring&value0-2-0=Localizations&field0-3-0=product&type0-3-0=nowordssubstr&value0-3-0=Thunderbird&field0-4-0=component&type0-4-0=notsubstring&value0-4-0=XForms fixed1.8.1.2 (2.0.0.2) only] | |||
** All bug lists above exclude Camino, Thunderbird, Localizations and XForms | ** All bug lists above exclude Camino, Thunderbird, Localizations and XForms | ||
'''Verified''' | '''Verified''' | ||
*[https://bugzilla.mozilla.org/buglist.cgi?keywords_type=allwords&keywords=verified1.8.0.10&order=Bug+Number verified 1.5.0.10 bugs] | *[https://bugzilla.mozilla.org/buglist.cgi?keywords_type=allwords&keywords=verified1.8.0.10&order=Bug+Number verified 1.5.0.10 bugs] | ||
*[https://bugzilla.mozilla.org/buglist.cgi?keywords_type=allwords&keywords=verified1.8.1.2&order=Bug+Number verified 2.0.0.2 bugs] | *[https://bugzilla.mozilla.org/buglist.cgi?keywords_type=allwords&keywords=verified1.8.1.2&order=Bug+Number verified 2.0.0.2 bugs] | ||
=== Priority Verifications === | === Priority Verifications === | ||
* Critical bugs ("fixed1.8.0.10" or "fixed1.8.1.2" bugs, no "needs testcase" in status whiteboard, and severity is "critical") | * Critical bugs ("fixed1.8.0.10" or "fixed1.8.1.2" bugs, no "needs testcase" in status whiteboard, and severity is "critical") | ||
**[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=fixed1.8.0.10&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=status_whiteboard&type0-0-0=notsubstring&value0-0-0=need+testcase&field0-1-0=bug_severity&type0-1-0=equals&value0-1-0=critical 1.5.0.10 critical bugs] | **[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=fixed1.8.0.10&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=status_whiteboard&type0-0-0=notsubstring&value0-0-0=need+testcase&field0-1-0=bug_severity&type0-1-0=equals&value0-1-0=critical 1.5.0.10 critical bugs] | ||
**[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=fixed1.8.1.2&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=status_whiteboard&type0-0-0=notsubstring&value0-0-0=need+testcase&field0-1-0=bug_severity&type0-1-0=equals&value0-1-0=critical 2.0.0.2 critical bugs] | **[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=fixed1.8.1.2&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=status_whiteboard&type0-0-0=notsubstring&value0-0-0=need+testcase&field0-1-0=bug_severity&type0-1-0=equals&value0-1-0=critical 2.0.0.2 critical bugs] | ||
* Security bugs ("fixed1.8.0.10" or "fixed1.8.1.2" bugs, no "needs testcase" in status whitebooard, and is marked "security-sensitive") | * Security bugs ("fixed1.8.0.10" or "fixed1.8.1.2" bugs, no "needs testcase" in status whitebooard, and is marked "security-sensitive") | ||
**[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=fixed1.8.0.10&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=bug_group&type0-0-0=substring&value0-0-0=security&field0-1-0=status_whiteboard&type0-1-0=notsubstring&value0-1-0=need+testcase 1.5.0.10 security bugs] | **[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=fixed1.8.0.10&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=bug_group&type0-0-0=substring&value0-0-0=security&field0-1-0=status_whiteboard&type0-1-0=notsubstring&value0-1-0=need+testcase 1.5.0.10 security bugs] | ||
**[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=fixed1.8.1.2&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=bug_group&type0-0-0=substring&value0-0-0=security&field0-1-0=status_whiteboard&type0-1-0=notsubstring&value0-1-0=need+testcase 2.0.0.2 security bugs] | **[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=fixed1.8.1.2&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=bug_group&type0-0-0=substring&value0-0-0=security&field0-1-0=status_whiteboard&type0-1-0=notsubstring&value0-1-0=need+testcase 2.0.0.2 security bugs] | ||
Note: If you run into a difficult bug, just add the "[needs testcase]" in the status whiteboard and move on. | Note: If you run into a difficult bug, just add the "[needs testcase]" in the status whiteboard and move on. | ||
Revision as of 01:53, 25 January 2007
General Firefox 1.5.0.x Test Plan
This is the basic set of tests we run for every security & maintenance release.
Windows Vista Test Plan
Firefox 2.0.0.2 will be the first release where we support the Windows Vista platform. To that end, Marcia created a Windows Vista Test Plan. You can view the latest iteration of that document here: Windows Vista Test Plan
Assumptions
- 1.5.0.10 and 2.0.0.2 are simultaneous releases of Firefox. It hasn't been decided if we will ship Thunderbird 1.5.0.10 at the same time.
Current Tasks
- Bug Triage
- Bug Verifications
- Help out by going through the fixed bugs and verifying them:
Schedule
- Tentative Release Date: Late January
- Overall Schedule from Community Page
Test Results
Any 1.5.0.10-2.0.0.2 testing results that will help us track progress, identify regressions, and verify fixes should go here.
| Smoketests | BFTs | |
|---|---|---|
| Firefox 2.0.0.2 | TBD | TBD |
| Firefox 1.5.0.10 | TBD | TBD |
- Smoketests and BFTs
- l10n related testing
- Updates Testing
- Major Software Updates Testing
- Vista Updates Testing
- Distro Test Results
- Search Engine Checker Results: (need link)
- Continued new locale testing results:
The above list is just a sample of what we will be testing and links to blank pages we should us to track our test results. Please add any other test results here. Thanks!
Bug Verifications
When you verify the bug is fixed, resolve it as VERIFIED FIXED and replace the fixed1.8.0.10 / fixed1.8.1.2 keyword with verified1.8.0.10 / verified1.8.1.2
Tips:
- Verify on both 1.8.0.10 and 1.8.1.2 for bugs fixed on both branches
- If you don't see an easy way to verify or need further clarification add a comment to the bug or add "[needs testcase]" (without quotes) to the bug's Status Whiteboard.
Fixed
- ALL fixed1.8.1.2 OR fixed1.8.0.10
- Refined bug lists for quick reference fo what's fixed where:
- All bug lists above exclude Camino, Thunderbird, Localizations and XForms
Verified
Priority Verifications
- Critical bugs ("fixed1.8.0.10" or "fixed1.8.1.2" bugs, no "needs testcase" in status whiteboard, and severity is "critical")
- Security bugs ("fixed1.8.0.10" or "fixed1.8.1.2" bugs, no "needs testcase" in status whitebooard, and is marked "security-sensitive")
Note: If you run into a difficult bug, just add the "[needs testcase]" in the status whiteboard and move on.
Need Verification
- bc's js tests
https://bugzilla.mozilla.org/show_bug.cgi?id=355497