Firefox:1.5.0.7:Test Plan: Difference between revisions
Jump to navigation
Jump to search
No edit summary |
|||
| Line 53: | Line 53: | ||
* Firefox RC4 will be released this afternoon | * Firefox RC4 will be released this afternoon | ||
* Smoketest Firefox RC4 | * Smoketest Firefox RC4 | ||
** [[Firefox:1.5.0.7:Smoketests|1.5.0.7 Firefox Smoketest results]] | |||
* Thunderbird bug verifications | * Thunderbird bug verifications | ||
Revision as of 13:56, 8 September 2006
General Firefox 1.5.0.x Test Plan
This is the basic set of tests we run for every security & maintenance release.
Assumptions
- Goal of this release is security fixes and important regressions, other fixes will not be included
- Builds should have gone through the l10n meta-diff checker and the update checker before they are released to QA
- Thunderbird will be released a few days after Firefox
- Monday, September 4th is a holiday
Current Tasks
- Bug triage
- Test plan completion
- Bug verification
Schedule
Monday, August 28th
- RC1 delayed till Monday night/Tuesday morning. Shifting Monday's planned activities to Tuesday
Tuesday, August 29th
- Firefox builds should be available for Win/Linux/PPC
- Smoketests (rc2) on Windows, Linux, Mac en-us
Wednesday, August 30th
- Firefox BFTs - PASS
- Build should begin l10n packaging after BFTs signoff (Rhelmer/TR)
- Get post up on the QA blog with link to candidate builds
- Testing of QA identified hot spots
- Targeted exploratory testing over Developer identified hot spots
Thursday, August 31st
- Continued testing of developer identified hot spots and bug verifications
Friday, September 1st
- Community Testday for 1.5.0.7 RC builds
- Smoketests (rc2) on Windows, Linux, Mac en-us
- Thunderbird BFTs - PASS
- Bug verifications and focus testing
Tuesday, September 5th
- Further bug verifications and testing of hot spots
- Thunderbird Smoketests
- Start Thunderbird BFTs
Wednesday, September 6th
- Firefox RC4 will be released this afternoon
- Smoketest Firefox RC4
- Thunderbird bug verifications
Thursday, September 7th
- Firefox security testing for RSA/Certificate changes
- Thunderbird bug verifications
Friday, September 8th
- Spot check P1 locales
- 1.5.0.7 Firefox and Thunderbird Localization testing results
- Check other tier 2 locales as time permits
Monday, September 11th
- Update testing for P1 locales
- Random update spot checks of other locales
Tuesday, September 12th
- Firefox 1.5.0.7 is released, probably 4pm
- Spot check live updates
Wednesday, September 13th
- Spot check Thunderbird P1 locales
- 1.5.0.7 Firefox and Thunderbird Localization testing results
- Check other tier 2 locales as time permits
Thursday, September 14th
- Update testing for Thunderbird P1 locales
- Random update spot checks of other locales
Bug Verifications
When you verify the bug is fixed, resolve it as VERIFIED FIXED and replace the fixed1.8.0.7 keyword with verified1.8.0.7
Tips:
- Bugs verified on 1.8.1 still need to be verified in 1.8.0.7
- If you don't see an easy way to verify or need further clarification add a comment to the bug or add "[needs testcase]" (without quotes) to the bug's Status Whiteboard.
Fixed
Verified
Priority Verifications
- 7 mail bugs ("fixed1.8.0.7" bugs, component is "mailnews" or product is "thunderbird")
- 20 critical bugs ("fixed1.8.0.7" bugs, no "needs testcase" in status whiteboard, and severity is "critical")
- 11 security bugs ("fixed1.8.0.7" bugs, no "needs testcase" in status whiteboard, and is marked "security-sensitive"):
Note: If you run into a difficult bug, just add the "[need testcase]" in the status whiteboard and move on.
Need Verification
bc's JS bugs:
Cannot Verify
- https://bugzilla.mozilla.org/show_bug.cgi?id=347725 (no crash with 1506, 1507, or 2)
- https://bugzilla.mozilla.org/show_bug.cgi?id=350081 (not sure what to look for with testcase)