Firefox:1.5.0.5:Test Plan
General Firefox 1.5.0.x Test Plan
This is the basic set of tests we run for every security & maintenance release.
Current Tasks
I am including all end game tasks including build, security notifications, etc. If anyone doesn't like this, I can create a separate cross-functional tasks page at a higher level.
Assumption: Builds should have gone through the l10n meta-diff checker and the update checker before they are released to QA.
Friday, June 16 - Wednesday, June 22
- Ongoing bug verifications. Please see list here: http://tinyurl.com/e6haf
- If everyone on the QA team could pitch in for a few verifications, that would be great.
Wednesday - June 22nd
- Firefox and Thunderbird Builds should be available Win/Linux/PPC - rhelmer/preed
- Build should tag the releases
Thursday/Friday - June 23/24
- Smoketests begin on all platforms for Firefox - tracy/juanb
- Smoketests begin on all platforms for Thunderbird - marcia/adam
- Post builds to the community blog for QA testing - marcia
- Build should begin l10n Packaging
Monday/Tuesday - June 26 and June 27
- Firefox: Begin Basic Functional Run on Windows Platform only - marcia/tracy
- Let's try to use the tag team approach and have the run divied up between two people.
- Review feedback that comes in via the QA blog - QA team
Tuesday/Wednesday - June 27 and June 28
- Thunderbird: Begin Basic Functional Run on Windows Platform only - juanb/adam
- Let's try to use the tag team approach and have the run divied up between two people.
- If the onsite gets in the way of these dates, move to Friday the 29th
Week of June 26 - June 30
- Informal Community Testing and Test Day
Wednesday July 5 - Friday 7
- Exploratory Testing - marcia/tracy/juanb
- Build: Update Patches/CJK Repackaging begins
- Friday, July 7 - Notify Partners and Distributors of final RC - (Basil/Dveditz)
Monday, July 10 - Wed July 12 =
- l10n + Update Testing: Firefox
- Prep Security Notes and Notify Security Group - (Dveditz)
- Prep Release Notes for Firefox - ?
- Prepare Release Notes for Thunderbird - mscott
Wednesday July 12 - Friday 14
- l10n + Update Testing: Thunderbird
- Build: Release Signing Begins for FF and Tbird
Specific Testing for 1.5.0.5
There are a few areas not covered by the general test plan above, and we will track that testing here. A few things to think about and test/verify with 1.5.0.5 include:
- MacOS X Universal Binaries (marcia/Juanb/tracy)
- both BFTs and software update need to be thoroughly tested to ensure all existing users of 1.5.0.4 are properly updated to 1.5.0.5 (both PPC and UB users).
- Thunderbird PPB-UB Update Testing
- Additional Extension testing
- http://www.mozilla.com/add-ons/jogacompanion/ - joga.com extension
Please add any other bugs/areas that need special attention for this release. Thanks!
Test Results
Any 1.5.0.5 testing results that will help us track progress, identify regressions, and verify fixes should go here.
The above list is just a sample of what we will be testing and links to blank pages we should us to track our test results. Please add any other test results here. Thanks!
Bug Verifications
Fixed
Verified
Need Verification
- Bugs with JS testcases (bc?)
Cannot Verify
- https://bugzilla.mozilla.org/show_bug.cgi?id=340129 - topcrash bug with no testcase, can only be verified after release (to see if crash goes away).