Firefox:1.5.0.7:Test Plan

General Firefox 1.5.0.x Test Plan

This is the basic set of tests we run for every security & maintenance release.

Assumptions

• Goal of this release is security fixes and important regressions, other fixes will not be included
• Builds should have gone through the l10n meta-diff checker and the update checker before they are released to QA
• No Thunderbird release unless a security fix becomes necessary
• Monday, September 4th is a holiday

Current Tasks

• Bug triage
• Test plan completion
• Bug verification

Monday, August 28th - Tuesday September 12th

• Ongoing Bug verifications.

Monday, August 28th

• RC1 delayed till Monday night/Tuesday morning. Shifting Monday's planned activities to Tuesday

Tuesday, August 29th

• Firefox builds should be available for Win/Linux/PPC
• Smoketests (rc2) on Windows, Linux, Mac en-us
  • 1.5.0.7 Smoketest results
• Work out BFT schedule (divide and conquer)

Wednesday, August 30th

• Firefox BFTs - PASS
  • tester: tracy
  • Windows XP
  • Build ID: 2006082915
  • Results: results query
    • note: long standing failure in copy/paste in bookmarks - not a blocker for release
• Build should begin l10n packaging after BFTs signoff (Rhelmer/TR)
• Get post up on the QA blog with link to candidate builds
• Testing of QA identified hot spots
• Targeted exploratory testing over Developer identified hot spots

Thursday, August 31st

• Continued testing of developer identified hot spots and bug verifications

Friday, September 1st

• Community Testday for 1.5.0.7 RC builds
• Smoketests (rc2) on Windows, Linux, Mac en-us
  • 1.5.0.7 Smoketest results
• Bug verifications and focus testing

Tuesday, September 5th

• Further bug verifications and testing of hot spots
• Thunderbird Smoketests
• Start Thunderbird BFTs

Wednesday, September 6th

• Spot check P1 locales
  • 1.5.0.7 Localization testing results
  • Check other tier 2 locales as time permits
• Thunderbird BFTs

Thursday, September 7th

• Continued spot check P1 locales
  • 1.5.0.7 Localization testing results
  • Check other tier 2 locales as time permits

Friday, September 8th

• Update testing for P1 locales
  • 1.5.0.7 Update testing results
• Random update spot checks of other locales

Monday, September 11th

• Continued update testing for P1 locales
  • 1.5.0.7 Update testing results
• Random update spot checks of other locales

Tuesday, September 12th

• 1.5.0.7 is released
• Spot check live updates

Bug Verifications

When you verify the bug is fixed, resolve it as VERIFIED FIXED and replace the fixed1.8.0.7 keyword with verified1.8.0.7

Tips:

• Bugs verified on 1.8.1 still need to be verified in 1.8.0.7
• If you don't see an easy way to verify or need further clarification add a comment to the bug or add "[needs testcase]" (without quotes) to the bug's Status Whiteboard.

Fixed

• fixed 1.5.0.7 bugs

Verified

• verified 1.5.0.7 bugs

Need Verification

bc's JS bugs:

• https://bugzilla.mozilla.org/show_bug.cgi?id=348532

Cannot Verify

• https://bugzilla.mozilla.org/show_bug.cgi?id=347725 (no crash with 1506, 1507, or 2)
  • https://bugzilla.mozilla.org/show_bug.cgi?id=350081 (not sure what to look for with testcase)