Firefox:1.5.0.8:Test Plan: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
Line 18: Line 18:


=== Tuesday, October 17 ===
=== Tuesday, October 17 ===
* Start bug verifications
* Start bug verifications for bugs marked fixed1.8.0.8
* Post to QA blog for Community Testing ?


=== Tuesday, August 29th ===
=== Friday, October 20 ===
* Firefox builds should be available for Win/Linux/PPC
* Continue bug verifications
* Smoketests (rc2) on Windows, Linux, Mac en-us
* Start testing minor/major softare updates with mock-ups provided by Seth
** [[Firefox:1.5.0.7:Smoketests|1.5.0.7 Firefox and Thunderbird Smoketest results]]


=== Wednesday, August 30th ===
=== Wednesday, October 25 ===
* Firefox BFTs - PASS
* Firefox release candidate builds should be available for Win/Linux/PPC
** [[Firefox:1.5.0.7:BFTs|1.5.0.7 Firefox and Thunderbird BFT results]]
* Smoketests (rc1) on Windows, Linux, Mac en-us
* Build should begin l10n packaging after BFTs signoff (Rhelmer/TR)
** If smoketests go well, start BFTs
* Get post up on the QA blog with link to candidate builds
* Testing of QA identified hot spots
* Targeted exploratory testing over Developer identified hot spots


=== Thursday, August 31st ===
=== Thursday, October 26 ===
* Continued testing of developer identified hot spots and bug verifications
* Firefox BFTs
* Build should begin l10n packaging after BFTs signoff


=== Friday, September 1st ===
=== Friday, October 27 ===
* Community Testday for 1.5.0.7 RC builds
* Testing of QA identified hot spots
* Smoketests (rc2) on Windows, Linux, Mac en-us
* Targeted exploratory testing over Developer identified hot spots (minor/major software updates, for example)
** [[Firefox:1.5.0.7:Smoketests|1.5.0.7 Firefox and Thunderbird Smoketest results]]
* Thunderbird BFTs - PASS
** [[Firefox:1.5.0.7:BFTs|1.5.0.7 Firefox and Thunderbird BFT results]]
* Bug verifications and focus testing
 
=== Tuesday, September 5th ===
* Further bug verifications and testing of hot spots
* Thunderbird Smoketests
* Start Thunderbird BFTs
 
=== Wednesday, September 6th ===
* Firefox RC4 will be released this afternoon
* Smoketest Firefox RC4
** [[Firefox:1.5.0.7:Smoketests|1.5.0.7 Firefox Smoketest results]]
* Thunderbird bug verifications
 
=== Thursday, September 7th ===
* Respins for rc5 out late Sept. 6
* Smoketest rc5 builds
** [[Firefox:1.5.0.7:Smoketests|1.5.0.7 Firefox Smoketest results]]
* Firefox security testing for RSA/Certificate changes
** https://bugzilla.mozilla.org/show_bug.cgi?id=340198
** https://bugzilla.mozilla.org/show_bug.cgi?id=351079
** https://bugzilla.mozilla.org/show_bug.cgi?id=350640
* Thunderbird bug verifications
 
=== Friday, September 8th ===
* Spot check P1 locales
** [[Firefox:1.5.0.7:LocalizationTesting|1.5.0.7 Firefox and Thunderbird Localization testing results]]
** Check other tier 2 locales as time permits
**[[Firefox:1.5.0.7:Extension Testing|1.5.0.7 Firefox and Thunderbird Extension Testing results]]
 
=== Monday, September 11th ===
* Smoketest rc6 builds
** [[Firefox:1.5.0.7:Smoketests#RC6_builds_-_tested_09.2F10|1.5.0.7 Firefox Smoketest results]]
* Spot check Thunderbird P1 locales
** [[Firefox:1.5.0.7:LocalizationTesting|1.5.0.7 Firefox and Thunderbird Localization testing results]]
** Check other tier 2 locales as time permits
* Spot check a few CJK builds (WinXP)
** zhCN, ko Yahoo!: PASS (new build ID: 2006090918)
** ja, zhTW Google: PASS (new build ID: 2006090918)
** Other locales verified by diff scripts (rc5 vs rc6 PASS, no changes)
** Original test results:
*** https://intranet.mozilla.org/QA:FF1.5.0.7:GoogleCJK:Test_Results
*** https://intranet.mozilla.org/QA:FF1.5.0.7:YahooCJK:Test_Results
 
=== Tuesday, September 12th ===
* Focus/Exploratory testing for SSL/SMIME bug fixes
* Update testing for P1 locales
** [[Firefox:1.5.0.7:UpdateTesting|1.5.0.7 Firefox and Thunderbird Update testing results]]


=== Wednesday, September 13th ===
=== Monday, October 30, 31 ===
* Update testing for P1 locales
* L10n + Updates testing
** [[Firefox:1.5.0.7:UpdateTesting|1.5.0.7 Firefox and Thunderbird Update testing results]]
* Update testing for Google/Yahoo! CJK
** [[Firefox:1.5.0.7:CJKUpdateTesting|1.5.0.7 Firefox Google/Yahoo! CJK Update testing results]]


=== Wednesday, November 1st ===
=== Wednesday, November 1st ===
Line 101: Line 46:


=== Thusday, November 2, 3, 6 ===
=== Thusday, November 2, 3, 6 ===
** Start special distro spotchecks, and continue until Monday, Nov 6
* Start special distro spotchecks, and continue until Monday, Nov 6


=== Tuesday, November 7, 8 ===  
=== Tuesday, November 7, 8 ===  
** Test updates for special distributions
* Test updates for special distributions


=== Thursday, November 9 ===
=== Thursday, November 9 ===
** Special distributions are released.
* Special distributions are released.
** Live updates for special distros.
* Live updates for special distros.


== Bug Verifications ==
== Bug Verifications ==

Revision as of 21:12, 20 October 2006

General Firefox 1.5.0.x Test Plan

This is the basic set of tests we run for every security & maintenance release.


Assumptions

  • This release will be piggy-backing on 1.8.1
  • Builds should have gone through the l10n meta-diff checker and the update checker before they are released to QA

Current Tasks

  • Bug triage
  • Test plan completion
  • Minor/Major Software Updates discussions and testing
  • Bug verification

Schedule

Tuesday, October 17

  • Start bug verifications for bugs marked fixed1.8.0.8
  • Post to QA blog for Community Testing ?

Friday, October 20

  • Continue bug verifications
  • Start testing minor/major softare updates with mock-ups provided by Seth

Wednesday, October 25

  • Firefox release candidate builds should be available for Win/Linux/PPC
  • Smoketests (rc1) on Windows, Linux, Mac en-us
    • If smoketests go well, start BFTs

Thursday, October 26

  • Firefox BFTs
  • Build should begin l10n packaging after BFTs signoff

Friday, October 27

  • Testing of QA identified hot spots
  • Targeted exploratory testing over Developer identified hot spots (minor/major software updates, for example)

Monday, October 30, 31

  • L10n + Updates testing

Wednesday, November 1st

  • Firefox 1.5.0.8 is released, probably 4pm
  • Spot check live updates

Thusday, November 2, 3, 6

  • Start special distro spotchecks, and continue until Monday, Nov 6

Tuesday, November 7, 8

  • Test updates for special distributions

Thursday, November 9

  • Special distributions are released.
  • Live updates for special distros.

Bug Verifications

When you verify the bug is fixed, resolve it as VERIFIED FIXED and replace the fixed1.8.0.7 keyword with verified1.8.0.7

Tips:

  • Bugs verified on 1.8.1 still need to be verified in 1.8.0.7
  • If you don't see an easy way to verify or need further clarification add a comment to the bug or add "[needs testcase]" (without quotes) to the bug's Status Whiteboard.

Fixed

Verified

Priority Verifications

  • 7 mail bugs ("fixed1.8.0.7" bugs, component is "mailnews" or product is "thunderbird")
  • 20 critical bugs ("fixed1.8.0.7" bugs, no "needs testcase" in status whiteboard, and severity is "critical")
  • 11 security bugs ("fixed1.8.0.7" bugs, no "needs testcase" in status whiteboard, and is marked "security-sensitive"):

Note: If you run into a difficult bug, just add the "[need testcase]" in the status whiteboard and move on.


Need Verification

bc's JS bugs:

Cannot Verify

Retrieved from "https://wiki.mozilla.org/index.php?title=Firefox:1.5.0.8:Test_Plan&oldid=38639"