Firefox:1.5.0.8:Test Plan: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
Line 76: Line 76:
**[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&keywords_type=allwords&keywords=fixed1.8.0.8&chfieldto=Now&field0-0-0=status_whiteboard&type0-0-0=notsubstring&value0-0-0=need+testcase&field0-1-0=bug_severity&type0-1-0=equals&value0-1-0=critical critical bugs]
**[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&keywords_type=allwords&keywords=fixed1.8.0.8&chfieldto=Now&field0-0-0=status_whiteboard&type0-0-0=notsubstring&value0-0-0=need+testcase&field0-1-0=bug_severity&type0-1-0=equals&value0-1-0=critical critical bugs]


* 11 security bugs ("fixed1.8.0.8" bugs, no "needs testcase" in status whiteboard, and is marked "security-sensitive"):
* 5 security bugs ("fixed1.8.0.8" bugs, no "needs testcase" in status whiteboard, and is marked "security-sensitive"):
**[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&keywords_type=allwords&keywords=fixed1.8.0.8&chfieldto=Now&field0-0-0=bug_group&type0-0-0=substring&value0-0-0=security&field0-1-0=status_whiteboard&type0-1-0=notsubstring&value0-1-0=need+testcase security bugs]
**[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&keywords_type=allwords&keywords=fixed1.8.0.8&chfieldto=Now&field0-0-0=bug_group&type0-0-0=substring&value0-0-0=security&field0-1-0=status_whiteboard&type0-1-0=notsubstring&value0-1-0=need+testcase security bugs]


Revision as of 21:23, 20 October 2006

General Firefox 1.5.0.x Test Plan

This is the basic set of tests we run for every security & maintenance release.


Assumptions

  • This release will be piggy-backing on 1.8.1
  • Builds should have gone through the l10n meta-diff checker and the update checker before they are released to QA

Current Tasks

  • Bug triage
  • Test plan completion
  • Minor/Major Software Updates discussions and testing
  • Bug verification

Schedule

Tuesday, October 17

  • Start bug verifications for bugs marked fixed1.8.0.8
  • Post to QA blog for Community Testing ?

Friday, October 20

  • Continue bug verifications
  • Start testing minor/major softare updates with mock-ups provided by Seth

Wednesday, October 25

  • Firefox release candidate builds should be available for Win/Linux/PPC
  • Smoketests (rc1) on Windows, Linux, Mac en-us
    • If smoketests go well, start BFTs

Thursday, October 26

  • Firefox BFTs
  • Build should begin l10n packaging after BFTs signoff

Friday, October 27

  • Testing of QA identified hot spots
  • Targeted exploratory testing over Developer identified hot spots (minor/major software updates, for example)

Monday, October 30, 31

  • L10n + Updates testing

Wednesday, November 1st

  • Firefox 1.5.0.8 is released, probably 4pm
  • Spot check live updates

Thusday, November 2, 3, 6

  • Start special distro spotchecks, and continue until Monday, Nov 6

Tuesday, November 7, 8

  • Test updates for special distributions

Thursday, November 9

  • Special distributions are released.
  • Live updates for special distros.

Bug Verifications

When you verify the bug is fixed, resolve it as VERIFIED FIXED and replace the fixed1.8.0.8 keyword with verified1.8.0.8

Tips:

  • Bugs verified on 1.8.1 still need to be verified in 1.8.0.8
  • If you don't see an easy way to verify or need further clarification add a comment to the bug or add "[needs testcase]" (without quotes) to the bug's Status Whiteboard.

Fixed

Verified

Priority Verifications

  • 6 mail bugs ("fixed1.8.0.8" bugs, component is "mailnews" or product is "thunderbird")
  • 16 critical bugs ("fixed1.8.0.8" bugs, no "needs testcase" in status whiteboard, and severity is "critical")
  • 5 security bugs ("fixed1.8.0.8" bugs, no "needs testcase" in status whiteboard, and is marked "security-sensitive"):

Note: If you run into a difficult bug, just add the "[need testcase]" in the status whiteboard and move on.

Need Verification

bc's JS bugs:

Cannot Verify

Retrieved from "https://wiki.mozilla.org/index.php?title=Firefox:1.5.0.8:Test_Plan&oldid=38643"