Firefox:1.5.0.8:Test Plan: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
Line 57: Line 57:
== Bug Verifications ==
== Bug Verifications ==


When you verify the bug is fixed, resolve it as VERIFIED FIXED and replace the fixed1.8.0.7 keyword with verified1.8.0.7
When you verify the bug is fixed, resolve it as VERIFIED FIXED and replace the fixed1.8.0.8 keyword with verified1.8.0.8


Tips:
Tips:
* Bugs verified on 1.8.1 still need to be verified in 1.8.0.7
* Bugs verified on 1.8.1 still need to be verified in 1.8.0.8
* If you don't see an easy way to verify or need further clarification add a comment to the bug or add "[needs testcase]" (without quotes) to the bug's Status Whiteboard.  
* If you don't see an easy way to verify or need further clarification add a comment to the bug or add "[needs testcase]" (without quotes) to the bug's Status Whiteboard.  


'''Fixed'''
'''Fixed'''
*[https://bugzilla.mozilla.org/buglist.cgi?keywords_type=allwords&keywords=fixed1.8.0.7&order=Bug+Number fixed 1.5.0.7 bugs]
*[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=fixed1.8.0.8&emailtype1=substring&email1=&emailtype2=subst fixed 1.5.0.8 bugs]


'''Verified'''
'''Verified'''
*[https://bugzilla.mozilla.org/buglist.cgi?keywords_type=allwords&keywords=verified1.8.0.7&order=Bug+Number verified 1.5.0.7 bugs]
*[https://bugzilla.mozilla.org/buglist.cgi?keywords_type=allwords&keywords=verified1.8.0.8&order=Bug+Number verified 1.5.0.8 bugs]


=== Priority Verifications ===
=== Priority Verifications ===
* 7 mail bugs ("fixed1.8.0.7" bugs, component is "mailnews" or product is "thunderbird")
* 7 mail bugs ("fixed1.8.0.8" bugs, component is "mailnews" or product is "thunderbird")
**[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&keywords_type=allwords&keywords=fixed1.8.0.7&chfieldto=Now&field0-0-0=component&type0-0-0=substring&value0-0-0=mailnews&field0-0-1=product&type0-0-1=substring&value0-0-1=thunderbird mail bugs]
**[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&keywords_type=allwords&keywords=fixed1.8.0.8&chfieldto=Now&field0-0-0=component&type0-0-0=substring&value0-0-0=mailnews&field0-0-1=product&type0-0-1=substring&value0-0-1=thunderbird mail bugs]


* 20 critical bugs ("fixed1.8.0.7" bugs, no "needs testcase" in status whiteboard, and severity is "critical")
* 20 critical bugs ("fixed1.8.0.8" bugs, no "needs testcase" in status whiteboard, and severity is "critical")
**[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&keywords_type=allwords&keywords=fixed1.8.0.7&chfieldto=Now&field0-0-0=status_whiteboard&type0-0-0=notsubstring&value0-0-0=need+testcase&field0-1-0=bug_severity&type0-1-0=equals&value0-1-0=critical critical bugs]
**[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&keywords_type=allwords&keywords=fixed1.8.0.8&chfieldto=Now&field0-0-0=status_whiteboard&type0-0-0=notsubstring&value0-0-0=need+testcase&field0-1-0=bug_severity&type0-1-0=equals&value0-1-0=critical critical bugs]


* 11 security bugs ("fixed1.8.0.7" bugs, no "needs testcase" in status whiteboard, and is marked "security-sensitive"):
* 11 security bugs ("fixed1.8.0.8" bugs, no "needs testcase" in status whiteboard, and is marked "security-sensitive"):
**[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&keywords_type=allwords&keywords=fixed1.8.0.7&chfieldto=Now&field0-0-0=bug_group&type0-0-0=substring&value0-0-0=security&field0-1-0=status_whiteboard&type0-1-0=notsubstring&value0-1-0=need+testcase security bugs]
**[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&keywords_type=allwords&keywords=fixed1.8.0.8&chfieldto=Now&field0-0-0=bug_group&type0-0-0=substring&value0-0-0=security&field0-1-0=status_whiteboard&type0-1-0=notsubstring&value0-1-0=need+testcase security bugs]


Note: If you run into a difficult bug, just add the "[need testcase]" in the status whiteboard and move on.
Note: If you run into a difficult bug, just add the "[need testcase]" in the status whiteboard and move on.


== Need Verification ==
== Need Verification ==

Revision as of 21:22, 20 October 2006

General Firefox 1.5.0.x Test Plan

This is the basic set of tests we run for every security & maintenance release.


Assumptions

  • This release will be piggy-backing on 1.8.1
  • Builds should have gone through the l10n meta-diff checker and the update checker before they are released to QA

Current Tasks

  • Bug triage
  • Test plan completion
  • Minor/Major Software Updates discussions and testing
  • Bug verification

Schedule

Tuesday, October 17

  • Start bug verifications for bugs marked fixed1.8.0.8
  • Post to QA blog for Community Testing ?

Friday, October 20

  • Continue bug verifications
  • Start testing minor/major softare updates with mock-ups provided by Seth

Wednesday, October 25

  • Firefox release candidate builds should be available for Win/Linux/PPC
  • Smoketests (rc1) on Windows, Linux, Mac en-us
    • If smoketests go well, start BFTs

Thursday, October 26

  • Firefox BFTs
  • Build should begin l10n packaging after BFTs signoff

Friday, October 27

  • Testing of QA identified hot spots
  • Targeted exploratory testing over Developer identified hot spots (minor/major software updates, for example)

Monday, October 30, 31

  • L10n + Updates testing

Wednesday, November 1st

  • Firefox 1.5.0.8 is released, probably 4pm
  • Spot check live updates

Thusday, November 2, 3, 6

  • Start special distro spotchecks, and continue until Monday, Nov 6

Tuesday, November 7, 8

  • Test updates for special distributions

Thursday, November 9

  • Special distributions are released.
  • Live updates for special distros.

Bug Verifications

When you verify the bug is fixed, resolve it as VERIFIED FIXED and replace the fixed1.8.0.8 keyword with verified1.8.0.8

Tips:

  • Bugs verified on 1.8.1 still need to be verified in 1.8.0.8
  • If you don't see an easy way to verify or need further clarification add a comment to the bug or add "[needs testcase]" (without quotes) to the bug's Status Whiteboard.

Fixed

Verified

Priority Verifications

  • 7 mail bugs ("fixed1.8.0.8" bugs, component is "mailnews" or product is "thunderbird")
  • 20 critical bugs ("fixed1.8.0.8" bugs, no "needs testcase" in status whiteboard, and severity is "critical")
  • 11 security bugs ("fixed1.8.0.8" bugs, no "needs testcase" in status whiteboard, and is marked "security-sensitive"):

Note: If you run into a difficult bug, just add the "[need testcase]" in the status whiteboard and move on.

Need Verification

bc's JS bugs:

Cannot Verify

Retrieved from "https://wiki.mozilla.org/index.php?title=Firefox:1.5.0.8:Test_Plan&oldid=38641"