Firefox:1.5.0.9-2.0.0.1:Test Plan: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(60 intermediate revisions by 5 users not shown)
Line 8: Line 8:
== Current Tasks ==
== Current Tasks ==


* Bug triage
* Live Updates Testing (12.19.2006)
** Updates should be live sometime tomorrow afternoon.
 
* Software Updates (12.12.2006)
** FF2.0.0.1 (en-US), FF1.5.0.9(all)
** TB 1.5.0.9 (all)-12.13
* ''' Bug Verifications'''
* ''' Bug Verifications'''
**Help out by going through the '''fixed bugs''' and verifying them:
**Help out by going through the '''fixed bugs''' and verifying them:
***[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=fixed1.8.0.9&emailtype1=substring&email1=&emailtype2=subst fixed 1.5.0.9 bugs]
***[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=fixed1.8.0.9&emailtype1=substring&email1=&emailtype2=subst fixed 1.5.0.9 bugs]
***[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=fixed1.8.1.1&emailtype1=substring&email1=&emailtype2=subst fixed 2.0.0.1 bugs]
***[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=fixed1.8.1.1&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=keywords&type0-0-0=notsubstring&value0-0-0=verified1.8.1.1&field0-1-0=product&type0-1-0=notsubstring&value0-1-0=Camino&field0-2-0=product&type0-2-0=notsubstring&value0-2-0=Localizations&field0-3-0=product&type0-3-0=nowordssubstr&value0-3-0=Thunderbird&field0-4-0=component&type0-4-0=notsubstring&value0-4-0=XForms fixed 2.0.0.1 bugs]


== Schedule ==
== Schedule ==
 
* Tentative Release Date: '''December 14th'''
=== December 14th ===
* Overall Schedule from [[Firefox:1.5.0.9-2.0.0.1:Community#Overall_Schedule|Community Page]]
* Tentative Release Date


== Test Results ==
== Test Results ==
Any 1.5.0.9-2.0.0.1 testing results that will help us track progress, identify regressions, and verify fixes should go here.
Any 1.5.0.9-2.0.0.1 testing results that will help us track progress, identify regressions, and verify fixes should go here.


* [[Firefox:1.5.0.9-2.0.0.1:Test_Plan:BFT | Basic Functional Tests (BFTs)]]
{| border="1" cellpadding="5" cellspacing="0" align="center"
|+'''Status (12/04/2006)'''
|-
!
! style="background:#ffdead;" | FF2001
! style="background:#ffdead;" | FF1509
! style="background:#ffdead;" | TB1509
|-
| style="background:#ffdead;" | '''Smoketest'''
| '''PASS''' (RC1 - 20061204 tracy)
| '''PASS''' (tracy)
| '''PASS'''
|-
| style="background:#ffdead;" | '''BFT'''
| Tomcat - '''PASS''' 2001 BFT (Linux/Windows)
| '''PASS'''
| '''PASS''' (tomcat)
|-
|}
 
* [[Firefox:1.5.0.9-2.0.0.1:Test_Plan:BFT | Smoketests and BFTs]]
* [[Firefox:1.5.0.9-2.0.0.1:Test_Plan:l10n | l10n related testing]]
* [[Firefox:1.5.0.9-2.0.0.1:Test_Plan:l10n | l10n related testing]]
* [[Firefox:1.5.0.9-2.0.0.1:Test_Plan:Software Update | Updates Testing]]
* [[Firefox:1.5.0.9-2.0.0.1:Test_Plan:Software Update | Updates Testing]]
* [[Firefox:1.5.0.9-2.0.0.1:Test_Plan:Minor Major Software Update | Minor-Major Software Update Testing]]
* [[Firefox:1.5.0.9-2.0.0.1:Test_Plan:Vista Software Update | Vista Updates Testing]]
* Distro Test Results: TBD
* [[Firefox:1.5.0.9-2.0.0.1:Test_Plan:Distro Test Results | Distro Test Results]]
* [http://people.mozilla.org/~timr/FF2.0.0.1/Results/test_results_2.0.0.1.zip Search Engine Checker results from Alice: test_results_2.0.0.1.zip]
* New locale testing: Hebrew - [http://people.mozilla.org/~timr/FF2.0.0.1/Results/Hebrew_Testing/index.mht 3rd party testing results] (without language skills)


'''The above list is just a sample of what we will be testing and links to blank pages we should us to track our test results.  Please add any other test results here.  Thanks!'''
'''The above list is just a sample of what we will be testing and links to blank pages we should us to track our test results.  Please add any other test results here.  Thanks!'''
Line 32: Line 58:
== Bug Verifications ==
== Bug Verifications ==


When you verify the bug is fixed, resolve it as VERIFIED FIXED and replace the fixed1.8.0.9 / fixed1.8.1.1 keyword with verified1.8.0.9 / verified1.8.1.1
'''When you verify the bug is fixed, resolve it as VERIFIED FIXED and replace the fixed1.8.0.9 / fixed1.8.1.1 keyword with verified1.8.0.9 / verified1.8.1.1'''


Tips:
Tips:
Line 40: Line 66:
'''Fixed'''
'''Fixed'''
*[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=fixed1.8.0.9&emailtype1=substring&email1=&emailtype2=subst fixed 1.5.0.9 bugs]
*[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=fixed1.8.0.9&emailtype1=substring&email1=&emailtype2=subst fixed 1.5.0.9 bugs]
 
*[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=fixed1.8.1.1&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=keywords&type0-0-0=notsubstring&value0-0-0=verified1.8.1.1&field0-1-0=product&type0-1-0=notsubstring&value0-1-0=Camino&field0-2-0=product&type0-2-0=notsubstring&value0-2-0=Localizations&field0-3-0=product&type0-3-0=nowordssubstr&value0-3-0=Thunderbird&field0-4-0=component&type0-4-0=notsubstring&value0-4-0=XForms fixed 2.0.0.1 bugs]
*[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=fixed1.8.1.1&emailtype1=substring&email1=&emailtype2=subst fixed 2.0.0.1 bugs]
** Excludes Camino, Thunderbird, Localizations and XForms


'''Verified'''
'''Verified'''
Line 48: Line 74:


=== Priority Verifications ===
=== Priority Verifications ===
* 1 mail bugs ("fixed1.8.0.9" bugs, component is "mailnews" or product is "thunderbird")
* 2 mail bugs ("fixed1.8.0.9" bugs, component is "mailnews" or product is "thunderbird")
**[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&keywords_type=allwords&keywords=fixed1.8.0.9&chfieldto=Now&field0-0-0=component&type0-0-0=substring&value0-0-0=mailnews&field0-0-1=product&type0-0-1=substring&value0-0-1=thunderbird mail bugs]
**[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&keywords_type=allwords&keywords=fixed1.8.0.9&chfieldto=Now&field0-0-0=component&type0-0-0=substring&value0-0-0=mailnews&field0-0-1=product&type0-0-1=substring&value0-0-1=thunderbird mail bugs]


* 21-29 critical bugs ("fixed1.8.0.9" or "fixed1.8.1.1" bugs, no "needs testcase" in status whiteboard, and severity is "critical")
* 6-9 critical bugs ("fixed1.8.0.9" or "fixed1.8.1.1" bugs, no "needs testcase" in status whiteboard, and severity is "critical")
**[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&keywords_type=allwords&keywords=fixed1.8.0.9&chfieldto=Now&field0-0-0=status_whiteboard&type0-0-0=notsubstring&value0-0-0=need+testcase&field0-1-0=bug_severity&type0-1-0=equals&value0-1-0=critical 1.5.0.9 critical bugs]
**[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&keywords_type=allwords&keywords=fixed1.8.0.9&chfieldto=Now&field0-0-0=status_whiteboard&type0-0-0=notsubstring&value0-0-0=need+testcase&field0-1-0=bug_severity&type0-1-0=equals&value0-1-0=critical 1.5.0.9 critical bugs]
**[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&keywords_type=allwords&keywords=fixed1.8.1.1&chfieldto=Now&field0-0-0=status_whiteboard&type0-0-0=notsubstring&value0-0-0=need+testcase&field0-1-0=bug_severity&type0-1-0=equals&value0-1-0=critical 2.0.0.1 critical bugs]
**[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&keywords_type=allwords&keywords=fixed1.8.1.1&chfieldto=Now&field0-0-0=status_whiteboard&type0-0-0=notsubstring&value0-0-0=need+testcase&field0-1-0=bug_severity&type0-1-0=equals&value0-1-0=critical 2.0.0.1 critical bugs]


* 14-17 security bugs ("fixed1.8.0.9" or "fixed1.8.1.1" bugs, no "needs testcase" in status whiteboard, and is marked "security-sensitive"):
* 11-13 security bugs ("fixed1.8.0.9" or "fixed1.8.1.1" bugs, no "needs testcase" in status whiteboard, and is marked "security-sensitive"):
**[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&keywords_type=allwords&keywords=fixed1.8.0.9&chfieldto=Now&field0-0-0=bug_group&type0-0-0=substring&value0-0-0=security&field0-1-0=status_whiteboard&type0-1-0=notsubstring&value0-1-0=need+testcase 1.5.0.9 security bugs]
**[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&keywords_type=allwords&keywords=fixed1.8.0.9&chfieldto=Now&field0-0-0=bug_group&type0-0-0=substring&value0-0-0=security&field0-1-0=status_whiteboard&type0-1-0=notsubstring&value0-1-0=need+testcase 1.5.0.9 security bugs]
**[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&keywords_type=allwords&keywords=fixed1.8.1.1&chfieldto=Now&field0-0-0=bug_group&type0-0-0=substring&value0-0-0=security&field0-1-0=status_whiteboard&type0-1-0=notsubstring&value0-1-0=need+testcase 2.0.0.1 security bugs]
**[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&keywords_type=allwords&keywords=fixed1.8.1.1&chfieldto=Now&field0-0-0=bug_group&type0-0-0=substring&value0-0-0=security&field0-1-0=status_whiteboard&type0-1-0=notsubstring&value0-1-0=need+testcase 2.0.0.1 security bugs]
Line 62: Line 88:


== Need Verification ==
== Need Verification ==
* bc?
** https://bugzilla.mozilla.org/show_bug.cgi?id=347306
** https://bugzilla.mozilla.org/show_bug.cgi?id=352064
** https://bugzilla.mozilla.org/show_bug.cgi?id=361467
* need external verifications
** https://bugzilla.mozilla.org/show_bug.cgi?id=358863 (verify on os/2)
** https://bugzilla.mozilla.org/show_bug.cgi?id=348706 (java testcase)
* difficult testcases
** https://bugzilla.mozilla.org/show_bug.cgi?id=359882
** https://bugzilla.mozilla.org/show_bug.cgi?id=361730


== Cannot Verify ==
== Cannot Verify ==
'''JS Bugs:'''
* 347065 JavaScript Can not compile without JS_HAS_GENERATORS
* 347065 JavaScript Can not compile without JS_HAS_GENERATORS
* 354982 JavaScript Cleaning up iterator implementation
* 354982 JavaScript Cleaning up iterator implementation
* 357169 JavaScript GC temp roots cleanup
* [https://bugzilla.mozilla.org/show_bug.cgi?id=357169 357169] JavaScript GC temp roots cleanup
* 357388 JavaScript js_SweepScopeProperties can leave a JSScopeProperty with dangling parent pointer
* 357388 JavaScript js_SweepScopeProperties can leave a JSScopeProperty with dangling parent pointer
* 357392 JavaScript jsdtoa.c - locks not released in some error cases
* 357392 JavaScript jsdtoa.c - locks not released in some error cases
* 357398 JavaScript js_ExpandErrorArguments can crash in OOM conditions
* 357398 JavaScript js_ExpandErrorArguments can crash in OOM conditions
* 358867 JavaScript Return value in a void function
* [https://bugzilla.mozilla.org/show_bug.cgi?id=358867 358867] JavaScript Return value in a void function
* [https://bugzilla.mozilla.org/show_bug.cgi?id=358528 358528] Leak Monitor locks Firefox.exe during startup
** Caused open regression (along with bug 357169) [https://bugzilla.mozilla.org/show_bug.cgi?id=358661 358661]
* https://bugzilla.mozilla.org/show_bug.cgi?id=358569
* 360612 JavaScript GC can leave GSN cache pointing to destroyed script
* 360612 JavaScript GC can leave GSN cache pointing to destroyed script
* 361273 JavaScript Assert fail: cg->stackDepth >= 0, at jsemit.c:164
* 361273 JavaScript Assert fail: cg->stackDepth >= 0, at jsemit.c:164
* 361362 JavaScript js/src/jsemit.c assumes sizeof(int) == sizeof(ptrdiff_t)
* 361362 JavaScript js/src/jsemit.c assumes sizeof(int) == sizeof(ptrdiff_t)
'''Build Bugs (lack of comments after checkin suggest these are fixed):'''
* https://bugzilla.mozilla.org/show_bug.cgi?id=358953
* https://bugzilla.mozilla.org/show_bug.cgi?id=359000
* https://bugzilla.mozilla.org/show_bug.cgi?id=359001
* https://bugzilla.mozilla.org/show_bug.cgi?id=359687

Latest revision as of 00:08, 19 December 2006

General Firefox 1.5.0.x Test Plan

This is the basic set of tests we run for every security & maintenance release.

Assumptions

  • 1.5.0.9 and 2.0.0.1 are simultaneous releases of Firefox. In addition we are releasing Thunderbird 1.5.0.9

Current Tasks

  • Live Updates Testing (12.19.2006)
    • Updates should be live sometime tomorrow afternoon.
  • Software Updates (12.12.2006)
    • FF2.0.0.1 (en-US), FF1.5.0.9(all)
    • TB 1.5.0.9 (all)-12.13
  • Bug Verifications

Schedule

  • Tentative Release Date: December 14th
  • Overall Schedule from Community Page

Test Results

Any 1.5.0.9-2.0.0.1 testing results that will help us track progress, identify regressions, and verify fixes should go here.

Status (12/04/2006)
FF2001 FF1509 TB1509
Smoketest PASS (RC1 - 20061204 tracy) PASS (tracy) PASS
BFT Tomcat - PASS 2001 BFT (Linux/Windows) PASS PASS (tomcat)

The above list is just a sample of what we will be testing and links to blank pages we should us to track our test results. Please add any other test results here. Thanks!

Bug Verifications

When you verify the bug is fixed, resolve it as VERIFIED FIXED and replace the fixed1.8.0.9 / fixed1.8.1.1 keyword with verified1.8.0.9 / verified1.8.1.1

Tips:

  • Verify on both 1.8.0.9 and 1.8.1.1
  • If you don't see an easy way to verify or need further clarification add a comment to the bug or add "[needs testcase]" (without quotes) to the bug's Status Whiteboard.

Fixed

Verified

Priority Verifications

  • 2 mail bugs ("fixed1.8.0.9" bugs, component is "mailnews" or product is "thunderbird")

Note: If you run into a difficult bug, just add the "[need testcase]" in the status whiteboard and move on.

Need Verification

Cannot Verify

JS Bugs:

  • 347065 JavaScript Can not compile without JS_HAS_GENERATORS
  • 354982 JavaScript Cleaning up iterator implementation
  • 357169 JavaScript GC temp roots cleanup
  • 357388 JavaScript js_SweepScopeProperties can leave a JSScopeProperty with dangling parent pointer
  • 357392 JavaScript jsdtoa.c - locks not released in some error cases
  • 357398 JavaScript js_ExpandErrorArguments can crash in OOM conditions
  • 358867 JavaScript Return value in a void function
  • 358528 Leak Monitor locks Firefox.exe during startup
    • Caused open regression (along with bug 357169) 358661
  • https://bugzilla.mozilla.org/show_bug.cgi?id=358569
  • 360612 JavaScript GC can leave GSN cache pointing to destroyed script
  • 361273 JavaScript Assert fail: cg->stackDepth >= 0, at jsemit.c:164
  • 361362 JavaScript js/src/jsemit.c assumes sizeof(int) == sizeof(ptrdiff_t)


Build Bugs (lack of comments after checkin suggest these are fixed):

Retrieved from "https://wiki.mozilla.org/index.php?title=Firefox:1.5.0.9-2.0.0.1:Test_Plan&oldid=44796"