QA/Firefox3.5/TestPlan/RC3: Difference between revisions

From MozillaWiki
< QA‎ | Firefox3.5‎ | TestPlan
Jump to navigation Jump to search
 
(62 intermediate revisions by 8 users not shown)
Line 1: Line 1:
== Firefox 3.5rc3 Test Plan ==
== Firefox 3.5rc3 Test Plan ==
juanb to update


== Description of Release ==
== Description of Release ==
This will address a few (~three) video bugs, and possibly a top crasher.
We are addressing several bugs in video playback, tab drag and drop, and other miscellaneous critical bugs. This release candidate will be available through the all-beta download page, and it will be offered in the form of software updates to our beta users on 3.5x.


== Specific Plan for RC3 ==
== Specific Plan for RC3 ==
We are going to run '''smoketests''', '''l10n spot checks''', '''updates checks''' and we are going to verify the bugs that landed for this release. In addition we are going to run '''sections of the full functional tests''' that are touched by the fixes that landed. These include tabbed browsing (including drag&drop) and video playback controls.
Given that we took the fix for {{Bug|499169}} we are having someone check if the browser loads the URLs where people were reporting crashes. This is on-going as of 6/24 evening PDT.
== Schedule ==
== Schedule ==
In flux. We will very likely get builds today (Tue 6/23). We will then run smoketests, verifications, and focused tests for a couple of days before offering updates later this week. (As it happens, we are releasing updates Wednesday night 6/24).
* Verifications: Henrik (whimboo)
* Smoketests: abillings, ashughes, marcia, juanb
* FFTs: see section
* l10n checks: tchung
* Updates checks: aakashd, aaronmt, juanb
== Builds ==
== Builds ==
As of 6/24 the latest is ''build2'' and it can be found here:
ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/3.5rc3-candidates/
== Build IDs ==
*Intel Mac 10.5
**Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1) Gecko/20090624012136 Firefox/3.5
*Intel Mac 10.4
** Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9.1) Gecko/20090624012136 Firefox/3.5
*PPC Mac 10.4
** Mozilla/5.0 (Macintosh; U; PPC Mac OS X 10.4; en-US; rv:1.9.1) Gecko/20090624012136 Firefox/3.5
* Linux i686
** Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1) Gecko/20090624012820 Firefox/3.5
* Windows Vista (vm)
**Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1) Gecko/20090624 Firefox/3.5 (BuildID: 20090624025744)
== Test Results ==
== Test Results ==
* [[QA/Firefox3.5/TestPlan/RC3/Smoketests | Smoketests]]: '''overall result'''
* Verifications: '''PASS. see below'''
* [[QA/Firefox3.5/TestPlan/RC3/FFTs | FFTs (focused testing)]]: '''overall result'''
* [[QA/Firefox3.5/TestPlan/RC3/Smoketests | Smoketests]]: '''PASS'''
* [[QA/Firefox3.5/TestPlan/RC3/l10n | l10n Spot Checks]]: '''overall result'''
* [[QA/Firefox3.5/TestPlan/RC3/FFTs | FFTs (focused testing)]]: '''PASS'''
* [[QA/Firefox3.5/TestPlan/RC3/Software Update | Updates]]: '''overall result'''
* [[QA/Firefox3.5/TestPlan/RC3/l10n | l10n Spot Checks]]: '''PASS'''
* [[QA/Firefox3.5/TestPlan/RC3/Software Update | Updates]]: '''PASS'''
* [[QA/Firefox3.5/TestPlan/RC3/Major Update | Major Updates]]: '''PASS for betatest'''


== Target Bugs to Verify ==
== Target Bugs to Verify ==
So far these are being considered:
* [http://bit.ly/1fRGwf '''Full List (~13 Total, fixed or verified by now)''']
 
* {{Bug|499169}} - top crash [@ js_MonitorLoopEdge(JSContext*, unsigned int&)]
** Status: Bob Clary (bc) is running some tests by loading URLs coming from the crash reports and making sure these URLs no longer crash the browser.
*{{Bug|496684}} - some valid ogg files are rejected as invalid
** Status: ''reopened''  This may not be a blocker now.
*{{Bug|498815}} - crash in oggplay_data_handle_theora_frame
** Status: ''verified''
*{{Bug|498824}} - Crash in Theora th_comment_clear
** Status: ''verified''
*{{Bug|498827}} - Crash at _v_readstring at vorbis_info.c:54
** Status: ''verified''
*{{Bug|498853}} - Crash in vorbis_comment_clear
** Status: ''verified''
*{{Bug|498855}} - Crash in vorbis_synthesis
** Status: ''verified''
*{{Bug|497563}} - Crashes [@ BindStatementURI]
** Status: ''verified''
*{{Bug|492390}} - credits.xhtml update for 3.5 release
*{{Bug|492390}} - credits.xhtml update for 3.5 release
** Status: ''reopened on trunk''
*{{Bug|494026}} - drag and drop a tab onto the new tab button in the toolbar does not duplicate tab
*{{Bug|494026}} - drag and drop a tab onto the new tab button in the toolbar does not duplicate tab
*{{Bug|495962}} - TM assertion (needs to land on 191)
** Status: ''reopened on trunk''
** Status: ''not verified''
* ... ''see more in full list''
*{{Bug|499169}} - TM topcrash (need to find regressor)
** Status: ''not verified''
*{{Bug|499603}} - TM leak (need comment 8 answered)
** Status: ''not verified''
*{{Bug|427715}} - NSS topcrash (still blocks?)
** Status: ''not verified''
* Others...(making a list)

Latest revision as of 06:06, 29 June 2009

Firefox 3.5rc3 Test Plan

Description of Release

We are addressing several bugs in video playback, tab drag and drop, and other miscellaneous critical bugs. This release candidate will be available through the all-beta download page, and it will be offered in the form of software updates to our beta users on 3.5x.

Specific Plan for RC3

We are going to run smoketests, l10n spot checks, updates checks and we are going to verify the bugs that landed for this release. In addition we are going to run sections of the full functional tests that are touched by the fixes that landed. These include tabbed browsing (including drag&drop) and video playback controls.

Given that we took the fix for bug 499169 we are having someone check if the browser loads the URLs where people were reporting crashes. This is on-going as of 6/24 evening PDT.

Schedule

In flux. We will very likely get builds today (Tue 6/23). We will then run smoketests, verifications, and focused tests for a couple of days before offering updates later this week. (As it happens, we are releasing updates Wednesday night 6/24).

  • Verifications: Henrik (whimboo)
  • Smoketests: abillings, ashughes, marcia, juanb
  • FFTs: see section
  • l10n checks: tchung
  • Updates checks: aakashd, aaronmt, juanb

Builds

As of 6/24 the latest is build2 and it can be found here:

ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/3.5rc3-candidates/

Build IDs

  • Intel Mac 10.5
    • Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1) Gecko/20090624012136 Firefox/3.5
  • Intel Mac 10.4
    • Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9.1) Gecko/20090624012136 Firefox/3.5
  • PPC Mac 10.4
    • Mozilla/5.0 (Macintosh; U; PPC Mac OS X 10.4; en-US; rv:1.9.1) Gecko/20090624012136 Firefox/3.5
  • Linux i686
    • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1) Gecko/20090624012820 Firefox/3.5
  • Windows Vista (vm)
    • Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1) Gecko/20090624 Firefox/3.5 (BuildID: 20090624025744)

Test Results

Target Bugs to Verify

  • Full List (~13 Total, fixed or verified by now)
  • bug 499169 - top crash [@ js_MonitorLoopEdge(JSContext*, unsigned int&)]
    • Status: Bob Clary (bc) is running some tests by loading URLs coming from the crash reports and making sure these URLs no longer crash the browser.
  • bug 496684 - some valid ogg files are rejected as invalid
    • Status: reopened This may not be a blocker now.
  • bug 498815 - crash in oggplay_data_handle_theora_frame
    • Status: verified
  • bug 498824 - Crash in Theora th_comment_clear
    • Status: verified
  • bug 498827 - Crash at _v_readstring at vorbis_info.c:54
    • Status: verified
  • bug 498853 - Crash in vorbis_comment_clear
    • Status: verified
  • bug 498855 - Crash in vorbis_synthesis
    • Status: verified
  • bug 497563 - Crashes [@ BindStatementURI]
    • Status: verified
  • bug 492390 - credits.xhtml update for 3.5 release
    • Status: reopened on trunk
  • bug 494026 - drag and drop a tab onto the new tab button in the toolbar does not duplicate tab
    • Status: reopened on trunk
  • ... see more in full list