QA/Firefox3.5/TestPlan/RC3

From MozillaWiki
< QA‎ | Firefox3.5‎ | TestPlan
Jump to: navigation, search

Firefox 3.5rc3 Test Plan

Description of Release

We are addressing several bugs in video playback, tab drag and drop, and other miscellaneous critical bugs. This release candidate will be available through the all-beta download page, and it will be offered in the form of software updates to our beta users on 3.5x.

Specific Plan for RC3

We are going to run smoketests, l10n spot checks, updates checks and we are going to verify the bugs that landed for this release. In addition we are going to run sections of the full functional tests that are touched by the fixes that landed. These include tabbed browsing (including drag&drop) and video playback controls.

Given that we took the fix for bug 499169 we are having someone check if the browser loads the URLs where people were reporting crashes. This is on-going as of 6/24 evening PDT.

Schedule

In flux. We will very likely get builds today (Tue 6/23). We will then run smoketests, verifications, and focused tests for a couple of days before offering updates later this week. (As it happens, we are releasing updates Wednesday night 6/24).

  • Verifications: Henrik (whimboo)
  • Smoketests: abillings, ashughes, marcia, juanb
  • FFTs: see section
  • l10n checks: tchung
  • Updates checks: aakashd, aaronmt, juanb

Builds

As of 6/24 the latest is build2 and it can be found here:

ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/3.5rc3-candidates/

Build IDs

  • Intel Mac 10.5
    • Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1) Gecko/20090624012136 Firefox/3.5
  • Intel Mac 10.4
    • Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9.1) Gecko/20090624012136 Firefox/3.5
  • PPC Mac 10.4
    • Mozilla/5.0 (Macintosh; U; PPC Mac OS X 10.4; en-US; rv:1.9.1) Gecko/20090624012136 Firefox/3.5
  • Linux i686
    • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1) Gecko/20090624012820 Firefox/3.5
  • Windows Vista (vm)
    • Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1) Gecko/20090624 Firefox/3.5 (BuildID: 20090624025744)

Test Results

Target Bugs to Verify

  • Full List (~13 Total, fixed or verified by now)
  • bug 499169 - top crash [@ js_MonitorLoopEdge(JSContext*, unsigned int&)]
    • Status: Bob Clary (bc) is running some tests by loading URLs coming from the crash reports and making sure these URLs no longer crash the browser.
  • bug 496684 - some valid ogg files are rejected as invalid
    • Status: reopened This may not be a blocker now.
  • bug 498815 - crash in oggplay_data_handle_theora_frame
    • Status: verified
  • bug 498824 - Crash in Theora th_comment_clear
    • Status: verified
  • bug 498827 - Crash at _v_readstring at vorbis_info.c:54
    • Status: verified
  • bug 498853 - Crash in vorbis_comment_clear
    • Status: verified
  • bug 498855 - Crash in vorbis_synthesis
    • Status: verified
  • bug 497563 - Crashes [@ BindStatementURI]
    • Status: verified
  • bug 492390 - credits.xhtml update for 3.5 release
    • Status: reopened on trunk
  • bug 494026 - drag and drop a tab onto the new tab button in the toolbar does not duplicate tab
    • Status: reopened on trunk
  • ... see more in full list