QA/Firefox3/TestResults/RC3

« QA/Firefox3/TestResults

Firefox 3 RC3 Test Results

This respin of RC3 is primarily focused on mac 10.5.3 users only. Windows and Linux builds will remain at RC2. For more details, see bug 436575.

Related Pages

Links to separate test results. Some are referenced further below.

Project Release Tracking Page

• Update snippets Test Results
• L10n Spotchecks Test Results
• RC2 Testday Results
• QA RC3 Relnotes Tracking

Contact Info

PM: Mike Beltzner (beltzner)
Build: John O'Duinn (joduinn)
QA: Tony (tchung)

Schedule

Code Freeze

Code Build

6/10

QA test signoff

ETA 6/11

• Smoketests result
• Update snippets from Alpha X, Beta X -> RC2 betatest, result releasetest, result, rc1,rc2->rc3 beta/release, result
• P1 L10N spotchecks result
• live tests result

Build Location and IDs

• ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/3.0rc3-candidates/build1/
• Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9) Gecko/2008061004 Firefox/3.0
• Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9) Gecko/2008061004 Firefox/3.0

*Note: Mac builds only. Windows and Linux are not affected.

Test Coverage

• Areas Covered:
  • Smoketests
    • Use test profiles stored here.
  • Focused Tests (primarily fix for bug 436575
  • Update snippets from Alpha X, Beta X, RC1, RC2 -> RC3 (mac only)
  • P1 L10N spotchecks (mac only)

• Areas Not Covered:
  • Windows and Linux platforms
  • BFT
  • FFT
  • Top plugins
  • Top Sites
  • Top Themes
  • Top Extensions
  • Accessibility Tests (litmus and automation)
  • Memory Leak Testing (handled by Tomcat on debug builds)
  • Bc's topsite spidertests against jemalloc/malloc builds
  • localization (String changes) - Localizers to cover
  • Distribution
  • Major Updates
  • RC3 Testday

Test Results

Types of Tests	Mac Tiger	Mac Leopard
Smoketest	Tomcat - PASS	Tomcat - PASS
Updates Testing	Tchung - Betatest result, Releasetest result, Beta result	Tomcat - Betatest result, Releasetest result, Beta result
l10N Pri 1 locales	Tchung - result	Timr - result
Live Checks & Download Links	Tchung - result	Tomcat - result

Updates Testing

We will be doing updates of Alpha and Beta users to RC3. We will be checking partial updates, complete updates, and failed status.

Will be available on betatest, releasetest, beta, and release (rc1 only) channels

• Betatest channel - result
• Releasetest channel - result
• Beta channel (live) - result
• Release channel (rc1 & rc2) - result

Testcases and Results are tracked here.

L10N P1 Spotchecks

Visual inspection: Go through the P1 list of locales, and run a spotcheck to see if everything visually looks fine. Refer to L10N Requirements for more specifics.

Testcases and Results are tracked here - result

Live Spot Checks

Check live site download links on all platforms. Please cover en-US, and 2 or 3 additional Tier 1 locales as well. Pay attention to the following areas:

• Check for signed installer and applications (windows only)
• Firstrun page, whatsnew page, Home page, Search plugin
• Install, uninstall
• General spotchecks and browser functionality
• Confirm Build IDs

OS assignments:

• Mac Tiger - Tchung - result
• Mac Leopard - Tomcat - result

Detailed Results

Smoketests (tomcat)

• Tomcat
  • 10.5.3 Leopard
    • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9) Gecko/2008061004 Firefox/3.0
    • Status : PASS - Results in Litmus

• • 10.4.11 Tiger
    • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9) Gecko/2008061004 Firefox/3.0
    • Status : PASS - Results in Litmus