« QA/Firefox3/TestResults

Firefox 3 RC3 Test Results

This respin of RC3 is primarily focused on mac 10.5.3 users only. Windows and Linux builds will remain at RC2. For more details, see bug 436575.

Related Pages

Links to separate test results. Some are referenced further below.

Project Release Tracking Page

• Update snippets Test Results
• L10n Spotchecks Test Results
• RC2 Testday Results
• QA RC3 Relnotes Tracking

Contact Info

PM: Mike Beltzner (beltzner)
Build: John O'Duinn (joduinn)
QA: Tony (tchung)

Schedule

Code Freeze

Code Build

6/10

QA test signoff

ETA 6/11

• Mac Smoketests PASS
• Update snippets from Alpha X, Beta X -> RC2 betatest, PASS releasetest, PASS, rc1,rc2->rc3 beta/release, PASS
• P1 L10N spotchecks PASS
• live tests PASS

Build Location and IDs

• ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/3.0rc3-candidates/build1/
• Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9) Gecko/2008061004 Firefox/3.0
• Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9) Gecko/2008061004 Firefox/3.0

*Note: Mac builds only. Windows and Linux are not affected.

Test Coverage

• Areas Covered:
  • Smoketests
    • Use test profiles stored here.
  • Focused Tests (primarily fix for bug 436575
  • Update snippets from Alpha X, Beta X, RC1, RC2 -> RC3 (mac only)
  • P1 L10N spotchecks (mac only)

• Areas Not Covered:
  • Windows and Linux platforms
  • BFT
  • FFT
  • Top plugins
  • Top Sites
  • Top Themes
  • Top Extensions
  • Accessibility Tests (litmus and automation)
  • Memory Leak Testing (handled by Tomcat on debug builds)
  • Bc's topsite spidertests against jemalloc/malloc builds
  • localization (String changes) - Localizers to cover
  • Distribution
  • Major Updates
  • RC3 Testday

Test Results

Updates Testing

We will be doing updates of Alpha and Beta users to RC3. We will be checking partial updates, complete updates, and failed status.

Will be available on betatest, releasetest, beta, and release (RC's only) channels

• Betatest channel - PASS
• Releasetest channel - PASS
• Beta channel (live) - PASS
• Release channel (rc1 & rc2) - PASS

Testcases and Results are tracked here. - PASS

L10N P1 Spotchecks

Visual inspection: Go through the P1 list of locales, and run a spotcheck to see if everything visually looks fine. Refer to L10N Requirements for more specifics.

Testcases and Results are tracked here - PASS

Live Spot Checks

Check live site download links on all platforms. Please cover en-US, and 2 or 3 additional Tier 1 locales as well. Pay attention to the following areas:

• Check for signed installer and applications (windows only)
• Firstrun page, whatsnew page, Home page, Search plugin
• Install, uninstall
• General spotchecks and browser functionality
• Confirm Build IDs

OS assignments:

• Mac Tiger - Tomcat - PASS
• Mac Leopard - Tchung - PASS
• Linux/Windows Checks - Tchung pass

Detailed Results

Smoketests (tomcat)

• Tomcat
  • 10.5.3 Leopard
    • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9) Gecko/2008061004 Firefox/3.0
    • Status : PASS - Results in Litmus

• • 10.4.11 Tiger
    • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9) Gecko/2008061004 Firefox/3.0
    • Status : PASS - Results in Litmus

L10n Testing

• Tchung
  • PASS. no issues found.