QA/Firefox3/TestResults/M11

« QA/Firefox3/TestResults

Firefox 3 M11 Test Results

Related Pages

Most of these pages are linked below in this document.

• Extensions Test Results
• Update snippets Test Results
• L10n Spotchecks Test Results
• Accessibility Test Results
• Beta 2 Testday Results

Contact Info

Build: John O'Duinn (joduinn)
QA: Tony (tchung)

Schedule

Code Freeze

1/22

Code Complete

Code Build

QA test signoff

Strategy

• Areas Covered:
  • Smoketests
  • BFTs
  • M11 and past focused Tests
  • Supported Plugins
  • Top Websites
  • Major Updates (Fx2 -> Fx3 trial run)
  • Memory Leak Testing (handled by Tomcat on debug builds)
  • P1 L10N spotchecks
  • M11 bug verifications
  • Beta 3 Testday

• Areas Not Covered:
  • FFTs
  • localization (String changes) - 3rd party will cover
  • Distribution

Test Results

Types of Tests	Win XP	Win Vista	Mac Tiger	Mac Leopard	Linux
Smoketest	Tomcat - result	Tomcat - result	Tchung - result	Marcia - result	Tomcat - result
BFT	Tomcat (running leak tests) - result	Tomcat (running leak tests) - result	Tracy - result	Marcia - result	Tomcat (running leak tests) - result
Top Websites Testing (see below)	Juanb - result	N/A	Juanb - result	N/A	Tracy - result
Updates Testing (see below)	Tomcat - result	Marcia - result	Tomcat - result	Marcia - result	Tchung - result
l10N Pri 1 locales	Tomcat/Tracy (nl, fi, it) - result - Tomcat (de, pa-IN) result	N/A	Tchung (ja-JP, es-ES, pa-IN, zh-CN) - result	N/A	Tracy (fr, zh-CN) - result
Bug Verifications	Everyone - result	Everyone - result	Everyone - result	Everyone - result	Everyone - result

Top Extensions Testing

Select a few top extensions from this list and run tests to install/update/uninstall/disable extensions. Available for download at AMO.

Or, refer to this list: Most-Used Addons

Testcases:

• Enabling extensions and confirming web compatibility
• Disabling or Uninstalling extensions and confirming proper messaging and behavior
• Load about 10+ extensions, and fire them up all at once, verifying functionality and performance
• Updating old extension versions to the latest if applicable
• Switch profiles with different extensions, and confirm they do not get carried over.

Extensions Test Results - result

Updates Testing

For b3, we will be doing updates of all Alpha and Beta 1 users to Beta 3. Tests will include different locales for beta 1, but only en-US for all past versions. We will be checking partial updates, complete updates, and failed status.

We will also do a special round of major update testing from Fx2-> Fx3 trial run. Testplan is held here.

Will be available on betatest, releasetest, and beta channels

• Betatest channel - result
• Releasetest channel - result
• Beta channel (live) - result

Testcases and Results are tracked here.

L10N P1 Spotchecks

Visual inspection: Go through the P1 list of locales, and run a spotcheck to see if everything visually looks fine. Refer to L10N Requirements for more specifics.

Automation inspection: supported locales will be ran through Minotaur, and results will be reviewed by axel and mic.

Axel's Localization Status Page

P1 Locales to be tested:

• UPDATE - not ready English (en-GB) result
• French (fr) result
• Chinese (zh-CN) result
• German (de) result
• Japanese (ja) result
• Spanish (es-ES) result
• Netherlands (nl) result
• Italian (it) result
• Finnish (fi) result
• Indian (pa-IN) result

Testcases and Results are tracked here.

Bug Verifications

Bugs that are marked RESOLVED FIXED that are checked in for beta. Please verify them.

Testday

A beta 2 testday will be held and call for the community support to assist with testing. Activities include executing litmus testcases, bug verifications, and focus on the new feature areas that are being implemented. More can be found at the QMO post.

Testday results are posted here.

Live Spot Checks for M10

Live site downloads for M11, after bits are pushed out. This includes verifying websites and release notes.

• Windows XP -> abillings - Result
• Windows Vista -> Tomcat - Result
• Mac PPC/Intel-> tchung - Result
• Mac Leopard -> Marcia - Result
• Linux -> stephend - Result