QA/Firefox3/TestResults/M11: Difference between revisions
| Line 117: | Line 117: | ||
=== Updates Testing === | === Updates Testing === | ||
For b3, we will be doing updates of all Alpha and Beta 1 users to Beta 3. Tests will include different locales for beta 1, but only en-US for all past versions. We will be checking partial updates, complete updates, and failed status. | For b3, we will be doing updates of all Alpha and Beta 1 users to Beta 3. Tests will include different locales for beta 1, but only en-US for all past versions. We will be checking partial updates, complete updates, and failed status. | ||
Will be available on ''betatest'', ''releasetest'', and ''beta'' channels | Will be available on ''betatest'', ''releasetest'', and ''beta'' channels | ||
| Line 127: | Line 125: | ||
Testcases and Results are tracked [http://wiki.mozilla.org/QA/Firefox3/TestResults/M11/Updates here]. | Testcases and Results are tracked [http://wiki.mozilla.org/QA/Firefox3/TestResults/M11/Updates here]. | ||
We will also do a special round of major update testing from Fx2-> Fx3 trial run. Testplan is held [http://wiki.mozilla.org/QA/Firefox3/TestPlan/MajorUpdate here]. | |||
* Major Update - '''result''' | |||
=== L10N P1 Spotchecks === | === L10N P1 Spotchecks === | ||
Revision as of 21:46, 14 January 2008
Firefox 3 M11 Test Results
Related Pages
Most of these pages are linked below in this document.
- Extensions Test Results
- Update snippets Test Results
- L10n Spotchecks Test Results
- Accessibility Test Results
- Beta 2 Testday Results
Contact Info
Build: John O'Duinn (joduinn)
QA: Tony (tchung)
Schedule
- Code Freeze
- 1/22
- Code Complete
- Code Build
- QA test signoff
Release Notes
Build Location and IDs
Strategy
- Areas Covered:
- Smoketests
- BFTs
- M11 and past focused Tests
- Supported Plugins
- Top Websites
- Major Updates (Fx2 -> Fx3 trial run)
- Memory Leak Testing (handled by Tomcat on debug builds)
- P1 L10N spotchecks
- M11 bug verifications
- Beta 3 Testday
- Areas Not Covered:
- FFTs
- localization (String changes) - 3rd party will cover
- Distribution
Test Results
| Types of Tests | Win XP | Win Vista | Mac Tiger | Mac Leopard | Linux |
|---|---|---|---|---|---|
| Smoketest | Tomcat - result | Tomcat - result | Tchung - result | Marcia - result | Tomcat - result |
| BFT | Tomcat (running leak tests) - result | Tomcat (running leak tests) - result | Tracy - result | Marcia - result | Tomcat (running leak tests) - result |
| Top Websites Testing (see below) | Juanb - result | N/A | Juanb - result | N/A | Tracy - result |
| Updates Testing (see below) | Tomcat - result | Marcia - result | Tomcat - result | Marcia - result | Tchung - result |
| l10N Pri 1 locales | Tomcat/Tracy (nl, fi, it) - result - Tomcat (de, pa-IN) result | N/A | Tchung (ja-JP, es-ES, pa-IN, zh-CN) - result | N/A | Tracy (fr, zh-CN) - result |
| Bug Verifications | Everyone - result | Everyone - result | Everyone - result | Everyone - result | Everyone - result |
Top Extensions Testing
Select a few top extensions from this list and run tests to install/update/uninstall/disable extensions. Available for download at AMO.
Or, refer to this list: Most-Used Addons
Testcases:
- Enabling extensions and confirming web compatibility
- Disabling or Uninstalling extensions and confirming proper messaging and behavior
- Load about 10+ extensions, and fire them up all at once, verifying functionality and performance
- Updating old extension versions to the latest if applicable
- Switch profiles with different extensions, and confirm they do not get carried over.
Extensions Test Results - result
Updates Testing
For b3, we will be doing updates of all Alpha and Beta 1 users to Beta 3. Tests will include different locales for beta 1, but only en-US for all past versions. We will be checking partial updates, complete updates, and failed status.
Will be available on betatest, releasetest, and beta channels
- Betatest channel - result
- Releasetest channel - result
- Beta channel (live) - result
Testcases and Results are tracked here.
We will also do a special round of major update testing from Fx2-> Fx3 trial run. Testplan is held here.
- Major Update - result
L10N P1 Spotchecks
Visual inspection: Go through the P1 list of locales, and run a spotcheck to see if everything visually looks fine. Refer to L10N Requirements for more specifics.
Automation inspection: supported locales will be ran through Minotaur, and results will be reviewed by axel and mic.
Axel's Localization Status Page
P1 Locales to be tested:
- UPDATE - not ready
English (en-GB) result - French (fr) result
- Chinese (zh-CN) result
- German (de) result
- Japanese (ja) result
- Spanish (es-ES) result
- Netherlands (nl) result
- Italian (it) result
- Finnish (fi) result
- Indian (pa-IN) result
Testcases and Results are tracked here.
Bug Verifications
Bugs that are marked RESOLVED FIXED that are checked in for beta. Please verify them.
Testday
A beta 2 testday will be held and call for the community support to assist with testing. Activities include executing litmus testcases, bug verifications, and focus on the new feature areas that are being implemented. More can be found at the QMO post.
Testday results are posted here.
Detailed Results
Tomcats Results
Live Spot Checks for M10
Live site downloads for M11, after bits are pushed out. This includes verifying websites and release notes.
- Windows XP -> abillings - Result
- Windows Vista -> Tomcat - Result
- Mac PPC/Intel-> tchung - Result
- Mac Leopard -> Marcia - Result
- Linux -> stephend - Result