Releases/Firefox 4b7/Test Plan
Contents
Firefox 4 Beta 7 Testplan
Coordinating QA: juanb in irc.mozilla.org, jbecerra@mozilla.com. If not around, contact: mevans, mevans@mozilla.com; tchung, tchung@mozilla.com. Or ping someone in #qa
Description of Release
This is the latest beta version of Firefox 4. Some of the more notable changes include revisions in:
- Theme
- OpenGL
- Add-ons Manager
- Addition of Bing Search Engine and removal of answers and cc bug 603298
- Panorama
- Plugins
- JS
- And a ton of stuff that has been baking on trunk since the last beta.
Specific Plan Beta 7
We will run smoketests and BFTs using Mozmill, and completement them with manual checks. We will focus on new bugs filed against the latest nightly, and we'll monitor crash-stats. For the past several weeks we have been testing continuously several areas of focus, and we've run BFTs on XP and Win7 (as of yesterday, 11/03).
We'll include a testday on Friday focusing on web compatibility testing that will include browsing popular sites and exercising their functionality.
Schedule
We will run through Litmus smoketests, BFTs, and updates checks. We'll focus on features landed for Beta 7. After a few weeks of churn and non-starts:
- Code Freeze: 11/04
- Builds Start: 11/04
- QA: 11/04 - 11/09 (estimate)
- Smoketests and BFTs using Mozmill: (1 person)
- Manual smoketests, BFT areas, and Other OS Spot Checks: 11/04-11/09 (3 people)
- Testday: 11/05 (3 people monitoring)
- Accessibility: On-going (1 person)
- Top Sites Functionality and Page Load Testing: Before 11/09 (1 people)
- Updates checks: Before 11/09 (1 person)
- Manual spot checks as necessary
Builds
Builds for all beta 7 candidates can be found here:
ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b7-candidates/
Test Results
Build 1 (Current)
- Smoketests and BFTs: Completed
- Feature Area Tests: Completed
- Updates Checks - ashughes: in progress
- l10n Spot Checks: Completed
- Accessibility - marco: in-progress/completed
- Top Sites Testing: in progress/completed
- Top Add-ons - marcia: Completed
- Testday: Completed - Held on 11/05
- Bugs Filed: crashers, blocking bugs, others
- Whiteboard entry [4b7]
- Bugs Filed During Testday: crashers, blocking bugs, others
- Whiteboard entry on testday: [Nov-05-Testday]
Focus Areas
See the feature area testing section.
