Releases/Firefox 4b1/Test Plan

Firefox 4 Beta 1 Testplan

Coordinating QA: juanb in irc.mozilla.org, jbecerra@mozilla.com. Or ping someone in #qa

Description of Release

This is the first beta version of Firefox 4. It will have the new theme work on Windows. Localized builds of Beta 1 will not ship this release.

Specific Plan Beta 1

We will run smoketests and BFTs using Mozmill, as well as manual smoketests. We'll also manually run areas of the BFT that focus on several areas listed in this page.

Schedule

We will run through Litmus smoketests, BFTs, and updates checks. We'll focus on features landed for beta 1 as well as some of the more prominent features that landed in alpha 5.

Code Freeze: June 28
Builds Start: June 28
QA: June 28-July 2
- Smoketests and BFTs using Mozmill: (1 person)
- Manual smoketests, BFT areas, and Other OS Spot Checks: June 29-July 1 (4 people)
- Testday: July 2 (3 people monitoring)
- Accessibility: Before July 1 (1 person)
- Top Sites Page Load Testing: Before July 1 (1 people)
- Updates checks: June 29, 30 (1 person)
  - Manual spot checks as necessary

Builds

Builds for all beta 1 candidates can be found here:

http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b1-candidates/

Test Results

Build 1 (Current)

Smoketests: result
Basic Functional Tests (or BFTs): result
Accessibility: result
Top Sites Testing: result
Top Add-ons: result
Updates Checks: result
Bugs Filed: crashers, blocking bugs, others

Focus Areas

Theme work on Windows
Firefox Menu
Tab Stip
Bookmarking
Search
Session Restore
Undo close window/tab
Form and password manager
Profile migration
- Scenarios where users start out with 3.6, try out 4.0b1, and go back to 3.6
- These scenarios with Testpilot and Feedback in mind
Add-ons manager
OOPP
WebM
Fullscreen
d2d
Personas
Notifications (geo)
Antivirus and firewall interactions