Releases/Firefox 4b1/Test Plan

Firefox 4 Test Plan

Firefox 4 Beta 1 Testplan

Coordinating QA: juanb in irc.mozilla.org, jbecerra@mozilla.com. Or ping someone in #qa

Description of Release

This is the first beta version of Firefox 4. It will have the new theme work on Windows. Beta 1 will only be available in en-US.

Specific Plan Beta 1

We will run smoketests and BFTs using Mozmill, as well as manual smoketests. We'll also manually run areas of the BFT that focus on several areas listed in this page.

Schedule

We will run through Litmus smoketests, BFTs, and updates checks. We'll focus on features landed for beta 1 as well as some of the more prominent features that landed in alpha 5.

• Code Freeze: June 28
• Builds Start: June 28
• QA: June 28-July 2
  • Smoketests and BFTs using Mozmill: (1 person)
  • Manual smoketests, BFT areas, and Other OS Spot Checks: June 29-July 1 (4 people)
  • Testday: July 2 (3 people monitoring)
  • Accessibility: Before July 1 (1 person)
  • Top Sites Page Load Testing: Before July 1 (1 people)
  • Updates checks: June 29, 30 (1 person)
    • Manual spot checks as necessary

Builds

Builds for all beta 1 candidates can be found here:

http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b1-candidates/

Test Results

Build 1 (Current)

• Smoketests: result
• Basic Functional Tests (or BFTs): result
• Accessibility: result
• Top Sites Testing: result
• Top Add-ons: result
• Updates Checks: result
• Bugs Filed: crashers, blocking bugs, others

Focus Areas

• Theme work on Windows
• Firefox Menu
• Tab Stip
• Bookmarking
• Search
• Session Restore
• Undo close window/tab
• Form and password manager
• Profile migration
  • Scenarios where users start out with 3.6, try out 4.0b1, and go back

to 3.6

• • These scenarios with Testpilot and Feedback in mind
• Add-ons manager
• OOPP
• WebM
• Fullscreen
• d2d
• Personas
• Notifications (geo)
• Antivirus and firewall interactions