Releases/Firefox 4b4/Test Plan

Firefox 4 Test Plan

Firefox 4 Beta 4 Testplan

Coordinating QA: juanb in irc.mozilla.org, jbecerra@mozilla.com. If not around, contact: mevans, mevans@mozilla.com; tchung, tchung@mozilla.com. Or ping someone in #qa

Description of Release

This is the second beta version of Firefox 4. Some of the more notable changes include:

• Tabs-on-top on Mac
• App-tabs
• Add-ons manager UI post-install confirmation/notification
• CSS transitions
• Retained Layers

Specific Plan Beta 4

We will run smoketests and BFTs using Mozmill, as well as manual smoketests. We'll also manually run areas of the BFT that focus on several areas listed in this page, while focusing on the changes for this release.

Schedule

We will run through Litmus smoketests, BFTs, and updates checks. We'll focus on features landed for Beta 4.

• Code Freeze: Aug 16
• Builds Start: Aug 17
• QA: Aug 17 - Sept 2 (estimate)
  • Smoketests and BFTs using Mozmill: (1 person)
  • Manual smoketests, BFT areas, and Other OS Spot Checks: Aug 17-20 (3 people)
  • Testday: Aug 13, Aug 20(?) (3 people monitoring)
  • Accessibility: Sept 2 (1 person)
  • Top Sites Functionality and Page Load Testing: Before Sept 2 (1 people)
  • Updates checks: Before Aug 20 (1 person)
    • Manual spot checks as necessary

Builds

Builds for all beta 4 candidates can be found here:

ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b4-candidates/

Test Results

Build 1 (Current)

• Smoketests and BFTs: in progress/completed
• Feature Area Tests: in progress/completed
• Updates Checks - ashughes: in progress/completed
• Accessibility - marco: in progress/completed
• Top Sites Testing: in progress/completed
• Top Add-ons - unowned: in progress/completed
• Testday: Completed
• Bugs Filed: crashers, blocking bugs, others
  • Whiteboard entry [4b4]
• Bugs Filed During Testday: crashers, blocking bugs, others
  • Whiteboard entry on testday: [Aug-13-Testday]

Focus Areas

• Firefox Sync
• Tabbed Browsing
  • Tab Candy
  • App Tabs
  • History
  • Session Store
  • Interaction with Feedback add-on
• Toolbar Customization
• Add-ons Manager
• Personas (Lightweight Themes)
• Fullscreen
  • Interactions with Tab Candy and Personas
• OOPP
  • Crash reporting on Mac