Releases/Firefox 4b7/Test Plan: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(16 intermediate revisions by 2 users not shown)
Line 11: Line 11:
* Add-ons Manager
* Add-ons Manager
* Addition of Bing Search Engine and removal of answers and cc {{Bug|603298}}
* Addition of Bing Search Engine and removal of answers and cc {{Bug|603298}}
* Panorama
* Plugins
* JS
* And a ton of stuff that has been baking on trunk since the last beta.


== Specific Plan Beta 7 ==
== Specific Plan Beta 7 ==
We will run smoketests and BFTs using Mozmill, as well as manual smoketests. We'll also manually run areas of the BFT that focus on several areas listed in this page, while focusing on the changes for this release.
We will run smoketests and BFTs using Mozmill, and completement them with manual checks. We will focus on new bugs filed against the latest nightly, and we'll monitor crash-stats. For the past several weeks we have been testing continuously several areas of focus, and we've run BFTs on XP and Win7 (as of yesterday, 11/03).
 
We'll include a testday on Friday focusing on web compatibility testing that will include browsing popular sites and exercising their functionality.


== Schedule ==
== Schedule ==
We will run through Litmus smoketests, BFTs, and updates checks. We'll focus on features landed for Beta 7.
We will run through Litmus smoketests, BFTs, and updates checks. We'll focus on features landed for Beta 7. After a few weeks of churn and non-starts:


* Code Freeze: Sept 26
* Code Freeze: 11/04
* Builds Start: Sept 27
* Builds Start: 11/04
* QA: Aug 31 - Sept 27 - Oct 1 (estimate)
* QA: 11/04 - 11/09 (estimate)
** Smoketests and BFTs using Mozmill: (1 person)
** Smoketests and BFTs using Mozmill: (1 person)
** Manual smoketests, BFT areas, and Other OS Spot Checks: Sept 27 - Oct 1 (3 people)
** Manual smoketests, BFT areas, and Other OS Spot Checks: 11/04-11/09 (3 people)
** Testday: Oct 1 (3 people monitoring)
** Testday: 11/05 (3 people monitoring)
** Accessibility: Before Oct 1 (1 person)
** Accessibility: On-going (1 person)
** Top Sites Functionality and  Page Load Testing: Before Oct 1 (1 people)
** Top Sites Functionality and  Page Load Testing: Before 11/09 (1 people)
** Updates checks: Before Oct 1 (1 person)
** Updates checks: Before 11/09 (1 person)
*** Manual spot checks as necessary
*** Manual spot checks as necessary


Line 36: Line 42:
== Test Results ==
== Test Results ==
=== Build 1 (Current) ===
=== Build 1 (Current) ===
* [[Releases/Firefox 4b7/Test Plan:Smoketests | Smoketests and BFTs]]: '''in progress/completed'''
* [[Releases/Firefox 4b7/Test Plan:Smoketests | Smoketests and BFTs]]: '''Completed'''
* [[Releases/Firefox 4b7/Test Plan:Feature Area Testing | Feature Area Tests]]: '''in progress/completed'''
* [[Releases/Firefox 4b7/Test Plan:Feature Area Testing | Feature Area Tests]]: '''Completed'''
* [[Releases/Firefox 4b7/Test Plan:Updates | Updates Checks]] - ashughes: '''in progress/completed'''
* [[Releases/Firefox 4b7/Test Plan:Updates | Updates Checks]] - ashughes: '''in progress'''
* [[Releases/Firefox 4b7/Test Plan:l10n | l10n Spot Checks]]: '''in progress/completed'''
* [[Releases/Firefox 4b7/Test Plan:l10n | l10n Spot Checks]]: '''Completed'''
* [[Releases/Firefox 4b7/Test Plan:Accessibility | Accessibility]] - marco: '''in progress/completed'''
* [[Releases/Firefox 4b7/Test Plan:Accessibility | Accessibility]] - marco: '''in-progress/completed'''
* [[Releases/Firefox 4b7/Test Plan:Topsites | Top Sites Testing]]: '''in progress/completed'''
* [[Releases/Firefox 4b7/Test Plan:Topsites | Top Sites Testing]]: '''in progress/completed'''
* [[Releases/Firefox 4b7/Test Plan:Add-ons | Top Add-ons]] - unowned: '''in progress/completed'''
* [[Releases/Firefox 4b7/Test Plan:Add-ons | Top Add-ons]] - marcia: '''Completed'''
* [[Releases/Firefox 4b7/Test Plan:Testday | Testday]]: '''Completed'''
* [[Releases/Firefox 4b7/Test Plan:Testday | Testday]]: '''Completed''' - Held on 11/05
* [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=whiteboard%3A4b7 Bugs Filed]: '''crashers, blocking bugs, others'''
* [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=whiteboard%3A4b7 Bugs Filed]: '''crashers, blocking bugs, others'''
** Whiteboard entry '''[4b7]'''
** Whiteboard entry '''[4b7]'''
* [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=whiteboard%3ASept-03-Testday Bugs Filed During Testday]: '''crashers, blocking bugs, others'''
* [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=whiteboard%3ANov-05-Testday Bugs Filed During Testday]: '''crashers, blocking bugs, others'''
** Whiteboard entry on testday: [Oct-01-Testday]
** Whiteboard entry on testday: [Nov-05-Testday]


== Focus Areas ==
== Focus Areas ==
* Theme
See the feature area testing section.
* OpenGL
* Add-ons Manager
* ...

Latest revision as of 01:38, 10 November 2010

Firefox 4 Test Plan

Firefox 4 Beta 7 Testplan

Coordinating QA: juanb in irc.mozilla.org, jbecerra@mozilla.com. If not around, contact: mevans, mevans@mozilla.com; tchung, tchung@mozilla.com. Or ping someone in #qa

Description of Release

This is the latest beta version of Firefox 4. Some of the more notable changes include revisions in:

  • Theme
  • OpenGL
  • Add-ons Manager
  • Addition of Bing Search Engine and removal of answers and cc bug 603298
  • Panorama
  • Plugins
  • JS
  • And a ton of stuff that has been baking on trunk since the last beta.

Specific Plan Beta 7

We will run smoketests and BFTs using Mozmill, and completement them with manual checks. We will focus on new bugs filed against the latest nightly, and we'll monitor crash-stats. For the past several weeks we have been testing continuously several areas of focus, and we've run BFTs on XP and Win7 (as of yesterday, 11/03).

We'll include a testday on Friday focusing on web compatibility testing that will include browsing popular sites and exercising their functionality.

Schedule

We will run through Litmus smoketests, BFTs, and updates checks. We'll focus on features landed for Beta 7. After a few weeks of churn and non-starts:

  • Code Freeze: 11/04
  • Builds Start: 11/04
  • QA: 11/04 - 11/09 (estimate)
    • Smoketests and BFTs using Mozmill: (1 person)
    • Manual smoketests, BFT areas, and Other OS Spot Checks: 11/04-11/09 (3 people)
    • Testday: 11/05 (3 people monitoring)
    • Accessibility: On-going (1 person)
    • Top Sites Functionality and Page Load Testing: Before 11/09 (1 people)
    • Updates checks: Before 11/09 (1 person)
      • Manual spot checks as necessary

Builds

Builds for all beta 7 candidates can be found here:

ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b7-candidates/

Test Results

Build 1 (Current)

Focus Areas

See the feature area testing section.

Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_4b7/Test_Plan&oldid=266814"