Releases/Firefox 4b7/Test Plan: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(3 intermediate revisions by the same user not shown)
Line 44: Line 44:
* [[Releases/Firefox 4b7/Test Plan:Smoketests | Smoketests and BFTs]]: '''Completed'''
* [[Releases/Firefox 4b7/Test Plan:Smoketests | Smoketests and BFTs]]: '''Completed'''
* [[Releases/Firefox 4b7/Test Plan:Feature Area Testing | Feature Area Tests]]: '''Completed'''
* [[Releases/Firefox 4b7/Test Plan:Feature Area Testing | Feature Area Tests]]: '''Completed'''
* [[Releases/Firefox 4b7/Test Plan:Updates | Updates Checks]] - ashughes: '''in progress/completed'''
* [[Releases/Firefox 4b7/Test Plan:Updates | Updates Checks]] - ashughes: '''in progress'''
* [[Releases/Firefox 4b7/Test Plan:l10n | l10n Spot Checks]]: '''in progress/completed'''
* [[Releases/Firefox 4b7/Test Plan:l10n | l10n Spot Checks]]: '''Completed'''
* [[Releases/Firefox 4b7/Test Plan:Accessibility | Accessibility]] - marco: '''on-going'''
* [[Releases/Firefox 4b7/Test Plan:Accessibility | Accessibility]] - marco: '''in-progress/completed'''
* [[Releases/Firefox 4b7/Test Plan:Topsites | Top Sites Testing]]: '''in progress/completed'''
* [[Releases/Firefox 4b7/Test Plan:Topsites | Top Sites Testing]]: '''in progress/completed'''
* [[Releases/Firefox 4b7/Test Plan:Add-ons | Top Add-ons]] - marcia: '''Completed'''
* [[Releases/Firefox 4b7/Test Plan:Add-ons | Top Add-ons]] - marcia: '''Completed'''
Line 52: Line 52:
* [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=whiteboard%3A4b7 Bugs Filed]: '''crashers, blocking bugs, others'''
* [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=whiteboard%3A4b7 Bugs Filed]: '''crashers, blocking bugs, others'''
** Whiteboard entry '''[4b7]'''
** Whiteboard entry '''[4b7]'''
** Note: We didn't find and mark many bugs with the above entry, because we usually use it during the time we test build candidates. This time we tested trunk nightlies on which it was based, and we only had a little a few days with the release candidates.
* [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=whiteboard%3ANov-05-Testday Bugs Filed During Testday]: '''crashers, blocking bugs, others'''
* [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=whiteboard%3ANov-05-Testday Bugs Filed During Testday]: '''crashers, blocking bugs, others'''
** Whiteboard entry on testday: [Nov-05-Testday]
** Whiteboard entry on testday: [Nov-05-Testday]


== Focus Areas ==
== Focus Areas ==
* Theme
See the feature area testing section.
* OpenGL
* Add-ons Manager
* ...

Latest revision as of 01:38, 10 November 2010

Firefox 4 Test Plan

Firefox 4 Beta 7 Testplan

Coordinating QA: juanb in irc.mozilla.org, jbecerra@mozilla.com. If not around, contact: mevans, mevans@mozilla.com; tchung, tchung@mozilla.com. Or ping someone in #qa

Description of Release

This is the latest beta version of Firefox 4. Some of the more notable changes include revisions in:

  • Theme
  • OpenGL
  • Add-ons Manager
  • Addition of Bing Search Engine and removal of answers and cc bug 603298
  • Panorama
  • Plugins
  • JS
  • And a ton of stuff that has been baking on trunk since the last beta.

Specific Plan Beta 7

We will run smoketests and BFTs using Mozmill, and completement them with manual checks. We will focus on new bugs filed against the latest nightly, and we'll monitor crash-stats. For the past several weeks we have been testing continuously several areas of focus, and we've run BFTs on XP and Win7 (as of yesterday, 11/03).

We'll include a testday on Friday focusing on web compatibility testing that will include browsing popular sites and exercising their functionality.

Schedule

We will run through Litmus smoketests, BFTs, and updates checks. We'll focus on features landed for Beta 7. After a few weeks of churn and non-starts:

  • Code Freeze: 11/04
  • Builds Start: 11/04
  • QA: 11/04 - 11/09 (estimate)
    • Smoketests and BFTs using Mozmill: (1 person)
    • Manual smoketests, BFT areas, and Other OS Spot Checks: 11/04-11/09 (3 people)
    • Testday: 11/05 (3 people monitoring)
    • Accessibility: On-going (1 person)
    • Top Sites Functionality and Page Load Testing: Before 11/09 (1 people)
    • Updates checks: Before 11/09 (1 person)
      • Manual spot checks as necessary

Builds

Builds for all beta 7 candidates can be found here:

ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b7-candidates/

Test Results

Build 1 (Current)

Focus Areas

See the feature area testing section.