Releases/Firefox 6/Test Plan

From MozillaWiki
Jump to: navigation, search

« mozilla-beta:fx6 | Firefox 6 | Firefox 7 »

Firefox 6 Test Plan

Tasks

The following tasks need to be completed to sign-off the release.

Spotchecks should be performed across all supported operating systems, including Mac OSX 10.7:

  • Windows 2000, XP, Vista, 7, 7 64bit
  • Mac OS X 10.5, 10.6, 10.7
  • Ubuntu 11.04, 11.04 64-bit

If you find any issues use [fx6] whiteboard entry of the bug to keep track.

Automation

The following are the detailed results of the automated BFT test runs.

Issues Found

Manual

The following are the detailed results of the manual smoketests.

  • [DONE] [Alin] Windows 2000: PASS
  • [DONE] [Mihaela] Windows XP: PASS
  • [DONE] [Simona] Windows Vista: PASS
  • [DONE] [Simona] Windows 7: PASS
  • [DONE] [AndreiD] Windows 7 64-bit: PASS
  • [DONE] [VladG] Mac OS X 10.6: PASS
  • [DONE] [VladG] Mac OS X 10.7: PASS
  • [DONE] [Virgil] Ubuntu 11.04: PASS
  • [DONE] [AndreiD] Ubuntu 11.04 32-bit: PASS
  • Litmus testrun, report
  • Firefox 6 builds
Issues Found
  • No issues were found
Exploratory Testing
  • Conduct exploratory tests on WebGL, Javascript, Flash, and QuickTime plugin content
  • Tested plugin content using the following testing matrix: testing matrix
    • [DONE] [Mihaela] Windows XP: PASS with known issues
    • [DONE] [Alin] Windows 7: PASS with NEW issues
    • [DONE] [VladG] Mac OS X 10.6: PASS with known issues
    • [DONE] [SimonaB] Windows Vista: PASS with known issues
    • [DONE] [Virgil] Ubuntu 11.04: PASS with known issues
New Issues Found
  • bug 678482 - Scrolling in web pages with java and shockwave scrambles the content

Feature sign-off

The following are the details about spotchecks performed on landed features

Issues Found

Bug Verifications

The following are the detailed results of bug fix verifications for Firefox 6.

Issues Found
  • [DONE] bug 677510 - Video Controls buttons "Mute/unmute" and "Expand/Shrink" are lacking icons on HTML5 videos
    • Issue has been fixed on YouTube's end
  • [DONE] bug 677095 - 1px background-image miss-handling when position is fixed
    • Issue will be rel-noted and fixed in Firefox 7
  • bug 675260 - Crash in arena_dalloc_small coming from ShutdownNSS
    • Not a priority for Firefox 6 -- If you have free cycles, we need help identifying builds affected and steps to reproduce

Updates

The following are details of update verifications for Firefox 6

Coverage
  • Platforms: Windows (2000, XP, Vista, 7, 7 64-bit), Mac OS X (10.6, 10.7), Ubuntu (11.04, 11.04 64-bit)
  • Updates: partial, complete, fallback
  • Locales: en-US, random
  • Versions: Firefox 4*, 5*, 6b*
  • Target Build: Firefox 6.0 (20110811165603)
Results

Betatest: report (l10n)

  • [DONE] Windows XP: SIGNED-OFF
  • [DONE] Windows Vista: SIGNED-OFF
  • [DONE] Windows 7: SIGNED-OFF
  • [DONE] Windows 7 64-bit: SIGNED-OFF
  • [DONE] Mac OS X 10.6: SIGNED-OFF
  • [DONE] Mac OS X 10.7: SIGNED-OFF
  • [DONE] Ubuntu 11.04: SIGNED-OFF
  • [DONE] Ubuntu 11.04 64-bit: SIGNED-OFF

Beta: report (l10n)

  • [DONE] Windows XP: SIGNED-OFF
  • [DONE] Windows Vista: SIGNED-OFF
  • [DONE] Windows 7: SIGNED-OFF
  • [DONE] Windows 7 64-bit: SIGNED-OFF
  • [DONE] Mac OS X 10.6: SIGNED-OFF
  • [DONE] Mac OS X 10.7: SIGNED-OFF
  • [DONE] Ubuntu 11.04: SIGNED-OFF
  • [DONE] Ubuntu 11.04 64-bit: SIGNED-OFF

Releasetest: report

  • [DONE] Windows XP: PASS
  • [DONE] Windows Vista: PASS
  • [DONE] Windows 7: PASS
  • [DONE] Windows 7 64-bit: PASS
  • [DONE] Mac OS X 10.6: PASS
  • [DONE] Mac OS X 10.7: PASS
  • [DONE] Ubuntu 11.04: PASS
  • [DONE] Ubuntu 11.04 64-bit: PASS

Release: report

  • [DONE] Windows XP: PASS
  • [DONE] Windows Vista: PASS
  • [DONE] Windows 7: PASS
  • [DONE] Windows 7 64-bit: PASS
  • [DONE] Mac OS X 10.6: PASS
  • [DONE] Mac OS X 10.7: PASS
  • [DONE] Ubuntu 11.04: PASS
  • [DONE] Ubuntu 11.04 64-bit: PASS
Issues Found