QA SoftVision Team/Firefox-6-release-testplan

Overview

• The final goal is to decide whether we should release Firefox 6 or not

Tasks

• Our testing efforts will be divided into four major areas of checks
  • Owned Features
    • Signing off the owned features checked-in in Firefox 6. Perform the usual activities around them
  • Regression
    • Mostly running litmus guided tests - BFTs against win XP
  • Web Compatibility
    • Running Litmus WebApp Compatibility tests and checking top sites on alexa.com
  • Plugins
    • Use the plugin test matrix and run the tests - perform exploratory around those scenarios

• (qa-wanted bugs - please provide the query)
  • Bug 676318 - priority #1

Builds

• 6.0b5 candidates

Resources

• Who works what?
  • (state your name)
    • (your assigned task. operating system, platform, etc)

• Vlad Maniac (irc: vladmaniac)
  • Feature checks against Web Console and Web Console Autocomplete Popup
    • Run both summary tests and guided ones against Ubuntu 11.04 and Win 7
    • Feature test plan
    • Test scenarios
    • Logged Bug 677518
  • Planning, gathering and verifying results

• George (irc: GeorgeCarstoiu)
  • Feature spot-checking and interaction
  • Bug Triage against QA Wanted
    • The link of the query is here: http://bit.ly/qSvcyp

• Vlad Ghetiu (irc: vladg)
  • Feature checks against RevampAboutMemory and Progress Element
  • Bug Triage against QA Wanted
    • The link of the query is here: http://bit.ly/qSvcyp
    • Bug 657107 - Unexpected event. Javascript timeouts seem to freeze
    • Bug 644392 - Flash ExternalInterface methods no longer accept JS arrays, only Strings (FF 4.0)

• Florin(irc: Bebe)
  • Plugins
    • Use the plugin test matrix and run the tests - perform exploratory around those scenarios
      • Win7and Mac
• Virgil (irc: VirgilDicu)
  • running litmus guided tests - BFTs against win XP (the last third of the available BFTs-From Cookies to about:permissions)
    • PASSED

• Alin (irc:AlinT)
  • running litmus guided tests - BFTs against win XP
    • PASSED
    • UNCLEAR

• Alex Lakatos (irc: AlexLakatos)
  • Feature checks against Scratchpad
    • Run both spreadsheet tests and guided ones against Ubuntu 11.04
    • Feature test plan
  • WebApp Compatibility
    • Running Litmus tests
    • Spotchecks on Top Sites on alexa.com

• Simona (irc: simonab)
  • Feature spot-checking and interaction
  • WebApp Compatibility
    • Running Litmus tests
    • Spotchecks on Top Sites on alexa.com

• Remus (irc: RemusPop)
  • running litmus guided tests - BFTs against win XP
    • PASSED
    • UNCLEAR

Results

Feature sign-off

Owner	Feature page	Results
Andrei	50ms Assert	Not a user facing feature. The dev team is taking the decision for the sign-off since it is a specific feature for product development
Henrik & Vlad	PlugincheckLinkInAOM	result
Tracy	Sync Discoverability	result
George	Persist Panorama Groups	SIGNED-OFF
George	Panorama Groups On Demand	SIGNED-OFF
George	Site-based data management UI	SIGNED-OFF
George	windows-scrolling	SIGNED-OFF See limitations in wiki-page.
Simona	Locationbar Domain Highlight	SIGNED-OFF
Simona	WebDeveloper Menu	SIGNED-OFF
VladG	RevampAboutMemory	SIGNED-OFF
VladG	Progress Element	SIGNED-OFF
Vlad	Autocomplete Popup	SIGNED-OFF
Vlad	WebConsoleUpgrade	SIGNED-OFF
Alex	Scratchpad	SIGNED-OFF

Filed Bugs against features

• Firebug and Web Console interaction issue
• Bug 677518

Regression results

• include your name and results please

• Remus (irc: RemusPop)
  • PASSED
  • UNCLEAR

Web Compatibility results

• ISSUES FOUND
  • Bug 677510 - Video Controls buttons "Mute/unmute" and "Expand/Shrink" are lacking icons on HTML5 videos

• LITMUS RESULTS

Plugins results

• include your name and results please

Overall sign-off

Features	Regression	Web Compatibility	Plugins
pass/fail ?	pass/fail ?	PASS	pass/fail ?
Signed-off by ?	Signed-off by ?	Signed-off by Alex	Signed-off by ?