QA SoftVision Team/Firefox-6-release-testplan: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(19 intermediate revisions by 5 users not shown)
Line 1: Line 1:
== Overview ==  
== Overview ==  
* ''' The final goal is to decide whether we should release Firefox 6 or not '''
* ''' The final goal is to decide whether we should release Firefox 6 or not '''
=== Major issues list ===  
* ''' FINAL SIGN - OFF by Vlad '''
=== Major issues list ===
* none major
 
=== Unreproducible issues ===
=== Unreproducible issues ===
* none
=== Additional comments ===
=== Additional comments ===
* ''please add some comments if necessary''


== Tasks ==
== Tasks ==
Line 46: Line 52:
*** [https://bugzilla.mozilla.org/show_bug.cgi?id=657107 Bug 657107] - Unexpected event. Javascript timeouts seem to freeze
*** [https://bugzilla.mozilla.org/show_bug.cgi?id=657107 Bug 657107] - Unexpected event. Javascript timeouts seem to freeze
*** [https://bugzilla.mozilla.org/show_bug.cgi?id=644392 Bug 644392] - Flash ExternalInterface methods no longer accept JS arrays, only Strings (FF 4.0)
*** [https://bugzilla.mozilla.org/show_bug.cgi?id=644392 Bug 644392] - Flash ExternalInterface methods no longer accept JS arrays, only Strings (FF 4.0)
** Fixed Bug verification against Firefox 6 beta 5 [https://spreadsheets.google.com/spreadsheet/ccc?key=0AoWKqsW66shRdHI1aGdWaFVuWFR0cjI4Sl9MaUwyRHc&authkey=CMT0l7YF&hl=en_US#gid=56 http://bit.ly/qDdtrN]


* '''Florin(irc: Bebe)'''
* '''Florin(irc: Bebe)'''
Line 52: Line 59:
****Win7and Mac
****Win7and Mac
* '''Virgil (irc: VirgilDicu)'''
* '''Virgil (irc: VirgilDicu)'''
** running litmus guided tests - BFTs against win XP (the last third of the available BFTs-From Cookies to about:permissions)
** running litmus guided tests - BFTs against win XP
*** [http://bit.ly/nCGsM0 PASSED]
*** [http://bit.ly/nCGsM0 RESULTS]
 
* '''Alin (irc:AlinT)'''
** running litmus guided tests - BFTs against win XP
***[http://bit.ly/qws7Yt PASSED]
***[http://bit.ly/pC7GTS UNCLEAR]


* ''' Alex Lakatos (irc: AlexLakatos) '''
* ''' Alex Lakatos (irc: AlexLakatos) '''
Line 78: Line 80:
*** [http://bit.ly/qMBndm PASSED]
*** [http://bit.ly/qMBndm PASSED]
*** [https://litmus.mozilla.org/single_result.cgi?id=467407 UNCLEAR]
*** [https://litmus.mozilla.org/single_result.cgi?id=467407 UNCLEAR]
* '''Alin (irc:AlinT)'''
** running litmus guided tests - BFTs against win XP
***[http://bit.ly/qws7Yt PASSED]
***[http://bit.ly/pC7GTS UNCLEAR]


== Results ==
== Results ==
Line 95: Line 102:
| Henrik & Vlad
| Henrik & Vlad
| [https://wiki.mozilla.org/Features/Firefox/PlugincheckLinkInAOM PlugincheckLinkInAOM]
| [https://wiki.mozilla.org/Features/Firefox/PlugincheckLinkInAOM PlugincheckLinkInAOM]
| '''result'''
| '''SIGNED-OFF'''
|-
|-
| Tracy
| Tracy
| [https://wiki.mozilla.org/Firefox/Features/Sync_Discoverability Sync Discoverability]
| [https://wiki.mozilla.org/Firefox/Features/Sync_Discoverability Sync Discoverability]
| '''result'''
| '''SIGNED-OFF'''
|-
|-
| George
| George
Line 150: Line 157:
* [http://code.google.com/p/fbug/issues/detail?can=2&q=4730&colspec=ID%20Type%20Status%20Owner%20Test%20Summary&id=4730 Firebug and Web Console interaction issue]  
* [http://code.google.com/p/fbug/issues/detail?can=2&q=4730&colspec=ID%20Type%20Status%20Owner%20Test%20Summary&id=4730 Firebug and Web Console interaction issue]  
* [https://bugzilla.mozilla.org/show_bug.cgi?id=677518 Bug 677518]
* [https://bugzilla.mozilla.org/show_bug.cgi?id=677518 Bug 677518]
* [https://bugzilla.mozilla.org/show_bug.cgi?id=677889 Bug 677889]


=== Regression results ===  
=== Regression results ===  
Line 157: Line 165:
** [http://bit.ly/qMBndm PASSED]
** [http://bit.ly/qMBndm PASSED]
** [https://litmus.mozilla.org/single_result.cgi?id=467407 UNCLEAR]
** [https://litmus.mozilla.org/single_result.cgi?id=467407 UNCLEAR]
* '''Virgil (irc: VirgilDicu)'''
** [http://bit.ly/nCGsM0 RESULTS]
*'''Alin (irc: AlinT)'''
**[http://bit.ly/qws7Yt PASSED]
**[http://bit.ly/pC7GTS UNCLEAR]


=== Web Compatibility results ===  
=== Web Compatibility results ===  
Line 165: Line 180:


=== Plugins results ===
=== Plugins results ===
* include your name and results please
''Bebe''
 
PASSED
 
Run the plugin matrix across the Windows 7 and OX 10.7
 
No new issues found
[http://bit.ly/nNXmSF, Matrix]
 
=== Overall sign-off ===  
=== Overall sign-off ===  
{| class="fullwidth-table"
{| class="fullwidth-table"
Line 173: Line 196:
  | style="background:#EFEFEF; width:25%" | '''Plugins'''
  | style="background:#EFEFEF; width:25%" | '''Plugins'''
  |-
  |-
  | ''pass/fail ?''  
  | ''PASS''  
  | ''pass/fail ?''
  | ''PASS''
| ''PASS''
  | ''PASS''
  | ''PASS''
| ''pass/fail ?''
  |-
  |-
  | ''Signed-off by '' '''?'''
  | ''Signed-off by '' '''Vlad'''
  | ''Signed-off by '' '''?'''
  | ''Signed-off by '' '''Remus'''
  | ''Signed-off by '' '''Alex'''
  | ''Signed-off by '' '''Alex'''
  | ''Signed-off by '' '''?'''
  | ''Signed-off by '' '''Bebe'''
  |}
  |}

Latest revision as of 15:09, 12 August 2011

Overview

  • The final goal is to decide whether we should release Firefox 6 or not
  • FINAL SIGN - OFF by Vlad

Major issues list

  • none major

Unreproducible issues

  • none

Additional comments

  • please add some comments if necessary

Tasks

  • Our testing efforts will be divided into four major areas of checks
    • Owned Features
      • Signing off the owned features checked-in in Firefox 6. Perform the usual activities around them
    • Regression
      • Mostly running litmus guided tests - BFTs against win XP
    • Web Compatibility
      • Running Litmus WebApp Compatibility tests and checking top sites on alexa.com
    • Plugins
      • Use the plugin test matrix and run the tests - perform exploratory around those scenarios

Builds

Resources

  • Who works what?
    • (state your name)
      • (your assigned task. operating system, platform, etc)
  • Vlad Maniac (irc: vladmaniac)
  • George (irc: GeorgeCarstoiu)
    • Feature spot-checking and interaction
    • Bug Triage against QA Wanted
  • Vlad Ghetiu (irc: vladg)
    • Feature checks against RevampAboutMemory and Progress Element
    • Bug Triage against QA Wanted
      • The link of the query is here: http://bit.ly/qSvcyp
      • Bug 657107 - Unexpected event. Javascript timeouts seem to freeze
      • Bug 644392 - Flash ExternalInterface methods no longer accept JS arrays, only Strings (FF 4.0)
    • Fixed Bug verification against Firefox 6 beta 5 http://bit.ly/qDdtrN
  • Florin(irc: Bebe)
    • Plugins
      • Use the plugin test matrix and run the tests - perform exploratory around those scenarios
        • Win7and Mac
  • Virgil (irc: VirgilDicu)
    • running litmus guided tests - BFTs against win XP
  • Alex Lakatos (irc: AlexLakatos)
    • Feature checks against Scratchpad
    • WebApp Compatibility
      • Running Litmus tests
      • Spotchecks on Top Sites on alexa.com
  • Simona (irc: simonab)
    • Feature spot-checking and interaction
    • WebApp Compatibility
      • Running Litmus tests
      • Spotchecks on Top Sites on alexa.com
  • Remus (irc: RemusPop)
  • Alin (irc:AlinT)

Results

Feature sign-off

Owner Feature page Results
Andrei 50ms Assert Not a user facing feature. The dev team is taking the decision for the sign-off since it is a specific feature for product development
Henrik & Vlad PlugincheckLinkInAOM SIGNED-OFF
Tracy Sync Discoverability SIGNED-OFF
George Persist Panorama Groups SIGNED-OFF
George Panorama Groups On Demand SIGNED-OFF
George Site-based data management UI SIGNED-OFF
George windows-scrolling SIGNED-OFF See limitations in wiki-page.
Simona Locationbar Domain Highlight SIGNED-OFF
Simona WebDeveloper Menu SIGNED-OFF
VladG RevampAboutMemory SIGNED-OFF
VladG Progress Element SIGNED-OFF
Vlad Autocomplete Popup SIGNED-OFF
Vlad WebConsoleUpgrade SIGNED-OFF
Alex Scratchpad SIGNED-OFF

Filed Bugs against features

Regression results

  • include your name and results please

Web Compatibility results

  • ISSUES FOUND
    • Bug 677510 - Video Controls buttons "Mute/unmute" and "Expand/Shrink" are lacking icons on HTML5 videos

Plugins results

Bebe

PASSED

Run the plugin matrix across the Windows 7 and OX 10.7

No new issues found Matrix

Overall sign-off

Features Regression Web Compatibility Plugins
PASS PASS PASS PASS
Signed-off by Vlad Signed-off by Remus Signed-off by Alex Signed-off by Bebe
Retrieved from "https://wiki.mozilla.org/index.php?title=QA_SoftVision_Team/Firefox-6-release-testplan&oldid=339152"