QA/Execution/Web Testing/PluginCheck: Difference between revisions

 
(27 intermediate revisions by 2 users not shown)
Line 1: Line 1:
==Overview==
==Overview==
* Main implementation bug: [https://bugzilla.mozilla.org/show_bug.cgi?id=522585 bug 522585]
* Project homepage: https://wiki.mozilla.org/Plugins:PluginCheck/CrossBrowserRelease (slightly outdated, but still useful)


This release primarily supports multiple browsers.
==Bug Lists==
* [https://bugzilla.mozilla.org/buglist.cgi?classification=Other&query_format=advanced&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&component=plugins.mozilla.org&product=Websites Open bugs]
* [https://bugzilla.mozilla.org/buglist.cgi?resolution=FIXED&classification=Other&query_format=advanced&bug_status=RESOLVED&component=plugins.mozilla.org&product=Websites fixed bugs] -- note that this list includes PFS and Plugin Directory bugs, too, and is mainly for code updates
** Once we have Firefox.com in production, we should talk about re-organizing the Bugzilla workflow to be clearer which bugs are specifically for Plugin Check


==Found a Bug?==
==Found a Bug?==
Line 9: Line 12:
Thanks!
Thanks!


==Timeline/Milestones==
==QA/Dev Process==
* Testing starts: 3/12/2010
* Tentative ship date: 3/18/2010


==Open Bugs==
# Dev fixes a bug/finishes a page by marking as "resolved fixed", adds the "qawanted" keyword
* [http://tinyurl.com/yjqyo2a open bugs]
# QA checks,approves by adding the comment "qa-verified-trunk" and removes qawanted keyword, if not QA re-opens bug and also removes qawanted keyword.
 
# '''If the bug is ready to be pushed to production''', anyone can add "push-needed" keyword. '''If the bug is waiting on a particular launch date, don't add this'''
==Fixed Bugs to Verify==
# Dev pushes to production by leaving comment with revision number, removes "push-needed" keyword from bugs that have them
* [http://tinyurl.com/yzrnoxm fixed bugs]
# QA checks on production, marks "verified fixed"
 
==Staging Server==
* [https://www-trunk.stage.mozilla.com https://www-trunk.stage.mozilla.com]


==Supported Browsers==
==Supported Browsers==
* Internet Explorer 8
* Internet Explorer 8, 9 (when it comes out from beta)
* Chrome on Windows, Mac and Windows
* Chrome on Windows, Mac (latest version)
* Opera on Windows, Mac
* Opera on Windows, Mac (latest version)
* Firefox 3.0, 3.5, 3.6
* Firefox 3.0, 3.5, 3.6, 4.0
* Safari 4
* Safari 5 on Mac, Windows


==Supported Plugins==
==Supported Plugins==
* Adobe Flash
*Adobe Flash
* Microsoft Silverlight
* Divx Web Player
* Java Embedding Plugin
* Acrobat Reader
*MoveNetworks Quantum Media Player ( used for videos on ESPN360.com and other major video streaming websites)
*Adobe Reader Plugin
*Adobe Reader Plugin
*Microsoft Silverlight
*Divx Web Player
*Java Embedding Plugin
*Acrobat Reader
*MoveNetworks Quantum Media Player (used for videos on ESPN360.com and other major video streaming websites)
*Quicktime
*Quicktime
*BrowserPlus Plugin
*BrowserPlus Plugin
==Positive Test Cases==
1. Load https://www-trunk.stage.mozilla.com/plugincheck with any of the above supported browsers, using the most recent version of each supported plugin<br>
2. Verify that those plugins have their version # in their "Status", and have a green "Up-to-Date" button, which links to their homepage
1. Load https://www-trunk.stage.mozilla.com/plugincheck with the supported browsers, but with an *outdated* version of the plugin (oldversion.com is a great resource for Win32.)<br>
2. Verify that we detect the plugin as out-of-date, list its "Status" as "Outdated Version", and have a yellow "Update" button that links to its homepage
1. Load https://www-trunk.stage.mozilla.com/plugincheck with the supported browsers, but with a vulnerable version of the plugin (oldversion.com is a great resource for Win32.)<br>
2. Verify that we detect the plugins as vulnerable, and link the user, via an orange "! Update Now" button, to the plugin vendor's homepage
1. Load https://www-trunk.stage.mozilla.com/plugincheck with the supported browsers, but with an unknown plugin<br>
2. Verify that we detect the plugin as "Unknown Plugin" in its "Status", and link the user, via a Google search (e.g. http://www.google.com/search?q=current%20version%20plugin%20iTunes%20Application%20Detector) for that plugin
==Staging Server==
* [https://www-trunk.stage.mozilla.com https://www-trunk.stage.mozilla.com]


==Links to Useful Resources==
==Links to Useful Resources==
* [http://www.oldversion.com Oldversion.com] to download old versions of  Windows plug-ins
* [http://www.oldversion.com Oldversion.com] to download old versions of  Windows plug-ins
* [http://kb2.adobe.com/cps/142/tn_14266.html Adobe's archived Flash versions page]
* [http://ozten.com/random/perfidies/debug.html Austin's perfidies debug page]
* [http://ozten.com/random/perfidies/debug.html Austin's perfidies debug page]
==Positive Test Cases==
1. Load https://www-trunk.stage.mozilla.com/plugincheck with any of the above supported browsers, using the most recent version of each supported plugin<br>
2. Verify that those plugins are recognized as being up-to-date (green button)
1. Load https://www-trunk.stage.mozilla.com/plugincheck with the supported browsers, but with outdated version of plugins (oldversion.com is a great resource for Win32.)
2. Verify that we detect the plugins as out-of-date, and link the user, via a red button, to the plugin vendor's homepage


==Negative Test Cases==
==Negative Test Cases==

Latest revision as of 18:57, 8 March 2011

Overview

Bug Lists

  • Open bugs
  • fixed bugs -- note that this list includes PFS and Plugin Directory bugs, too, and is mainly for code updates
    • Once we have Firefox.com in production, we should talk about re-organizing the Bugzilla workflow to be clearer which bugs are specifically for Plugin Check

Found a Bug?

  • Help us, please! File in the "websites" component, product: plugins.mozilla.org, and in the whiteboard field, enter "0.6.0" (without the quotes).

Thanks!

QA/Dev Process

  1. Dev fixes a bug/finishes a page by marking as "resolved fixed", adds the "qawanted" keyword
  2. QA checks,approves by adding the comment "qa-verified-trunk" and removes qawanted keyword, if not QA re-opens bug and also removes qawanted keyword.
  3. If the bug is ready to be pushed to production, anyone can add "push-needed" keyword. If the bug is waiting on a particular launch date, don't add this
  4. Dev pushes to production by leaving comment with revision number, removes "push-needed" keyword from bugs that have them
  5. QA checks on production, marks "verified fixed"

Supported Browsers

  • Internet Explorer 8, 9 (when it comes out from beta)
  • Chrome on Windows, Mac (latest version)
  • Opera on Windows, Mac (latest version)
  • Firefox 3.0, 3.5, 3.6, 4.0
  • Safari 5 on Mac, Windows

Supported Plugins

  • Adobe Flash
  • Adobe Reader Plugin
  • Microsoft Silverlight
  • Divx Web Player
  • Java Embedding Plugin
  • Acrobat Reader
  • MoveNetworks Quantum Media Player (used for videos on ESPN360.com and other major video streaming websites)
  • Quicktime
  • BrowserPlus Plugin

Positive Test Cases

1. Load https://www-trunk.stage.mozilla.com/plugincheck with any of the above supported browsers, using the most recent version of each supported plugin
2. Verify that those plugins have their version # in their "Status", and have a green "Up-to-Date" button, which links to their homepage

1. Load https://www-trunk.stage.mozilla.com/plugincheck with the supported browsers, but with an *outdated* version of the plugin (oldversion.com is a great resource for Win32.)
2. Verify that we detect the plugin as out-of-date, list its "Status" as "Outdated Version", and have a yellow "Update" button that links to its homepage

1. Load https://www-trunk.stage.mozilla.com/plugincheck with the supported browsers, but with a vulnerable version of the plugin (oldversion.com is a great resource for Win32.)
2. Verify that we detect the plugins as vulnerable, and link the user, via an orange "! Update Now" button, to the plugin vendor's homepage

1. Load https://www-trunk.stage.mozilla.com/plugincheck with the supported browsers, but with an unknown plugin
2. Verify that we detect the plugin as "Unknown Plugin" in its "Status", and link the user, via a Google search (e.g. http://www.google.com/search?q=current%20version%20plugin%20iTunes%20Application%20Detector) for that plugin

Staging Server

Links to Useful Resources

Negative Test Cases