PluginUpdating:Test Plan: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(42 intermediate revisions by one other user not shown)
Line 8: Line 8:


Page URLs: <br>[1] [https://www.trunk.stage.mozilla.com/en-US/firefox/2.0.0.7/firstrun/ First Run]<br>
Page URLs: <br>[1] [https://www.trunk.stage.mozilla.com/en-US/firefox/2.0.0.7/firstrun/ First Run]<br>
[2] [https://www.trunk.stage.mozilla.com/en-US/firefox/plugincheck/ Plugin Check]
[2] [https://www.trunk.stage.mozilla.com/en-US/firefox/plugincheck/ Plugin Check]<br>
[3] "Updated" page: to be filed by Alex Polvi later


== Browser Testing Matrix ==
== Browser Testing Matrix ==
Line 14: Line 15:
<table style="text-align: left; width: 100%;" border="1" cellpadding="2"
<table style="text-align: left; width: 100%;" border="1" cellpadding="2"
cellspacing="2">
cellspacing="2">
<tbody>
<tr>
<tr>
<td style="vertical-align: top;"><br>
<td
style="vertical-align: top; color: rgb(255, 255, 255); background-color: rgb(0, 51, 102);"><br>
</td>
</td>
<td style="vertical-align: top;">Windows XP SP 2<br>
<td
style="vertical-align: top; background-color: rgb(0, 51, 102); color: rgb(255, 255, 255);"><span
style="font-weight: bold;">Windows XP SP 2</span><br>
</td>
</td>
<td style="vertical-align: top;">Windows Vista<br>
<td
style="vertical-align: top; background-color: rgb(0, 51, 102); color: rgb(255, 255, 255);"><span
style="font-weight: bold;">Windows Vista</span><br>
</td>
</td>
<td style="vertical-align: top;">Mac OS X 10.4<br>
<td
style="vertical-align: top; background-color: rgb(0, 51, 102); color: rgb(255, 255, 255); font-weight: bold;">Mac
OS X 10.4<br>
</td>
</td>
<td style="vertical-align: top;">Linux<br>
<td
style="vertical-align: top; background-color: rgb(0, 51, 102); color: rgb(255, 255, 255); font-weight: bold;">Linux<br>
</td>
</td>
</tr>
</tr>
<tr>
<tr>
<td style="vertical-align: top;">Firefox &lt; = 2.0.0.7<br>
<td
style="vertical-align: top; color: rgb(255, 255, 255); background-color: rgb(0, 51, 102);"><span
style="font-weight: bold;">Firefox &lt; = 2.0.0.7</span><br>
</td>
</td>
<td style="vertical-align: top;"><br>
<td style="vertical-align: top;"><br>
Line 40: Line 50:
</tr>
</tr>
<tr>
<tr>
<td style="vertical-align: top;">Firefox &lt; = 1.5.0.13<br>
<td
style="vertical-align: top; color: rgb(255, 255, 255); background-color: rgb(0, 51, 102);"><br>
</td>
<td style="vertical-align: top;">Flash &gt; = 9.0r47 (green)<br>
</td>
<td style="vertical-align: top;">Flash &gt; = 9.0r47 (green)</td>
<td style="vertical-align: top;">Flash &gt; = 9.0r47 (green)</td>
<td style="vertical-align: top;">Flash&nbsp; &gt; = 9.0r48
(green) </td>
</tr>
<tr>
<td
style="vertical-align: top; color: rgb(255, 255, 255); background-color: rgb(0, 51, 102);"><br>
</td>
<td style="vertical-align: top;">Flash &lt; 9.0r47 (red) </td>
<td style="vertical-align: top;">Flash &lt; 9.0r47 (red)<br>
</td>
<td style="vertical-align: top;">Flash &lt; 9.0r47 (red)<br>
</td>
<td style="vertical-align: top;">Flash &lt; = 9.0r47 (red)</td>
</tr>
<tr>
<td
style="vertical-align: top; color: rgb(255, 255, 255); background-color: rgb(0, 51, 102);"><br>
</td>
<td style="vertical-align: top;">Java 1.5.0_07 (green)<br>
</td>
<td style="vertical-align: top;">Java 1.5.0_07 (green)<br>
</td>
<td style="vertical-align: top;">Java 1.5.0_07 (green)<br>
</td>
<td style="vertical-align: top;">Java 1.5.0_07 (green)<br>
</td>
</tr>
<tr>
<td
style="vertical-align: top; color: rgb(255, 255, 255); background-color: rgb(0, 51, 102);"><br>
</td>
<td style="vertical-align: top;">Java &lt; 1.5.0_07 (red)<br>
</td>
<td style="vertical-align: top;">Java &lt; 1.5.0_07 (red)<br>
</td>
<td style="vertical-align: top;">Java &lt; 1.5.0_07 (red)<br>
</td>
<td style="vertical-align: top;">Java &lt; 1.5.0_07 (red)<br>
</td>
</tr>
<tr>
<td
style="vertical-align: top; color: rgb(255, 255, 255); background-color: rgb(0, 51, 102);"><br>
</td>
</td>
<td style="vertical-align: top;"><br>
<td style="vertical-align: top;">QuickTime &gt; = 7.2.0 (green)<br>
</td>
<td style="vertical-align: top;">QuickTime &gt; = 7.2.0 (green)</td>
<td style="vertical-align: top;">QuickTime &gt; = 7.2.0 (green)<br>
</td>
<td style="vertical-align: top;">N/A<br>
</td>
</tr>
<tr>
<td
style="vertical-align: top; color: rgb(255, 255, 255); background-color: rgb(0, 51, 102);"><br>
</td>
<td style="vertical-align: top;">QuickTime &lt; 7.2.0 (red)<br>
</td>
</td>
<td style="vertical-align: top;"><br>
<td style="vertical-align: top;">QuickTime &lt; 7.2.0 (red)<br>
</td>
</td>
<td style="vertical-align: top;"><br>
<td style="vertical-align: top;">QuickTime &lt; 7.2.0 (red)<br>
</td>
</td>
<td style="vertical-align: top;"><br>
<td style="vertical-align: top;">N/A<br>
</td>
</td>
</tr>
</tr>
</tbody>
</table>
</table>


Line 58: Line 128:
== JavaScript enabled (default) ==
== JavaScript enabled (default) ==


1. In a new profile/install, run Firefox 1.5.0.13 with the vulnerable plugins (Java, Flash, QuickTime).
1. In a new profile/install, run Firefox 2.0.0.7 with the various combinations of the vulnerable plugins (Java, Flash, QuickTime).
2. In a new profile/install, run Firefox 2.0.0.7 with the vulnerable plugins (Java, Flash, QuickTime).
* Verify that on the first run page there is a message indicating that some plugins are 'vulnerable.'  Click the provided link.
* In the resulting page, ensure that the buttons for the vulnerable plugin are red, and that the "safe" plugin buttons are green.
** Clicking on both the red and green buttons should always take you to the plugin vendor's download or verification page, which is loaded in a new tab.
2. In a migrated 2.0.0.6 -> 2.0.0.7 install, run with the various combinations of the vulnerable plugins (Java, Flash, QuickTime).
* Verify that '''XXX - TBD'''
* In the resulting page, ensure that the buttons for the vulnerable plugin are red, and that the "safe" plugin buttons are green.
** Clicking on both the red and green buttons should always take you to the plugin vendor's download or verification page, which is loaded in a new tab.


== JavaScript disabled ==
== JavaScript disabled ==
For the [https://www.trunk.stage.mozilla.com/en-US/firefox/plugincheck/ Plugin Check] page with JavaScript disabled, verify we display: This page requires JavaScript to work correctly. [https://addons.mozilla.org/en-US/firefox/browse/type:7 Find more information on plugins.]


== Test Results ==
== Test Results ==


{| class="fullwidth-table"
<table style="text-align: left; width: 100%;" border="1" cellpadding="2"
!
cellspacing="2">
! Windows XP SP2
<tr>
! Windows Vista
<td
! Mac
style="vertical-align: top; color: rgb(255, 255, 255); background-color: rgb(0, 51, 102);"><br>
! Linux
</td>
|-
<td
| Firefox < = 2.0.0.7
style="vertical-align: top; background-color: rgb(0, 51, 102); color: rgb(255, 255, 255);"><span
| P1
style="font-weight: bold;">Windows XP SP 2</span><br>
 
</td>
| P1
<td
 
style="vertical-align: top; background-color: rgb(0, 51, 102); color: rgb(255, 255, 255);"><span
| P1
style="font-weight: bold;">Windows Vista</span><br>
| P1
</td>
|-
<td
|-
style="vertical-align: top; background-color: rgb(0, 51, 102); color: rgb(255, 255, 255); font-weight: bold;">Mac
|}
OS X 10.4<br>
</td>
<td
style="vertical-align: top; background-color: rgb(0, 51, 102); color: rgb(255, 255, 255); font-weight: bold;">Linux<br>
</td>
</tr>
<tr>
<td
style="vertical-align: top; color: rgb(255, 255, 255); background-color: rgb(0, 51, 102);"><span
style="font-weight: bold;">Firefox &lt; = 2.0.0.7</span><br>
</td>
<td style="vertical-align: top;"><br>
</td>
<td style="vertical-align: top;"><br>
</td>
<td style="vertical-align: top;"><br>
</td>
<td style="vertical-align: top;"><br>
</td>
</tr>
<tr>
<td
style="vertical-align: top; color: rgb(255, 255, 255); background-color: rgb(0, 51, 102);"><br>
</td>
<td style="vertical-align: top;">Flash &gt; = 9.0r47 (green) '''PASS'''<br>
</td>
<td style="vertical-align: top;">Flash &gt; = 9.0r47 (green) '''PASS'''</td>
<td style="vertical-align: top;">Flash &gt; = 9.0r47 (green) '''PASS'''</td>
<td style="vertical-align: top;">Flash&nbsp; &gt; = 9.0r48
(green) '''PASS''' </td>
</tr>
<tr>
<td
style="vertical-align: top; color: rgb(255, 255, 255); background-color: rgb(0, 51, 102);"><br>
</td>
<td style="vertical-align: top;">Flash &lt; 9.0r47 (red) '''PASS (9.0r45)''' </td>
<td style="vertical-align: top;">Flash &lt; 9.0r47 (red) '''PASS (6.0r65)'''<br>
</td>
<td style="vertical-align: top;">Flash &lt; 9.0r47 (red) '''PASS (7.0r24)'''<br>
</td>
<td style="vertical-align: top;">Flash &lt; = 9.0r47 (red)</td>
</tr>
<tr>
<td
style="vertical-align: top; color: rgb(255, 255, 255); background-color: rgb(0, 51, 102);"><br>
</td>
<td style="vertical-align: top;">Java 1.5.0_07 (green) '''PASS'''<br>
</td>
<td style="vertical-align: top;">Java 1.5.0_07 (green) '''PASS'''<br>
</td>
<td style="vertical-align: top;">Java 1.5.0_07 (green) '''FAIL (0.9.6.2 passes when it shouldn't--or do we map its equivalent?)'''<br>
</td>
<td style="vertical-align: top;">Java 1.5.0_07 (green)<br>
</td>
</tr>
<tr>
<td
style="vertical-align: top; color: rgb(255, 255, 255); background-color: rgb(0, 51, 102);"><br>
</td>
<td style="vertical-align: top;">Java &lt; 1.5.0_07 (red) '''PASS (1.5.0_04)'''<br>
</td>
<td style="vertical-align: top;">Java &lt; 1.5.0_07 (red) '''PASS'''<br>
</td>
<td style="vertical-align: top;">Java &lt; 1.5.0_07 (red)<br>
</td>
<td style="vertical-align: top;">Java &lt; 1.5.0_07 (red)<br>
</td>
</tr>
<tr>
<td
style="vertical-align: top; color: rgb(255, 255, 255); background-color: rgb(0, 51, 102);"><br>
</td>
<td style="vertical-align: top;">QuickTime &gt; = 7.2.0 (green) '''PASS'''<br>
</td>
<td style="vertical-align: top;">QuickTime &gt; = 7.2.0 (green) '''PASS'''</td>
<td style="vertical-align: top;">QuickTime &gt; = 7.2.0 (green) '''PASS'''<br>
</td>
<td style="vertical-align: top;">N/A<br>
</td>
</tr>
<tr>
<td
style="vertical-align: top; color: rgb(255, 255, 255); background-color: rgb(0, 51, 102);"><br>
</td>
<td style="vertical-align: top;">QuickTime &lt; 7.2.0 (red) '''FAIL (7.1)'''<br>
</td>
<td style="vertical-align: top;">QuickTime &lt; 7.2.0 (red)<br>
</td>
<td style="vertical-align: top;">QuickTime &lt; 7.2.0 (red) '''FAIL (7.1)'''<br>
</td>
<td style="vertical-align: top;">N/A<br>
</td>
</tr>
</table>


== Detailed Test Results ==
== Detailed Test Results ==
Line 91: Line 262:
Mac - '''.'''
Mac - '''.'''


Linux - '''.'''
Linux - '''Pass'''

Latest revision as of 08:15, 28 November 2014

Description of Release

See http://wiki.mozilla.org/PluginUpdating

Implementation bug: https://bugzilla.mozilla.org/show_bug.cgi?id=391433

Change Set in this Release

Page URLs:
[1] First Run
[2] Plugin Check
[3] "Updated" page: to be filed by Alex Polvi later

Browser Testing Matrix


 Windows XP SP 2
 Windows Vista
 Mac

OS X 10.4

 Linux
Firefox < = 2.0.0.7




Flash > = 9.0r47 (green)
 Flash > = 9.0r47 (green) Flash > = 9.0r47 (green) Flash  > = 9.0r48 (green)

Flash < 9.0r47 (red) Flash < 9.0r47 (red)
 Flash < 9.0r47 (red)
 Flash < = 9.0r47 (red)

Java 1.5.0_07 (green)
 Java 1.5.0_07 (green)
 Java 1.5.0_07 (green)
 Java 1.5.0_07 (green)

Java < 1.5.0_07 (red)
 Java < 1.5.0_07 (red)
 Java < 1.5.0_07 (red)
 Java < 1.5.0_07 (red)

QuickTime > = 7.2.0 (green)
 QuickTime > = 7.2.0 (green) QuickTime > = 7.2.0 (green)
 N/A

QuickTime < 7.2.0 (red)
 QuickTime < 7.2.0 (red)
 QuickTime < 7.2.0 (red)
 N/A

Test Cases

JavaScript enabled (default)

1. In a new profile/install, run Firefox 2.0.0.7 with the various combinations of the vulnerable plugins (Java, Flash, QuickTime).

  • Verify that on the first run page there is a message indicating that some plugins are 'vulnerable.' Click the provided link.
  • In the resulting page, ensure that the buttons for the vulnerable plugin are red, and that the "safe" plugin buttons are green.
    • Clicking on both the red and green buttons should always take you to the plugin vendor's download or verification page, which is loaded in a new tab.

2. In a migrated 2.0.0.6 -> 2.0.0.7 install, run with the various combinations of the vulnerable plugins (Java, Flash, QuickTime).

  • Verify that XXX - TBD
  • In the resulting page, ensure that the buttons for the vulnerable plugin are red, and that the "safe" plugin buttons are green.
    • Clicking on both the red and green buttons should always take you to the plugin vendor's download or verification page, which is loaded in a new tab.

JavaScript disabled

For the Plugin Check page with JavaScript disabled, verify we display: This page requires JavaScript to work correctly. Find more information on plugins.

Test Results


 Windows XP SP 2
 Windows Vista
 Mac

OS X 10.4

 Linux
Firefox < = 2.0.0.7




Flash > = 9.0r47 (green) PASS
 Flash > = 9.0r47 (green) PASS Flash > = 9.0r47 (green) PASS Flash  > = 9.0r48 (green) PASS

Flash < 9.0r47 (red) PASS (9.0r45) Flash < 9.0r47 (red) PASS (6.0r65)
 Flash < 9.0r47 (red) PASS (7.0r24)
 Flash < = 9.0r47 (red)

Java 1.5.0_07 (green) PASS
 Java 1.5.0_07 (green) PASS
 Java 1.5.0_07 (green) FAIL (0.9.6.2 passes when it shouldn't--or do we map its equivalent?)
 Java 1.5.0_07 (green)

Java < 1.5.0_07 (red) PASS (1.5.0_04)
 Java < 1.5.0_07 (red) PASS
 Java < 1.5.0_07 (red)
 Java < 1.5.0_07 (red)

QuickTime > = 7.2.0 (green) PASS
 QuickTime > = 7.2.0 (green) PASS QuickTime > = 7.2.0 (green) PASS
 N/A

QuickTime < 7.2.0 (red) FAIL (7.1)
 QuickTime < 7.2.0 (red)
 QuickTime < 7.2.0 (red) FAIL (7.1)
 N/A

Detailed Test Results

Windows XP SP 2 - .

Vista - .

Mac - .

Linux - Pass

Retrieved from "https://wiki.mozilla.org/index.php?title=PluginUpdating:Test_Plan&oldid=1037587"