Firefox:Download Page:Test Plan

From MozillaWiki
Jump to: navigation, search

Download Page Test Plan

Description of Release

Marketing wants to increase retention of Firefox downloads, and in order to accomplish this, they have redesigned the "Mozilla Download" pages on the three major platforms: Windows, Mac, and Linux. It is important that users of other browsers--especially IE, Safari, and Opera--are able to successfully:
1) See the custom-tailored, redirect page that lets them know how to download and install Firefox.
2) Download Firefox both with and without JavaScript enabled.

Bugs fixed:

Bug 392362 - Download link on front page does not redirect for Safari and IE
Bug 393265 - Download links on mozilla.com cause problems for Safari 2.0.x on OSX

See http://wiki.mozilla.org/User:Clouserw/DownloadProposal for more information.

Specific Test Plan for this Release

QA will run each browser listed on the "Browser Testing Matrix," below, on the platforms noted, with a careful eye not only for functionality of the webpages, but also their appearance, ensuring that the copy is grammatically correct (once per platform, since the pages served are the same).

Results will be reported in the Test Results section, below, and its report will be the chief deciding factor on whether to push live.

Test this with JavaScript enabled (default setting for all browsers):
1. With the default settings for the particular browser, visit "Download Firefox" URL (https://www.trunk.stage.mozilla.com/en-US/).
2. Click on the "Download Firefox - Free" green button.
3. Ensure that it:

  • Redirects you to a page specific to your operating system, with screenshots appropriate for the given OS, as well as all instructions. Check spelling and grammar of said page.
  • Pops up an "Opening Firefox 2.0.0.6[file extension]" dialog, which allows you to save the binary/package to disk.
4. If the above doesn't work--no auto-propogated downloads dialog comes up--(THIS SHOULD WORK; REPORT THIS IF IT DOESN'T, BUT...) verify that clicking on the link" portion in
"Your download will begin shortly... If your download does not start after a few seconds, use this link."
spawns the "Opening Firefox 2.0.0.6[file extension]" with the latest appropriate build of Firefox for your operating system.

5. Otherwise, verify that it saves successfully, and you can run the installer without errors (you don't have to install).

Test this with JavaScript disabled on only the P1 browsers:
1. Disable JavaScript for your particular browser.
2. Visit the specific "Download Firefox" URL (https://www.trunk.stage.mozilla.com/en-US/) for which OS you signed up.
3. Click on the "Firefox for [specific OS]" link.
4. Verify that the "Opening Firefox 2.0.0.6[file extension]" dialog appears, which allows you to save the binary/package to disk.
5. Verify that it saves successfully, and you can run the installer without errors (you don't have to install).

Browser Testing Matrix

Windows XP SP2 Windows Vista Mac Linux
Firefox 1.5.12 + 2.0.0.6 P1 P1 P1 P1
Internet Explorer 7 P1 P1 N/A N/A
Internet Explorer 6 P1 N/A N/A N/A
Opera 9 P2 P2 P2 P2
Safari 2.0.4 P1 P1 P1 N/A
Flock 0.9 P2 P2 P2 P2

Schedule

Test Results

Make sure to include both "JS-enabled" and "JS-disabled" results in the "Detailed Test Results." section

Windows XP SP2 (stephend) Windows Vista (stephend) Mac (juanb) Linux (ashughes)
Firefox 1.5.x, 2.0.x PASS PASS PASS PASS
see detailed results
Internet Explorer 7 PASS (certificate error) PASS (certificate error) N/A N/A
Internet Explorer 6 PASS (certificate error) N/A N/A N/A
Opera 9 PASS PASS PASS* PASS
see detailed results
Safari 2.0.4 / 3.0 beta FAIL* 3.0 FAIL* 3.0 PASS* N/A
Flock 0.9 PASS PASS PASS* FAIL
see detailed results

Detailed Test Results

Bugs/issues found:

Bug 394364 - Missing certificate for *.mozilla.com subdomains
Bug 394368 - Linux "thanks for downloading" firefox page still shows old messenger bag
Bug 394366 - "Other Languages" link goes to raw 2.0.0.6 FTP directory Bug 394370 - Opera's download.html page doesn't have screenshots specific to Opera

Windows XP SP2

  • Internet Explorer 7, XP SP2, stephend, FAIL (I set security to "High," since it seems impossible to disable JavaScript).
  • Flock 0.9.2, XP SP2, stephend, PASS, both JS enabled and disabled
  • Opera 9.23, XP SP2, stephend, PASS, both JS enabled and disabled
    • Screenshots aren't specific to Opera
  • Firefox 2.0.0.6, XP SP2, stephend, PASS, both JS enabled and disabled
  • Firefox 1.5.0.12, XP SP2, stephend, PASS, both JS enabled and disabled
  • Safari 3.0 beta, XP SP2, stephend, FAIL - "Safari can’t open the page “https://www.trunk.stage.mozilla.com/” because it couldn’t establish a secure connection to the server “www.trunk.stage.mozilla.com”."

Vista

  • Internet Explorer 7, Vista, stephend, PASS (I set security to "High," since it seems impossible to disable JavaScript).
  • Flock 0.9.2, Vista, stephend, PASS, both JS enabled and disabled
  • Opera 9.23, Vista, stephend, PASS, both JS enabled and disabled
    • Screenshots aren't specific to Opera
  • Firefox 2.0.0.6, Vista, stephend, PASS, both JS enabled and disabled
  • Firefox 1.5.0.12, Vista, stephend, PASS, both JS enabled and disabled
  • Safari 3.0 beta, Vista, stephend, FAIL - "Safari can’t open the page “https://www.trunk.stage.mozilla.com/” because it couldn’t establish a secure connection to the server “www.trunk.stage.mozilla.com”."

Mac

  • Fx 15012, 2006, Javascript/No Javascript, juanb: PASS
  • Opera 9.23, Javascript, juanb: PASS*
    • Steps 1 has an image of a download dialog in Safari, as opposed to Opera. Stephend filing bug.
  • Opera 9.23, No Javascript, juanb: PASS
  • Safari 2.0.4, Javascript, juanb: PASS
  • Safari 2.0.4, No Javascript, juanb: PASS*
    • I saw a certificate mismatch dialog come up, and if this is no problem for the real page, then the only other issues are cosmetic (Other Languages link takes you to an ftp download page). Stephend filing bugs.
  • Flock 0.9.0.2, Javascrip/No Javascript, juanb: PASS

Linux

NOTE: Please see bug 394368 for details.

Firefox

  • Firefox 2.0.0.6 (Ubuntu Package) - Build: 2007073113 - Javascript: ON - Result: PASS
  • Firefox 2.0.0.6 (Ubuntu Package) - Build: 2007073113 - Javascript: OFF - Result: PASS
  • Firefox 2.0.0.6 - Build: 2007072517 - Javascript: ON - Result: PASS
  • Firefox 2.0.0.6 - Build: 2007072517 - Javascript: ON - Result: PASS
  • Firefox 2.0.0.6 - Build: 2007072517 - Javascript: OFF - Result: PASS
  • Firefox 2.0.0.5 - Build: 2007071317 - Javascript: ON - Result: PASS
  • Firefox 2.0.0.5 - Build: 2007071317 - Javascript: OFF - Result: PASS
  • Firefox 2.0.0.4 - Build: 2007051502 - Javascript: ON - Result: PASS
  • Firefox 2.0.0.4 - Build: 2007051502 - Javascript: OFF - Result: PASS
  • Firefox 2.0.0.3 - Build: 2007030916 - Javascript: ON - Result: PASS
  • Firefox 2.0.0.3 - Build: 2007030916 - Javascript: OFF - Result: PASS
  • Firefox 2.0.0.2 - Build: 2007022001 - Javascript: ON - Result: PASS
  • Firefox 2.0.0.2 - Build: 2007022001 - Javascript: OFF - Result: PASS
  • Firefox 2.0.0.1 - Build: 2006120814 - Javascript: ON - Result: PASS
  • Firefox 2.0.0.1 - Build: 2006120814 - Javascript: OFF - Result: PASS
  • Firefox 2.0 - Build: 2006101022 - Javascript: ON - Result: PASS
  • Firefox 2.0 - Build: 2006101022 - Javascript: OFF - Result: PASS
  • Firefox 1.5.0.12 - Build: 2007050813 - Javascript: ON - Result: PASS
  • Firefox 1.5.0.12 - Build: 2007050813 - Javascript: OFF - Result: PASS
  • Firefox 1.5 - Build: 2005111116 - Javascript: ON - Result: PASS
  • Firefox 1.5 - Build: 2005111116 - Javascript: OFF - Result: PASS

Opera

  • Version: 9.23 - Javascript: ON - Result: PASS
  • Version: 9.23 - Javascript: OFF - Result: PASS

Flock

  • Version: 0.9.0.2
    • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.6) Gecko/1185930370.13883 Firefox/2.0.0.6 Flock/0.9.0.2
    • Javascript: ON - Result: PASS
    • Javascript: OFF - Result: PASS
Retrieved from "https://wiki.mozilla.org/index.php?title=Firefox:Download_Page:Test_Plan&oldid=67284"