MozillaWiki

Firefox:Download Page:Test Plan: Difference between revisions

Page Discussion

Firefox:Download Page:Test Plan (view source)

Revision as of 20:54, 27 August 2007

1,067 bytes removed ,  27 August 2007
New page: == Download Page Test Plan == == Description of Release == The build team has been working to generate builds via automation. This automation remove...
(New page: == Download Page Test Plan == == Description of Release == The build team has been working to generate builds via automation. This automation remove...)
Line 3: Line 3:
== Description of Release ==
== Description of Release ==


Marketing wants to increase retention of Firefox downloads, and in order to accomplish this, they have resigned the "Mozilla Download" pages on the three major platforms: Windows, Mac, and Linux. It is important that users of other browsers--especially IE, Safari, and Opera--are able to successfully:<br>
The build team has been working to generate builds via automation. This automation removes the necessity of human intervention during a normal build process. This is the first time that this has been done but this process will be used for the 2.0.0.7 release.
1) See the custom-tailored, redirect page that lets them know how to download and install Firefox.<br>
2) Download Firefox both with and without JavaScript enabled.


See http://wiki.mozilla.org/User:Clouserw/DownloadProposal for more information.
In order to validate that the builds that are generated have no issues, the build team has asked that QA run basic tests on the builds.


== Specific Test Plan for this Release ==
== Specific Test Plan for this Release ==


QA will run each browser listed on the "Browser Testing Matrix," below, on the platforms noted, with a careful eye not only for functionality of the webpages, but also their appearance, ensuring that the copy is grammatically correct.
QA will run smoke tests on all of the standard operating systems (Windows XP, Windows Vista, Mac OS X, and Linux). BFTs will be run on Windows XP.


Results will be reported in the [http://wiki.mozilla.org/Firefox:Download_Page:Test_Plan#Test_Results Test Results] section, below, and its report will be the chief deciding factor on whether to push live.
In addition to this testing, the build team has specifically requested that additional testing be done with add-ons because of the nature of the automated builds. Top add-ons will be tested on Windows XP, Mac OS X, and Linux.


Test this with '''JavaScript enabled''' (default setting for all browsers):<br>
Additionally, localization should be spot checked as well since localized builds are being generated. This can be done through the Litmus l10n-localization test suite.
1. With the default settings for the particular browser, visit the specific "Download Firefox" URL ('''NEED STAGING URLs''') for your operating system.<br>
2. Click on the "Download Firefox - Free" green button.<br>
3. Ensure that it:<br>
* Redirects you to a page specific to your operating system, with screenshots appropriate for the given OS, as well as all instructions. Check spelling and grammar of said page.<br>
* Pops up an "Opening Firefox 2.0.0.6[file extension]" dialog, which allows you to save the binary/package to disk.<br>
4. If the above doesn't work--no auto-propogated downloads dialog comes up--verify that clicking on the link" portion in <blockquote>"Your download will begin shortly...
If your download does not start after a few seconds, use this link."</blockquote> spawns the "Opening Firefox 2.0.0.6[file extension]" with the latest appropriate build of Firefox for your operating system.
5. Otherwise, verify that it saves successfully, and you can run the installer without errors (you don't have to install).


Test this with '''JavaScript disabled''':<br>
== Builds ==
1. Disable JavaScript for your particular browser.<br>
2. Visit the specific "Download Firefox" URL ('''NEED STAGING URLs''') for your operating system.<br>
3. Click on the "Firefox for [specific OS]" link.<br>
4. Verify that the "Opening Firefox 2.0.0.6[file extension]" dialog appears, which allows you to save the binary/package to disk.<br>
5. Verify that it saves successfully, and you can run the installer without errors (you don't have to install).


== Browser Testing Matrix ==
Because of naming and versioning requirements, the automated build was generated as a 2.0.0.7 RC1 build. It is not the 2.0.0.7 RC1 but lives in that directory on ftp.mozilla.org:


{| class="fullwidth-table"
* ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/2.0.0.7-candidates/rc1/
!
! Windows XP SP2
! Windows Vista
! Mac
! Linux
|-
| Firefox < = 2.0.0.6
| P1
 
| P1
 
| P1
| P1
|-
|-
| Internet Explorer 7
| P1
| P1
| '''N/A'''
| '''N/A'''
|-
| Internet Explorer 6
| P1


| '''N/A'''
== Assumptions ==


| '''N/A'''
The automated build should behave exactly the same as the normal 1.8 nightly builds from 2007-08-21, but with official branding (eg Firefox rather than Bon Echo), and release update channel instead of nightly.


| '''N/A'''
== Current Tasks ==
|-
| Opera 9
| P2
| P2
| P2
| P2
|-


| Safari 2.0.4
* Smoke Tests:
| P1
** Windows XP (tomcat) - '''PASS'''
| P1
** Windows Vista (abillings) - '''PASS'''
| P1
** Mac OS X (tchung) - '''PASS'''
| '''N/A'''
** Linux (ashughes) - '''PASS'''
|-
* BFTs
| Flock 0.9
** Windows XP (tomcat) - '''PASS'''
| P2
** Mac OS X (tomcat) - '''PASS'''
| P2
** Linux (tomcat) - '''PASS'''
| P2
* FFTs
| P2
** Windows XP (tomcat) - '''PASS'''
|}


== Schedule ==
== Schedule ==
* First Builds Available: 8/23
* Testing: 8/24, 8/27


== Test Results ==
== Test Results ==


'''Make sure to include both "JS-enabled" and "JS-disabled" results.'''
{| border="1" cellpadding="5" cellspacing="0" align="center"
 
|+'''Status RC1 Builds'''
{| class="fullwidth-table"
|-
!  
!  
! Windows XP SP2
! style="background:#ffdead;" | '''Smoketests''' (Windows/Mac/Linux)
! Windows Vista
! style="background:#ffdead;" | '''BFTs''' (Windows/Mac/Linux)
! Mac
! style="background:#ffdead;" | '''FFT''' (Windows)
! Linux
|-
| Firefox < = 2.0.0.6
| .
 
| .
 
| .
| .
|-
|-
| Internet Explorer 7
| .
| .
| '''N/A'''
| '''N/A'''
|-
| Internet Explorer 6
| .
 
| '''N/A'''
 
| '''N/A'''
 
| '''N/A'''
|-
|-
| Opera 9
| style="background:#ffdead;" | '''Firefox 2.0.0.7 Automated Build'''
| .
| Team - '''Result'''
| .
| Tomcat - '''PASS'''
| .
| Tomcat - ''' PASS'''
| .
|-
 
| Safari 2.0.4
| .
| .
| .
| '''N/A'''
|-
|-
| Flock 0.9
| .
| .
| .
| .
|}
|}


== Associated Documentation ==


[http://wiki.mozilla.org/User:Clouserw/DownloadProposal Will Clouser's Download Proposal]
*[http://wiki.mozilla.org/index.php?title=Automated_Builds:Test_Plan:BFT Smoketests, BFTs, and FFTs]
* [[Firefox:Automated_Builds:Test_Plan:l10n | l10n related testing]]
* [[Firefox:Automated_Builds:Test_Plan:Addon Test Results | Addon Test Results]]
Stephend
Confirmed users
9,511

edits

Retrieved from "https://wiki.mozilla.org/Special:MobileDiff/66842"