Firefox:Automated Builds:Test Plan: Difference between revisions
| (6 intermediate revisions by 3 users not shown) | |||
| Line 3: | Line 3: | ||
== Description of Release == | == Description of Release == | ||
The build team has been working to generate builds via automation. This automation removes the necessity of human intervention during a normal build process. This is the | The build team has been working to generate builds via automation. This automation removes the necessity of human intervention during a normal build process. This is the first time that this has been done but this process will be used for the 2.0.0.7 release. | ||
In order to validate that the builds that are generated have no issues, the build team has asked that QA run basic tests on the builds. | In order to validate that the builds that are generated have no issues, the build team has asked that QA run basic tests on the builds. | ||
| Line 17: | Line 17: | ||
== Builds == | == Builds == | ||
Because of naming and versioning requirements, the automated build was generated as a 2.0.0.7 RC1 build. It is not the 2.0.0.7 RC1 but lives in that directory on ftp.mozilla.org: | |||
* ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/2.0.0.7-candidates/rc1/ | * ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/2.0.0.7-candidates/rc1/ | ||
| Line 23: | Line 23: | ||
== Assumptions == | == Assumptions == | ||
The automated build should behave exactly the same as the normal 1.8 nightly builds. | The automated build should behave exactly the same as the normal 1.8 nightly builds from 2007-08-21, but with official branding (eg Firefox rather than Bon Echo), and release update channel instead of nightly. | ||
== Current Tasks == | == Current Tasks == | ||
* Smoke Tests: | * Smoke Tests: | ||
** Windows XP | ** Windows XP (tomcat) - '''PASS''' | ||
** Windows Vista | ** Windows Vista (abillings) - '''PASS''' | ||
** Mac OS X | ** Mac OS X (tchung) - '''PASS''' | ||
** Linux | ** Linux (ashughes) - '''PASS''' | ||
* | * BFTs | ||
** Windows XP | ** Windows XP (tomcat) - '''PASS''' | ||
** Mac OS X (tomcat) - '''PASS''' | |||
** Linux (tomcat) - '''PASS''' | |||
* FFTs | |||
** Windows XP (tomcat) - '''PASS''' | |||
== Schedule == | == Schedule == | ||
| Line 45: | Line 49: | ||
|- | |- | ||
! | ! | ||
! style="background:#ffdead;" | '''Smoketests''' | ! style="background:#ffdead;" | '''Smoketests''' (Windows/Mac/Linux) | ||
! style="background:#ffdead;" | '''BFTs''' | ! style="background:#ffdead;" | '''BFTs''' (Windows/Mac/Linux) | ||
! style="background:#ffdead;" | '''FFT''' (Windows) | |||
|- | |- | ||
| style="background:#ffdead;" | '''Firefox 2.0.0.7 Automated Build''' | | style="background:#ffdead;" | '''Firefox 2.0.0.7 Automated Build''' | ||
| Team - '''Result''' | | Team - '''Result''' | ||
| Tomcat | | Tomcat - '''PASS''' | ||
| Tomcat - ''' PASS''' | |||
|- | |- | ||
|} | |} | ||
*[http://wiki.mozilla.org/index.php?title=Automated_Builds:Test_Plan:BFT Smoketests and | *[http://wiki.mozilla.org/index.php?title=Automated_Builds:Test_Plan:BFT Smoketests, BFTs, and FFTs] | ||
* [[Firefox:Automated_Builds:Test_Plan:l10n | l10n related testing]] | * [[Firefox:Automated_Builds:Test_Plan:l10n | l10n related testing]] | ||
* [[Firefox:Automated_Builds:Test_Plan:Addon Test Results | Addon Test Results]] | * [[Firefox:Automated_Builds:Test_Plan:Addon Test Results | Addon Test Results]] | ||
Latest revision as of 10:58, 27 August 2007
General Firefox Automated Builds Test Plan
Description of Release
The build team has been working to generate builds via automation. This automation removes the necessity of human intervention during a normal build process. This is the first time that this has been done but this process will be used for the 2.0.0.7 release.
In order to validate that the builds that are generated have no issues, the build team has asked that QA run basic tests on the builds.
Specific Test Plan for this Release
QA will run smoke tests on all of the standard operating systems (Windows XP, Windows Vista, Mac OS X, and Linux). BFTs will be run on Windows XP.
In addition to this testing, the build team has specifically requested that additional testing be done with add-ons because of the nature of the automated builds. Top add-ons will be tested on Windows XP, Mac OS X, and Linux.
Additionally, localization should be spot checked as well since localized builds are being generated. This can be done through the Litmus l10n-localization test suite.
Builds
Because of naming and versioning requirements, the automated build was generated as a 2.0.0.7 RC1 build. It is not the 2.0.0.7 RC1 but lives in that directory on ftp.mozilla.org:
Assumptions
The automated build should behave exactly the same as the normal 1.8 nightly builds from 2007-08-21, but with official branding (eg Firefox rather than Bon Echo), and release update channel instead of nightly.
Current Tasks
- Smoke Tests:
- Windows XP (tomcat) - PASS
- Windows Vista (abillings) - PASS
- Mac OS X (tchung) - PASS
- Linux (ashughes) - PASS
- BFTs
- Windows XP (tomcat) - PASS
- Mac OS X (tomcat) - PASS
- Linux (tomcat) - PASS
- FFTs
- Windows XP (tomcat) - PASS
Schedule
- First Builds Available: 8/23
- Testing: 8/24, 8/27
Test Results
| Smoketests (Windows/Mac/Linux) | BFTs (Windows/Mac/Linux) | FFT (Windows) | |
|---|---|---|---|
| Firefox 2.0.0.7 Automated Build | Team - Result | Tomcat - PASS | Tomcat - PASS |