QA/Jetpack/TestPlan: Difference between revisions
| Line 46: | Line 46: | ||
* Browser : Firefox 4.0b6 | * Browser : Firefox 4.0b6 | ||
* OS: | * OS: | ||
** Windows 7: | ** Windows 7: {{bug|606007}},{{bug|606010}},{{bug|606012}},{{bug|606013}}, | ||
***Notes: Everytime I run the integration script, the number of tests failing are different. I ran the script three times and each time, the number of failures and the number of tests run were different. The logs for these tests are [http://pastebin.mozilla.org/822628 Test 1] ,[http://pastebin.mozilla.org/822625 Test 2], [http://pastebin.mozilla.org/822629 Test 3] | ***Notes: Everytime I run the integration script, the number of tests failing are different. I ran the script three times and each time, the number of failures and the number of tests run were different. The logs for these tests are [http://pastebin.mozilla.org/822628 Test 1] ,[http://pastebin.mozilla.org/822625 Test 2], [http://pastebin.mozilla.org/822629 Test 3] | ||
** Windows XP: | |||
** Windows XP:{{bug|606010}} | |||
***Notes:[http://pastebin.mozilla.org/822682 Log] | ***Notes:[http://pastebin.mozilla.org/822682 Log] | ||
** Mac: | ** Mac: {{bug|606014}} | ||
*** Notes:[http://pastebin.mozilla.org/822651 Log] | *** Notes:[http://pastebin.mozilla.org/822651 Log] | ||
** Ubuntu 10.4: | ** Ubuntu 10.4: Not executed. | ||
***Notes: | ***Notes: While running integration script and also while running cfx testall manually, ubuntu was not able to find the FFx 4.0b6 binary. 0.9RC2 worked fine witht eh default version of FFx(3.6.10) though. [http://pastebin.mozilla.org/822720 Error] here. | ||
Revision as of 23:28, 20 October 2010
Introduction
Jetpack SDK
Jetpack SDK allows us to create powerful extensions with a set of extensible, robust APIs using the language of the web - HTML, CSS, and JavaScript. You can download the latest zip or tar version of the SDK to get started. Three main platforms to focus here are:
1. Mac
2. Windows
3. Linux
We have an integration script for making sure the Jetpack SDK passes all the tests before we ship it live. This script fires up all the unit tests necessary for the SDK to work correctly. After the tests are performed, it checks for any errors or warnings. This script is intended to run on all the three platforms that are mentioned above. The script for windows platform is still under review. We will land that as soon as possible.
Criteria to ship
Jetpack SDK can be shipped live only if the SDK passes the integration check without any errors. All tests have to pass in order to ship the SDK. Any error or a blocker, will halt the release of SDK. It will be decided by the person who is driving the release. The current need is to have all the tests pass on the latest beta release of the Firefox. The release criteria can change in the future.
QA Reports
The integration script will be run on each platform to make sure the SDK works as intended on each platform. It will be used to test the latest release or the tip of the SDK.
Jetpack
| Milestone | Release Date | QA Sign off | Status |
| SDK 0.9 | October 21 | Mac:result Windows 7:result Windows XP:result Linux:result | |
| SDk 0.8 | September 22 | Mac:result Windows 7:result Windows XP:result Linux:result |
Test Results
The results of the integration check are as follows:
- SDK: 0.9 RC2
- Browser : Firefox 4.0b6
- OS:
- Windows 7: bug 606007,bug 606010,bug 606012,bug 606013,
- Windows XP:bug 606010
- Notes:Log
- Windows XP:bug 606010
- Mac: bug 606014
- Notes:Log
- Mac: bug 606014
- Ubuntu 10.4: Not executed.
- Notes: While running integration script and also while running cfx testall manually, ubuntu was not able to find the FFx 4.0b6 binary. 0.9RC2 worked fine witht eh default version of FFx(3.6.10) though. Error here.
- Ubuntu 10.4: Not executed.