QA/Jetpack/TestPlan: Difference between revisions

From MozillaWiki
< QA‎ | Jetpack
Jump to navigation Jump to search
Line 55: Line 55:
*** Notes:[http://pastebin.mozilla.org/822651 Log]
*** Notes:[http://pastebin.mozilla.org/822651 Log]


** Ubuntu 10.4: Not executed.
** Ubuntu 9.04: Not executed.
***Notes: While running integration script and also while running cfx testall manually, ubuntu was not able to find the FFx 4.0b6 binary. 0.9RC2 worked fine witht eh default version of FFx(3.6.10) though. [http://pastebin.mozilla.org/822720 Error] here.
***Notes: While running integration script and also while running cfx testall manually, ubuntu was not able to find the FFx 4.0b6 binary. 0.9RC2 worked fine witht eh default version of FFx(3.6.10) though. [http://pastebin.mozilla.org/822720 Error] here.

Revision as of 23:30, 20 October 2010

Introduction

Jetpack SDK

Jetpack SDK allows us to create powerful extensions with a set of extensible, robust APIs using the language of the web - HTML, CSS, and JavaScript. You can download the latest zip or tar version of the SDK to get started. Three main platforms to focus here are:

1. Mac
2. Windows
3. Linux

We have an integration script for making sure the Jetpack SDK passes all the tests before we ship it live. This script fires up all the unit tests necessary for the SDK to work correctly. After the tests are performed, it checks for any errors or warnings. This script is intended to run on all the three platforms that are mentioned above. The script for windows platform is still under review. We will land that as soon as possible.

Criteria to ship


Jetpack SDK can be shipped live only if the SDK passes the integration check without any errors. All tests have to pass in order to ship the SDK. Any error or a blocker, will halt the release of SDK. It will be decided by the person who is driving the release. The current need is to have all the tests pass on the latest beta release of the Firefox. The release criteria can change in the future.

QA Reports


The integration script will be run on each platform to make sure the SDK works as intended on each platform. It will be used to test the latest release or the tip of the SDK.

Jetpack

Milestone Release Date QA Sign off Status
SDK 0.9 October 21 Mac:result
Windows 7:result
Windows XP:result
Linux:result
SDk 0.8 September 22 Mac:result
Windows 7:result
Windows XP:result
Linux:result

Test Results

The results of the integration check are as follows:

  • SDK: 0.9 RC2
  • Browser : Firefox 4.0b6
  • OS:
    • Windows 7: bug 606007,bug 606010,bug 606012,bug 606013,
      • Notes: Everytime I run the integration script, the number of tests failing are different. I ran the script three times and each time, the number of failures and the number of tests run were different. The logs for these tests are Test 1 ,Test 2, Test 3
    • Ubuntu 9.04: Not executed.
      • Notes: While running integration script and also while running cfx testall manually, ubuntu was not able to find the FFx 4.0b6 binary. 0.9RC2 worked fine witht eh default version of FFx(3.6.10) though. Error here.
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Jetpack/TestPlan&oldid=262370"