QA/Mozmill Test Automation/Addon Tests: Difference between revisions

Jump to navigation Jump to search

QA/Mozmill Test Automation/Addon Tests (view source)

Revision as of 14:02, 1 June 2010

352 bytes removed ,  1 June 2010
no edit summary
(Undo revision 226755 by Whimboo (Talk))
No edit summary
Line 13: Line 13:
  | No end date for tests
  | No end date for tests
  |- valign="top"
  |- valign="top"
  | '''Documents:'''
  | '''Documentation:'''
  | [http://docs.google.com/Doc?docid=0AVroormSQgiRZDljejN3a18xNmNrdmY2a2Rn&hl=en Spec for the test-run script]
  | [https://developer.mozilla.org/en/Mozmill_Tests/Addon_tests Add-on Test Creation Guide]
  |- valign="top"
  |- valign="top"
  | '''Repository Location:'''
  | '''Repository Location:'''
  | [http://hg.mozilla.org/qa/mozmill-tests/file/default/addons Add-on Tests]<br/>[http://hg.mozilla.org/qa/mozmill-automation/file/tip Add-on Test-run Script]
  | [http://hg.mozilla.org/qa/mozmill-tests/file/default/addons Add-on Tests]
  |- valign="top"
  |- valign="top"
  | '''Tracking Bug:'''
  | '''Tracking Bug:'''
Line 24: Line 24:


=Excerpt=
=Excerpt=
With Mozmill we are also able to create functional tests for extensions. If you are an author of an extension and interested in writing tests, you can help in improving the quality of your extension and even Firefox. Overall it allows us to identify regressions as early as possible in the development cycle and react accordingly.
With Mozmill we are also able to run functional tests for add-ons. If you are an author of an add-on and interested in creating tests to get your add-on automatically tested, you should definitely join this project. With your contributino you can help to improve your add-on and even the quality of Firefox. Overall we want to to able to identify regressions as early as possible in the development cycle and react accordingly.


=Project details=
=Project details=
The complete project can be divided into 2 different sub projects:
The project can be divided into 2 different sub projects:


* Creation and enhancement of the script which executes the add-on tests
* Creation of Mozmill tests for add-ons
* Creation of the Mozmill tests for your add-on.
* Script for Automated Add-on Test-runs


==Add-on Test-run Script==
==Creation of Mozmill Tests==
While you would also be able to run tests against extensions directly with Mozmill itself, you would have to download the extension first and specify it as argument to the Mozmill command line client. Those steps can be simplified and will result in a new test-run script for add-ons.  
The creation of the Mozmill tests for add-ons is basically the same work as what has to be done for all the other [[QA/Mozmill_Test_Automation/Test_Writing|Mozmill tests]]. We have a [https://developer.mozilla.org/en/Mozmill_Tests/Addon_tests helpful guide to get started] in writing tests for add-ons.


It will become a Python script which can be used to run tests against all or only a particular extension. Once it has been called it should automatically execute the steps below:
==Script for Automated Add-on Test-runs==
 
To be able to run all the created add-on tests a single test-run script is necessary. It takes care of downloading the specified version of the add-on, installing it in a fresh profile, run the add-on specific tests, and send the results to a reporting server (supported by CouchDB).  
* Perform tests against each listed extension
** Download the latest version from the specified URL
** Start Firefox with the extension installed
** Run all available tests
** Clean-up the system
 
The implementation of the script is covered by {{bug|562445}}.
 
==Creation of Mozmill Tests==
The creation of the Mozmill tests for your add-on is basically the same work as we do for all the other [[QA/Mozmill_Test_Automation/Test_Writing|Mozmill tests]]. Please check which [https://developer.mozilla.org/en/Mozmill_Tests#Testing_extensions_with_Mozmill steps] are necessary.


If you want to help please contact Henrik Skupin.
The implementation of the script is covered in the [[/QA/Mozmill_Test_Automation/Automated_Testruns#Script_for_Add-on_Test-runs|Automated Test-run project]].
Whimboo
canmove, Confirmed users, Bureaucrats and Sysops emeriti
4,747

edits

Retrieved from "https://wiki.mozilla.org/Special:MobileDiff/226766"

Navigation menu