MailNews:Automated Testing: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(→‎Rules and Review Policy: Add link to toolkit review policies)
(Content moved to devmo)
 
(14 intermediate revisions by 3 users not shown)
Line 1: Line 1:
<small>[[MailNews:Home Page|<< Back to MailNews:Home Page]]</small>
Content moved to the Mozilla Developer Center [https://developer.mozilla.org/en/MailNews/MailNews_Automated_Testing https://developer.mozilla.org/en/MailNews/MailNews_Automated_Testing]
 
__TOC__
 
== Introduction ==
 
Automated testing for MailNews (i.e. [[Thunderbird]] and the Mail/Newsgroups part of [[SeaMonkey]]) is becoming more important. We need to ensure that when we are fixing bugs we do not introduce regressions in other areas of the code. Automated testing is a vital part of this.
 
Tests are not only useful for checking for regressions, but they can help developing and testing of patches. For example, xpcshell tests are very good at checking interfaces, and are very quick to run as they only require a "make check" - you don't have to start up the application, and all the tests happen automatically in a consistent manner.
 
See also [[MailNews:Performance Testing]].
 
This page and its sub-pages are intended to describe and provide pointers to the available test mechanisms within MailNews and supporting information for developers and testers.
 
== Rules and Review Policy ==
 
''' DRAFT POLICY '''
 
'''These apply only to the mozilla/mailnews and mozilla/mail directories.'''
 
* '''At the moment''', tests are not required to be submitted with patches, or for patches to be accepted into the tree. Developers and contributors should consider adding tests within MailNews where possible.
** Once the testing infrastructure has been expanded so that it is possible to write tests for most areas of the code, this may change.
* All tests shall be reviewed by a module owner or peer.
** Where tests are included in a code patch that fixes a bug, no further review is necessary.
** Where tests are not included in a code patch, a review by the module owner or peer is required. No super-review is required.
* When a test is committed to the tree, the appropriate bug shall have the in-testsuite+ flag set.
* Certain build-config or tooling bugs which don't affect the actual product cannot be usefully tested. These bugs should have the in-testsuite- flag set.
 
See the [http://www.mozilla.org/owners.html Module Owners page] for the current module owners and peers.
 
[http://www.mozilla.org/projects/toolkit/review.html toolkit review policies].
 
== Useful Documentation and notes ==
 
The [http://developer.mozilla.org/ devmo] pages have some good descriptions on how to start writing [http://developer.mozilla.org/en/docs/Mozilla_automated_testing automated tests].
 
Not all the [http://developer.mozilla.org/en/docs/Mozilla_automated_testing automated tests] will work at the moment, some of them require new support architectures, some of them require other issues fixing before they will pass/work correctly.
 
== Automated Tests ==
 
* [[MailNews:xpcshell tests]]
** These currently run on the [http://tinderbox.mozilla.org/SeaMonkey/ SeaMonkey tinderboxes], and report as TUnit. Thunderbird hopes to pick running of these up soon ({{bug|422817}}).
 
== Notes for running on Trunk Builds ==
 
These apply to trunk builds of SeaMonkey and Thunderbird. They may also apply to other applications.
 
=== xpcshell tests ===
 
Some of the non-mailnews tests may currently fail in various places due to the following reasons:
 
{|border="1"
!Test !! Debug-only? !! Bug Reference !! Notes
|-
| test_default_index_handler.js ||align="center"| No ||align="center"| {{bug|427831}} ||align="left"| Broken if CVS directory doesn't exist
|-
| test_bug299716.js ||align="center" rowspan=4| Yes ||align="center" rowspan=4| {{bug|431134}} ||rowspan=4| &nbsp;
|-
| test_bug378216.js
|-
| test_bug394300.js
|-
| test_download_manager.js
|-
| test_bug356370.js ||align="center"| Yes ||align="center"| {{bug|428078}} ||
|-
| test_bug394717.js ||align="center"| Yes ||align="center"| {{bug|431147}} ||
|}
 
Thunderbird builds will also fail in various places in core, see the dependencies of {{bug|406227}}.

Latest revision as of 13:20, 17 July 2009

Content moved to the Mozilla Developer Center https://developer.mozilla.org/en/MailNews/MailNews_Automated_Testing

Retrieved from "https://wiki.mozilla.org/index.php?title=MailNews:Automated_Testing&oldid=155973"