MailNews:Automated Testing

<< Back to MailNews:Home Page

Introduction

Automated testing for MailNews (i.e. Thunderbird and the Mail/Newsgroups part of SeaMonkey) is becoming more important. We need to ensure that when we are fixing bugs we do not introduce regressions in other areas of the code. Automated testing is a vital part of this.

Tests are not only useful for checking for regressions, but they can help developing and testing of patches. For example, xpcshell tests are very good at checking interfaces, and are very quick to run as they only require a "make check" - you don't have to start up the application, and all the tests happen automatically in a consistent manner.

See also MailNews:Performance Testing.

This page and its sub-pages are intended to describe and provide pointers to the available test mechanisms within MailNews and supporting information for developers and testers.

Thunderbird brainstorm on unit test ideas is also available.

Rules and Review Policy

See the following pages:

• mailnews/ review policies
• mail/ review policies
• suite/ review policies
• toolkit/ review policies.

Useful Documentation and notes

The devmo pages have some good descriptions on how to start writing automated tests.

Not all the automated tests will work at the moment, some of them require new support architectures, some of them require other issues fixing before they will pass/work correctly.

Automated Tests

• MailNews:xpcshell tests
  • These report as TUnit and are run on both Thunderbird and SeaMonkey.

Notes for running on Trunk Builds

These apply to trunk builds of SeaMonkey and Thunderbird. They may also apply to other applications.

xpcshell tests

Some of the non-mailnews tests may currently fail in various places due to the following reasons:

Test	Debug-only?	Bug Reference	Notes
test_bug299716.js	Yes	bug 431139	Fails on exit due to an Assertion - Mem cache leaking entries?
test_bug378216.js
test_bug394300.js
test_bug394717.js
test_download_manager.js
test_bug356370.js	Yes	bug 428078