Litmus

Litmus is the new integrated testcase management and QA tool that is designed to improve workflow, visibility, and turnaround time in the Mozilla QA process. It is first and foremost designed as a replacement for Testrunner, but will also have additional functionality.

Goals for Litmus

Litmus will:

• make it easier for casual testers to assist with testing Mozilla products;
• serve as a repository for test cases, with all the inherent management abilities that implies;
• serve as a repository for test results, carrying over the best features of Testrunner, e.g. test lists, division of labor, etc.;
• provide a query interface for viewing, reporting on, and comparing test results;
• expose a web services interface for the mechanical batch submission of testing results.

Litmus will not:

• manage the automation of testing requests as a centralized test scheduler or daemon. The majority of testing we do, and all of the community testing that we know of, is still done by hand. This doesn't preclude such functionality in the future, but we need to figure out the intricacies of how to automate a larger proportion of our daily testing before it makes sense to spend too much time on scheduling those automated tests. Existing automation frameworks will be able to submit results via web services.

Litmus Documentation and Notes

Designing and Planning

• Litmus Roadmap
• Litmus To-Do List
• Future Directions for Litmus
• Feature Wishlist
• Litmus Developers' Notes
  • mod_perl Notes
• Litmus Requirements
• Litmus Design
  • Authentication System Design
• Litmus:Web Services
  • Result Submission Service:
    • Test Result Format (DTD)
    • bsmedberg's notes on Litmus Web Services
    • Getting results from Eggplant into Litmus
  • Testcase Retrieval Service:
    • Litmus:Test_Format_DTD
• Future Directions for Litmus

Installation

• Verifying Your Litmus Install
• How to check out Litmus from mozilla.org CVS

Using Litmus

• Adding Testcases to Litmus
• Syncing testcases between subgroups in Litmus

Miscellaneous

• View a list of recent checkins to Litmus in CVS (Bonsai)
• Notes from the Litmus BOF session held at the Mozilla 2005 offsite

Further Reading

• Mozilla QA