Litmus

Litmus is the new integrated testcase management and QA tool that is designed to improve workflow, visibility, and turnaround time in the Mozilla QA process. It is first and foremost designed as a replacement for Testrunner, but will also have additional functionality.

Work in Progress

• See information on the QA Extension Project

More information can be found in the To-Do List.

Goals for Litmus

Litmus will:

• make it easier for casual testers to assist with testing Mozilla products;
• serve as a repository for test cases, with all the inherent management abilities that implies;
• serve as a repository for test results, carrying over the best features of Testrunner, e.g. test lists, division of labor, etc.;
• provide a query interface for viewing, reporting on, and comparing test results;
• expose a web services interface for the mechanical batch submission of testing results.

Litmus will not:

• manage the automation of testing requests as a centralized test scheduler or daemon. The majority of testing we do, and all of the community testing that we know of, is still done by hand. This doesn't preclude such functionality in the future, but we need to figure out the intricacies of how to automate a larger proportion of our daily testing before it makes sense to spend too much time on scheduling those automated tests. Existing automation frameworks will be able to submit results via web services.

Litmus Documentation and Notes

Designing and Planning

• Roadmap
  • To-Do List: a list of what's in progress, and what remains to be done. Please check here before suggesting new features or filing new bugs.
  • Feature Wishlist
• Developers' Notes: Interested in helping with Litmus? Start here.
  • mod_perl Notes
• Requirements
• Design
  • Authentication System Design
• Web Services
  • Result Submission Service:
    • Test Result Format (DTD)
    • bsmedberg's notes on Litmus Web Services
    • Getting results from Eggplant into Litmus
  • Testcase Retrieval Service:
    • Test Format DTD

Installation

Litmus is released under the MPL.

• How to check out Litmus from mozilla.org CVS
• INSTALL doc (from mxr)
• Litmus Install FAQ
• Verifying Your Litmus Install
  • Command-line verifications
  • Selenium Tests

Using Litmus

• For Users:
  • Litmus Tutorial
• For Admins:
  • Admin Tutorial
  • Adding Testcases to Litmus
  • Syncing testcases between subgroups in Litmus

Miscellaneous

• View a list of recent checkins to Litmus in CVS (Bonsai)
• Notes from the Litmus BOF session held at the Mozilla 2005 offsite

Further Reading

• Mozilla QA