MailNews:Tinderbox Numbers Explanation
Both SeaMonkey and Thunderbird build MailNews, and run at least some tests on the builds continuously. The Tinderbox trees can be found at:
These are the revisions of the source code that were used for a particular build, e.g.
Trunk (Gecko 1.9.2): rev:4515bf6e257a m-c:dac237f37585 Branch (Gecko 1.9.1): rev:c1b691f7596b moz:5806c46219b5
All these link to the appropriate revision on hg.mozilla.org.
Note, sometimes there may be more than one revision per build. In which case?
MailNews specific Numbers
This list are numbers that are specific to MailNews tests, or are affected by MailNews tests.
Unit Test Boxes
These tinderbox names typically end with "check" (TB) or "unit test" (SM).
These numbers are a result of running the compiled-code tests on Thunderbird or SeaMonkey. These are low level tests driven from standalone executables (but using the compiled libraries).
This test display results as two numbers: <passed>/<failed>.
- More Information: Compiled code automated tests (devo)
These numbers are a result of running the xpcshell unit tests on Thunderbird or SeaMonkey. The xpcshell unit tests are low-level tests, typically testing interfaces, and do not run any UI.
Currently the SeaMonkey ones run on both core and MailNews code, whereas the Thunderbird ones are just run on MailNews code.
This test displays results as two numbers: <passed>/<failed>.
- More Information: MailNews:Xpcshell_tests
Bloat Test Boxes
More information about the specific tests can be found here
There are currently no graphs for these tests.
Reference Count Leaks
On the Thunderbird Tree, if this count goes above 0 bytes on any platform, the tinderbox will turn Orange.
Total Bytes malloc'ed and not free'd
On the Thunderbird Tree, if this count goes above a set level, the tinderbox will turn orange. The levels are currently:
For confirmation of the actual levels, see this file look for 'leak_threshold'.
Maximum Heap size
Allocations - number of calls to malloc and friends
Core (Gecko) Specific Numbers
See Performance:Tinderbox_Tests for more information.