Personal tools

Buildbot/Talos

From MozillaWiki

< Buildbot(Redirected from Auto-tools/Tools/Talos)
Jump to: navigation, search

Talos.jpg


Contents

Talos

Talos is a python performance testing framework that is usable on Windows, Mac and Linux. Talos is our versatile performance testing framework we use at Mozilla. It was created to serve as a test runner for the existing performance tests that Mozilla was running back in 2007 as well as providing an extensible framework for new tests as they were created.

So, why Talos? Talos is the bronze automaton of Greek myth. Talos protected the island of Crete, throwing giant boulders at unwary seamen. He's also purported to have heated himself glowing hot and then embraced his enemies. Basically, he was awesome.

Talos code lives at http://hg.mozilla.org/build/talos


Talos Tests

Information about each test is available in Buildbot/Talos/Tests or by using the command line switch: talos --print-tests

Lifecycle of a Performance Test, from push to graph server

  • Buildbot schedules Talos jobs
  • Buildbot runs a talos job on a slave when one is available
  • TBPL displays a green (all OK) status and has a link to the graph server
  • 13 pushes later, analyze_talos.py is ran which compares your push to the previous 12 pushes and next 12 pushes to look for a regression

Links

Signal From Noise

The Signal from Noise project is an effort to increase the fidelity of regression detection for performance tests.

Adding a new test

To create a new test you ideally need a webpage(s) that performs the test(s) desired. The results can be a simple alert.

Once you've got that, just talk to the a*team (jhammel or jmaher) and they will handle the majority of the steps required.

Bugs

Subpages

Blog posts about Talos