Running Performance Tests
To run the tests you will need to have the source code available locally, and satisfy the requirements for running mach commands. If you want to run tests against the same infrastructure as our continuous integration then you will need to follow the try server documentation.
Identifying tests to run
To be able to run one or more performance tests you first need to know which tests you would like to run. If you're responding to a regression bug then the test names will be listed in the bug report. The performance tests and frameworks available can be found from our projects list. You can also see our new performance test documentation, which will eventually replace our wiki pages.
Running tests locally
Scheduling tests on try
Follow this guide to schedule jobs against the try server.
Due to the variance in performance test results it is a good idea to schedule multiple rebuilds. We typically recommend 5 rebuilds. This can be achieved by adding
--rebuild 5 to your try syntax.
If you're unsure which tests to run, there are some mach try presets that can help:
- Runs all performance (raptor and talos) tasks across all platforms. Android hardware platforms are excluded due to resource limitations.
- Runs the talos tests most likely to change when making a change to the browser chrome. This skips a number of talos jobs that are unlikely to be affected in order to conserve resources.
Some jobs are hidden by default to reduce them being scheduled unintentionally. These are typically jobs that run on limited pools of hardware such as mobile devices. To make these available to your try run add the