TestEngineering/Performance/Raptor/Browsertime

Browsertime is a harness for running performance tests, similar to Mozilla's Raptor testing framework. Browsertime is written in Node.js and uses Selenium WebDriver to drive multiple browsers including Chrome, Chrome for Android, Firefox, and (pending the resolution of Bug 1525126 and similar tickets) Firefox for Android and GeckoView-based vehicles.

Source code:

• Our current (vendored) Browsertime uses the Mozilla fork of the canonical repo
• In-tree: https://searchfox.org/mozilla-central/source/tools/browsertime and https://searchfox.org/mozilla-central/source/taskcluster/scripts/misc/browsertime.sh

Running Locally

Prerequisites

• A local mozilla repository clone with a successful Firefox build completed
• Run ./mach browsertime --setup
• If you plan on running Browsertime on Android, your Android device must already be set up (see more below in the Android section)

Running on Firefox Desktop

• ./mach browsertime https://www.sitespeed.io --firefox.binaryPath '/Applications/Firefox.app/Contents/MacOS/firefox-bin'

Running on Google Chrome

• ./mach browsertime https://www.sitespeed.io -b chrome

Running on the Android GeckoView Example app

• ./mach browsertime --android --browser firefox https://www.sitespeed.io

Running Browsertime on Try

• Pending fix in bug 1566174