96
edits
Performance/Fenix/Performance reviews: Difference between revisions
Performance/Fenix/Performance reviews (view source)
Revision as of 17:06, 24 March 2023
, 24 March 2023Add information about how to run CI performance tests on custom APKs.
(Starting information for running benchmarks remotely or in CI.) |
(Add information about how to run CI performance tests on custom APKs.) |
||
| Line 11: | Line 11: | ||
== Benchmark remotely == | == Benchmark remotely == | ||
You can run benchmarks remotely in CI/automation now. | You can run benchmarks remotely in CI/automation now. | ||
First, you will need to clone, and setup mozilla-central, or mozilla-unified locally. See [https://firefox-source-docs.mozilla.org/setup/index.html these build instructions] for how to get setup. When prompted what kind of build you would like, select an Artifact build as you won't need to build Firefox. | |||
After/while building and setting up, you'll need to get setup for pushing to try. [https://firefox-source-docs.mozilla.org/tools/try/index.html Follow this link to do this]. | |||
Once you've finished setting up, you should be able to run <code>./mach try perf --help</code>. Now you're ready to test custom APKs on the try branch with the following instructions: | |||
* '''Get the path to your custom APK.''' | |||
** Ensure that you have a nightly APK build so that the activity, intents, and package name line up with existing tasks. | |||
* '''Run <code>./mach try perf --mozperftest-upload-apk /path/to/apk </code> to copy the APK in-tree.''' | |||
** This will replace the APK used in mozperftest tests (e.g. startup tests). | |||
** Use <code>--browsertime-upload-apk</code> if you want to target Browsertime performance tests. | |||
* '''Commit the changes in-tree with: <code>hg commit -m "Upload APK"</code>''' | |||
* '''Now you can re-run the performance selector to pick the tests you want to run, and perform the push: <code>./mach try perf --android --show-all</code>''' | |||
** Search for <code>'perftest 'start</code> to find the startup tests. | |||
** You'll be provided with a PerfCompare View link once the try runs are pushed that will show you a before/after comparison of the performance differences. | |||
** You can also find all your try pushes at <code>https://treeherder.mozilla.org/jobs?repo=try&author=YOUR_EMAIL</code>. | |||
== Benchmark locally == | == Benchmark locally == | ||