Confirmed users
2,197
edits
TestEngineering/Performance/Talos/Adding tests: Difference between revisions
TestEngineering/Performance/Talos/Adding tests (view source)
Revision as of 11:51, 16 March 2021
, 16 March 2021no edit summary
No edit summary |
No edit summary |
||
| Line 26: | Line 26: | ||
* What considerations are there for how this test should be run and what tools are required? | * What considerations are there for how this test should be run and what tools are required? | ||
Please document your new test along with answers to these questions | Please document your new test along with answers to these questions in the '''[https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html Firefox Source Docs]''' | ||
= Pageloader tests = | = Pageloader tests = | ||
| Line 60: | Line 60: | ||
* If you add a new suite, edit [https://searchfox.org/mozilla-central/rev/30b01f4f60dbcbd6b01500a26b3100c28005cf62/taskcluster/ci/test/talos.yml taskcluster/ci/test/talos.yml] to add the testname to a new suite, then add it to [https://searchfox.org/mozilla-central/rev/30b01f4f60dbcbd6b01500a26b3100c28005cf62/taskcluster/ci/test/test-sets.yml taskcluster/ci/test/test-sets.yml] for all the different Talos test-sets. | * If you add a new suite, edit [https://searchfox.org/mozilla-central/rev/30b01f4f60dbcbd6b01500a26b3100c28005cf62/taskcluster/ci/test/talos.yml taskcluster/ci/test/talos.yml] to add the testname to a new suite, then add it to [https://searchfox.org/mozilla-central/rev/30b01f4f60dbcbd6b01500a26b3100c28005cf62/taskcluster/ci/test/test-sets.yml taskcluster/ci/test/test-sets.yml] for all the different Talos test-sets. | ||
* If this is an update to an existing test that could change the numbers, this needs to be treated as a new test and run side by side for a week to get a new baseline. | * If this is an update to an existing test that could change the numbers, this needs to be treated as a new test and run side by side for a week to get a new baseline. | ||
* Document the test | * Document the test in [https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html Firefox Source Docs] | ||