TestEngineering/Performance/Talos/Running: Difference between revisions

TestEngineering/Performance/Talos/Running (view source)

145 bytes removed , 9 September 2019

no edit summary

Confirmed users

2,207

edits

@@ Line 36: / Line 36: @@
 = Try server =
-To run Talos tests on the try server, you just simply push to try as normal, specifying that you want to run Talos tests. It is highly recommended that you use [http://trychooser.pub.build.mozilla.org/ trychooser] to build your try server syntax (helpful hint for using trychooser: in the list of Talos suites available you can hover over any one of the suites, and a list of tests included in that suite will be displayed).
+{{note|It's recommended to run ~5 times using the <code>--rebuild</code> option due to the noise inherent in performance test results}}
-To run all of the Talos tests as part of your try push, just add "-t all" to the end of your try syntax. To run a single Talos suite as part of your try push, just add "-t <name of suite>" to your try syntax (i.e. "-t g1").
+Talos tests can be triggered using the [https://firefox-source-docs.mozilla.org/tools/try/ try server]. The following command will run all Talos tests against all available platforms five times using the [https://firefox-source-docs.mozilla.org/tools/try/selectors/fuzzy.html fuzzy selector]:
+  mach try fuzzy --query "^test- 'talos" --rebuild 5
+{{todo|update this}}
 To turn on [[../Profiling|profiling]] as part of your talos tests on try, add "mozharness: --spsProfile" to the end of the try syntax (i.e. "-t g1 mozharness: --spsProfile"). There is an option to do this in trychooser.