Buildbot/Talos/Running: Difference between revisions

Jump to navigation Jump to search
yet more minor changes
(→‎Locally: more minor adjustments)
(yet more minor changes)
Line 45: Line 45:
When viewing your talos try server results on Treeherder, look for the group names 'T' and 'T-e10s'. Click on the green symbol corresponding to the talos suite name, and then click on the 'Performance' tab below to see the test results.
When viewing your talos try server results on Treeherder, look for the group names 'T' and 'T-e10s'. Click on the green symbol corresponding to the talos suite name, and then click on the 'Performance' tab below to see the test results.


If you're curious about the hardware we use, here is a [https://wiki.mozilla.org/Buildbot/Talos/Misc#Hardware_Profile_of_machines_used_in_automation description of the specs].  You can also refer to the [https://wiki.mozilla.org/ReferencePlatforms#Build_Reference_Platforms test reference platforms] descriptions.
If you're curious about the hardware we use, here is a [https://wiki.mozilla.org/Buildbot/Talos/Misc#Hardware_Profile_of_machines_used_in_automation description of the specs].  You can also refer to the [https://wiki.mozilla.org/ReferencePlatforms#Build_Reference_Platforms test reference platforms] documentation.


== Are my Talos Results OK? ==
== Are my Talos Results OK? ==


The best way to answer this question is to push to try server and compare the performance of your push against a baseline, using Perfherder. After pushing to try with talos tests enabled, you will receive an email with a link to Perfherder where you can compare your results. Be aware of PGO vs Non PGO and e10s vs Non-e10s.
The best way to answer this question is to push to try server and compare the performance of your push against a baseline, using Perfherder (it is recommended hitting retrigger a few times to get at least 5 data points for each test). After pushing to try with talos tests enabled, you will receive an email with a link to Perfherder where you can compare your results. Be aware of the options: e.g. pgo vs non-pgo or e10s vs non-e10s.


= Hacking on Talos Itself =
= Hacking on Talos Itself =
Line 113: Line 113:
== Testing your Talos Patch on Try Server ==
== Testing your Talos Patch on Try Server ==


Just push your talos patch to the try server, and add the extra talos try syntax. See [https://wiki.mozilla.org/Buildbot/Talos/Running#Try Server the Try Server section] above.
Just push your talos patch to the try server. See [https://wiki.mozilla.org/Buildbot/Talos/Running#Try Server the Try Server section] above.
 
Try server will give you results for a single data point (it is recommended hitting retrigger a few times to get at least 3 data points for each test).
Confirmed users
955

edits

Navigation menu