160
edits
TestEngineering/Performance/Sheriffing/Perfherder FAQ: Difference between revisions
Jump to navigation
Jump to search
TestEngineering/Performance/Sheriffing/Perfherder FAQ (view source)
Revision as of 12:36, 22 January 2018
, 22 January 2018update links
(improve expression) |
(update links) |
||
| Line 1: | Line 1: | ||
= What is Perfherder = | = What is Perfherder = | ||
[https://treeherder.mozilla.org/perf.html#/graphs Perfherder] is a tool that takes data points from log files and graphs them over time. Primarily this is used for performance data from [https://wiki.mozilla.org/ | [https://treeherder.mozilla.org/perf.html#/graphs Perfherder] is a tool that takes data points from log files and graphs them over time. Primarily this is used for performance data from [https://wiki.mozilla.org/Performance_sheriffing/Talos Talos], but also from [https://wiki.mozilla.org/AWSY/Tests AWSY], build_metrics, [https://wiki.mozilla.org/EngineeringProductivity/Autophone Autophone] and platform_microbenchmarks. All these are test harnesses and you can find more about them [https://wiki.mozilla.org/Performance_sheriffing/Alerts here]. | ||
The code for Perfherder can be found inside Treeherder [https://github.com/mozilla/treeherder/ here]. | The code for Perfherder can be found inside Treeherder [https://github.com/mozilla/treeherder/ here]. | ||
| Line 51: | Line 51: | ||
= Muting additional data points = | = Muting additional data points = | ||
Once you become familiar with graph server it is a common use case to have [https://wiki.mozilla.org/ | Once you become familiar with graph server it is a common use case to have [https://wiki.mozilla.org/Performance_sheriffing/Talos/Sheriffing/GraphServer_FAQ#Adding_additional_Data_Points multiple data points] on the graph at a time. This results in a lot of confusing data points if you are trying to zoom in and investigating the values for a given data point. | ||
Luckily there is a neat feature in graph server that allows you to mute a data point. There is a checkbox (on by default) that lives in the left hand side bar where you have the list of data series. | Luckily there is a neat feature in graph server that allows you to mute a data point. There is a checkbox (on by default) that lives in the left hand side bar where you have the list of data series. | ||
| Line 61: | Line 61: | ||
Common practice is to load up a bunch of related series, and mute/unmute to verify revisions, dates, etc. for a visible regression. | Common practice is to load up a bunch of related series, and mute/unmute to verify revisions, dates, etc. for a visible regression. | ||
* [https://wiki.mozilla.org/index.php?title= | * [https://wiki.mozilla.org/index.php?title=Performance_sheriffing/Talos/Sheriffing/Perfherder_FAQ duplicated & update from old page] | ||