TestEngineering/Performance/Sheriffing/Perfherder FAQ: Difference between revisions

no edit summary
No edit summary
Line 1: Line 1:
= What is Perfherder =
= What is Perfherder =
[https://treeherder.mozilla.org/perf.html#/graphs Perfherder] is a tool that takes data points from log files and graphs them over time.  Primarily this is used for performance data from [https://wiki.mozilla.org/Performance_sheriffing/Talos Talos], but also from [https://wiki.mozilla.org/AWSY/Tests AWSY], build_metrics, [https://wiki.mozilla.org/EngineeringProductivity/Autophone Autophone] and platform_microbenchmarks. All these are test harnesses and you can find more about them [https://wiki.mozilla.org/Performance_sheriffing/Alerts here].  
[https://treeherder.mozilla.org/perf.html#/graphs Perfherder] is a tool that takes data points from log files and graphs them over time.  Primarily this is used for performance data from [[TestEngineering/Performance/Talos|Talos]], but also from [[AWSY/Tests|AWSY]], build_metrics, [[EngineeringProductivity/Autophone|Autophone]] and platform_microbenchmarks. All these are test harnesses and you can find more about them [[TestEngineering/Performance/Sheriffing/Alerts|here]].  


The code for Perfherder can be found inside Treeherder [https://github.com/mozilla/treeherder/ here].
The code for Perfherder can be found inside Treeherder [https://github.com/mozilla/treeherder/ here].
Line 51: Line 51:


= Muting additional data points =
= Muting additional data points =
Once you become familiar with graph server it is a common use case to have [https://wiki.mozilla.org/Performance_sheriffing/Talos/Sheriffing/GraphServer_FAQ#Adding_additional_Data_Points multiple data points] on the graph at a time.  This results in a lot of confusing data points if you are trying to zoom in and investigating the values for a given data point.
Once you become familiar with graph server it is a common use case to have [[TestEngineering/Performance/Sheriffing/Perfherder_FAQ#Adding_additional_data_points|multiple data points]] on the graph at a time.  This results in a lot of confusing data points if you are trying to zoom in and investigating the values for a given data point.


Luckily there is a neat feature in graph server that allows you to mute a data point.  There is a checkbox (on by default) that lives in the left hand side bar where you have the list of data series.
Luckily there is a neat feature in graph server that allows you to mute a data point.  There is a checkbox (on by default) that lives in the left hand side bar where you have the list of data series.
Line 60: Line 60:


Common practice is to load up a bunch of related series, and mute/unmute to verify revisions, dates, etc. for a visible regression.
Common practice is to load up a bunch of related series, and mute/unmute to verify revisions, dates, etc. for a visible regression.
* [https://wiki.mozilla.org/Buildbot/Talos/Sheriffing/Perfherder_FAQ duplicated & update from old page]
Confirmed users
2,197

edits