Confirmed users
3,376
edits
Buildbot/Talos/Sheriffing: Difference between revisions
m
→Understand an alert: - new title, more links
m (→Understand an alert: - brief update) |
m (→Understand an alert: - new title, more links) |
||
| Line 6: | Line 6: | ||
Enter the role of a Performance Sheriff. This role looks at the data produced by these test jobs and finds regressions, root causes and gets bugs on file to track all issues and make interested parties aware of what is going on. | Enter the role of a Performance Sheriff. This role looks at the data produced by these test jobs and finds regressions, root causes and gets bugs on file to track all issues and make interested parties aware of what is going on. | ||
= | = What is an alert = | ||
As of January 2015, alerts come in from [[http://graphs.mozilla.org/ graph server]] to [[http://groups.google.com/d/forum/mozilla.dev.tree-alerts dev.tree-alerts]]. These are generated by programatically verifying there is a sustained regression over time (original data point + [https://wiki.mozilla.org/Buildbot/Talos/Sheriffing/Noise_FAQ#Why_do_we_need_12_future_data_points 12 future data points]]). | As of January 2015, alerts come in from [[http://graphs.mozilla.org/ graph server]] to [[http://groups.google.com/d/forum/mozilla.dev.tree-alerts dev.tree-alerts]]. These are generated by programatically verifying there is a sustained regression over time (original data point + [https://wiki.mozilla.org/Buildbot/Talos/Sheriffing/Noise_FAQ#Why_do_we_need_12_future_data_points 12 future data points]]). | ||
| Line 13: | Line 13: | ||
* platform | * platform | ||
* test name | * test name | ||
* % change / values | * [[https://wiki.mozilla.org/Buildbot/Talos/Sheriffing/Alert_FAQ#Why_does_Alert_Manager_print_-xx.25 % change / values]] | ||
* malicious changeset [range] including commit summary | * malicious changeset [range] including commit summary | ||
* link to graph server | * link to [[https://wiki.mozilla.org/Buildbot/Talos/Sheriffing/GraphServer_FAQ#What_is_graph_server graph server]] | ||
Keep in mind that alerts mention improvements and regressions, which is valuable for us to track the entire system as a whole. For filing bugs, we focus mostly on the regressions. | Keep in mind that alerts mention improvements and regressions, which is valuable for us to track the entire system as a whole. For filing bugs, we focus mostly on the regressions. | ||