Buildbot/Talos/Sheriffing: Difference between revisions

m
Line 58: Line 58:
* an alert where the range of the regression overlaps with the regular range (a small alert (<5%) or a noisy test)
* an alert where the range of the regression overlaps with the regular range (a small alert (<5%) or a noisy test)


We need to do some retriggers.  I usually find it useful to retrigger 3 times on 5 regressions:
We need to do some retriggers.  I usually find it useful to retrigger 3 times on 5 revisions:
* target revision-2
* target revision-2
* target revision-1
* target revision-1
Line 67: Line 67:
In the case where there is missing data, target revision becomes a range of: [target revision, revisions with missing data]
In the case where there is missing data, target revision becomes a range of: [target revision, revisions with missing data]


This is important because we then have enough evidence to show that the regression is sustained through retriggers and over time.  If there is suspect of alerts on other tests/platforms, please retriggers as well.
This is important because we then have enough evidence to show that the regression is sustained through retriggers and over time.  If there is suspect of alerts on other tests/platforms, please retrigger those as well.


== Determining the scope of the regression from Perfherder ==
== Determining the scope of the regression from Perfherder ==
Confirmed users
372

edits