Confirmed users
372
edits
m (→Minor fix) |
m (→Fix typo) |
||
| Line 58: | Line 58: | ||
* an alert where the range of the regression overlaps with the regular range (a small alert (<5%) or a noisy test) | * an alert where the range of the regression overlaps with the regular range (a small alert (<5%) or a noisy test) | ||
We need to do some retriggers. I usually find it useful to retrigger 3 times on 5 | We need to do some retriggers. I usually find it useful to retrigger 3 times on 5 revisions: | ||
* target revision-2 | * target revision-2 | ||
* target revision-1 | * target revision-1 | ||
| Line 67: | Line 67: | ||
In the case where there is missing data, target revision becomes a range of: [target revision, revisions with missing data] | In the case where there is missing data, target revision becomes a range of: [target revision, revisions with missing data] | ||
This is important because we then have enough evidence to show that the regression is sustained through retriggers and over time. If there is suspect of alerts on other tests/platforms, please | This is important because we then have enough evidence to show that the regression is sustained through retriggers and over time. If there is suspect of alerts on other tests/platforms, please retrigger those as well. | ||
== Determining the scope of the regression from Perfherder == | == Determining the scope of the regression from Perfherder == | ||