canmove, Confirmed users
1,126
edits
Sheriffing/Test Disabling Policy: Difference between revisions
m
Correct OrangeFactor link
(→Exceptions: 48 hours is too short to notice, file, notice frequent & recently landed; changing to 7 days) |
m (Correct OrangeFactor link) |
||
| Line 4: | Line 4: | ||
This policy will define an escalation path for when a single test case is identified to be leaking or failing and is causing enough disruption on the trees. Disruption is defined as any of: | This policy will define an escalation path for when a single test case is identified to be leaking or failing and is causing enough disruption on the trees. Disruption is defined as any of: | ||
* Test case is on the list of top 20 intermittent failures on [[http://brasstacks.mozilla.com/orangefactor/ | * Test case is on the list of top 20 intermittent failures on [[http://brasstacks.mozilla.com/orangefactor/ Orange Factor]] | ||
* It is causing oranges >=8% of the time | * It is causing oranges >=8% of the time | ||
* We have >100 instances of this failure in the bug in the last 30 days | * We have >100 instances of this failure in the bug in the last 30 days | ||