Sheriffing/Job Visibility Policy: Difference between revisions

Sheriffing/Job Visibility Policy (view source)

Revision as of 21:37, 30 August 2017

2 bytes removed , 30 August 2017

→‎Adding a new test task, or a new test platform?

Gbrown

Confirmed users

1,759

edits

@@ Line 90: / Line 90: @@
 * Please file a bug using this [https://bugzilla.mozilla.org/enter_bug.cgi?cc=sheriffs%40mozilla.bugs&comment=Job%2Fplatform%20ZZZZZZ%20now%20meets%20the%20requirements%20at%3A%0D%0Ahttps%3A%2F%2Fwiki.mozilla.org%2FSheriffing%2FJob_Visibility_Policy%0D%0A%0D%0APlease%20may%20it%20be%20unhidden&component=Treeherder&op_sys=All&product=Tree+Management&rep_platform=All&short_desc=Please%20unhide%20job%2Fplatform%20ZZZZZZ%20on%20Treeherder template], so that changes in visibility are more discoverable (vs IRC or asking as part of a bug in another product/component) and reasoning/history is preserved.
 == Adding a new test task, or a new test platform? ==
-Be sure to demonstrate an acceptable intermittent failure rate for your new test tasks on try, and include the try links in the bug which adds the new tasks. Usually that means repeating each new test task at least 10 times (try: --rebuild 10). For each known intermittent failure, check the expected frequency from recent comments in the bug, or by looking up the failure on Orange Factor; if you are seeing higher failure rates in your try push, consider fixing or disabling the test(s) before enabling your new task(s).
+* Be sure to demonstrate an acceptable intermittent failure rate for your new test tasks on try, and include the try links in the bug which adds the new tasks. Usually that means repeating each new test task at least 10 times (try: --rebuild 10).
+* For each known intermittent failure, check the expected frequency from recent comments in the bug, or by looking up the failure on Orange Factor; if you see higher failure rates in your try push, consider fixing or disabling the test(s) before enabling your new task(s).
 == My platform/test-suite does not meet the base requirements, what now? ==