Sheriffing/Job Visibility Policy: Difference between revisions

m
m (→‎Requesting changes in visibility: Mention CCing sheriffs)
Line 95: Line 95:
== Adding a new test task, or a new test platform? ==
== Adding a new test task, or a new test platform? ==
* Be sure to demonstrate an acceptable intermittent failure rate for your new test tasks on try, and include the try links in the bug which adds the new tasks. Usually that means repeating each new test task at least 10 times (try: --rebuild 10).  
* Be sure to demonstrate an acceptable intermittent failure rate for your new test tasks on try, and include the try links in the bug which adds the new tasks. Usually that means repeating each new test task at least 10 times (try: --rebuild 10).  
* For each known intermittent failure, check the expected frequency from recent comments in the bug, or by looking up the failure on Orange Factor; if you see higher failure rates in your try push, consider fixing or disabling the test(s) before enabling your new task(s).
* For each known intermittent failure, check the expected frequency from recent comments in the bug, or by looking up the failure in treeherder's Intermittent Failures view; if you see higher failure rates in your try push, consider fixing or disabling the test(s) before enabling your new task(s).


== My platform/test-suite does not meet the base requirements, what now? ==
== My platform/test-suite does not meet the base requirements, what now? ==
Confirmed users
1,759

edits