canmove, Confirmed users, Bureaucrats and Sysops emeriti
1,334
edits
Sheriffing/Job Visibility Policy: Difference between revisions
Jump to navigation
Jump to search
→8) Must avoid patterns known to cause non deterministic failures: examples of time bombs
m (→8) Must avoid patterns known to cause non deterministic failures: Add link markup, sigh) |
(→8) Must avoid patterns known to cause non deterministic failures: examples of time bombs) |
||
| Line 65: | Line 65: | ||
** eg: Emulator/driver binaries direct from a vendor's site, package downloads from PyPi or page assets for unit/performance tests. | ** eg: Emulator/driver binaries direct from a vendor's site, package downloads from PyPi or page assets for unit/performance tests. | ||
** Ensure MOZ_DISABLE_NONLOCAL_CONNECTIONS is defined in the automation environment (see {{bug|995417}}) & use a list of automation prefs for switching off undesirable behaviour (eg automatic updates, telemetry pings; see {{bug|1023483}} for where these are set). | ** Ensure MOZ_DISABLE_NONLOCAL_CONNECTIONS is defined in the automation environment (see {{bug|995417}}) & use a list of automation prefs for switching off undesirable behaviour (eg automatic updates, telemetry pings; see {{bug|1023483}} for where these are set). | ||
* Must not contain time bombs, e.g. tests that will fail after a certain date or when run at certain times. | * Must not contain time bombs, e.g. tests that will fail after a certain date or when run at certain times (e.g., the day summer time starts or ends, or when the test starts before midnight and finishes after midnight). | ||
* See the [https://developer.mozilla.org/en-US/docs/Mozilla/QA/Avoiding_intermittent_oranges best practices for avoiding intermittent failures (oranges)]. | * See the [https://developer.mozilla.org/en-US/docs/Mozilla/QA/Avoiding_intermittent_oranges best practices for avoiding intermittent failures (oranges)]. | ||