160
edits
TestEngineering/Performance/Sheriffing/Alerts: Difference between revisions
Jump to navigation
Jump to search
TestEngineering/Performance/Sheriffing/Alerts (view source)
Revision as of 09:06, 16 January 2018
, 16 January 2018platform_microbench description
(awsy info) |
(platform_microbench description) |
||
| Line 7: | Line 7: | ||
=== Talos === | === Talos === | ||
* short description: [https://wiki.mozilla.org/index.php?title=Buildbot/Talos/Tests link] | * short description: <provide it> [https://wiki.mozilla.org/index.php?title=Buildbot/Talos/Tests link] | ||
* frequency: daily, little more than a dozen alerts | * frequency: daily, little more than a dozen alerts | ||
* [https://wiki.mozilla.org/Buildbot/Talos/Sheriffing/Tree_FAQ#What_is_coalescing coalesced] by SETA?: yes (often requires backfilling) | * [https://wiki.mozilla.org/Buildbot/Talos/Sheriffing/Tree_FAQ#What_is_coalescing coalesced] by SETA?: yes (often requires backfilling) | ||
* available on platforms: | * available on platforms: | ||
** Windows: 7 32bit, 10 64bit (OPT, PGO builds) | |||
** Linux: 64bit (OPT, PGO builds) | ** Linux: 64bit (OPT, PGO builds) | ||
** OS X: 10.10 (OPT builds only) | ** OS X: 10.10 (OPT builds only) | ||
* triaging specifics: | * triaging specifics: | ||
| Line 21: | Line 21: | ||
* [https://wiki.mozilla.org/Buildbot/Talos/Sheriffing/Tree_FAQ#What_is_coalescing coalesced] by SETA?: no (doesn't require backfilling) | * [https://wiki.mozilla.org/Buildbot/Talos/Sheriffing/Tree_FAQ#What_is_coalescing coalesced] by SETA?: no (doesn't require backfilling) | ||
* available on platforms: | * available on platforms: | ||
** Windows: 32/64bit (OPT, No-OPT, Mingw builds) | |||
** Linux: 32/64bit (OPT, No-OPT builds) | ** Linux: 32/64bit (OPT, No-OPT builds) | ||
** OS X: 10.10 (cross, no-cross builds) | ** OS X: 10.10 (cross, no-cross builds) | ||
** Android: 4.0, 4.2, 5.0 | ** Android: 4.0, 4.2, 5.0 | ||
| Line 32: | Line 32: | ||
=== Autophone === | === Autophone === | ||
=== AWSY === | === AWSY === | ||
* short description: [https://wiki.mozilla.org/AWSY/Tests link] | * short description: <provide it> [https://wiki.mozilla.org/AWSY/Tests link] | ||
* frequency: every 2-3 days, around half a dozen | * frequency: every 2-3 days, around half a dozen | ||
* contact: :erahm | * contact: :erahm | ||
* [https://wiki.mozilla.org/Buildbot/Talos/Sheriffing/Tree_FAQ#What_is_coalescing coalesced] by SETA?: yes | * [https://wiki.mozilla.org/Buildbot/Talos/Sheriffing/Tree_FAQ#What_is_coalescing coalesced] by SETA?: yes | ||
* available on platforms: | * available on platforms: | ||
** Windows: 32/64bit (OPT, PGO builds) | |||
** Linux: 64bit (OPT builds) | ** Linux: 64bit (OPT builds) | ||
** OS X: 10.10 (OPT builds) | ** OS X: 10.10 (OPT builds) | ||
** Android: 4.2, 4.3 (OPT builds) | ** Android: 4.2, 4.3 (OPT builds) | ||
| Line 44: | Line 44: | ||
** retriggering/backfilling takes some time (>1h per test), so one must not abuse in collecting missing graph data | ** retriggering/backfilling takes some time (>1h per test), so one must not abuse in collecting missing graph data | ||
=== platform_microbench === | === platform_microbench === | ||
* short description: <provide it> | |||
* frequency: daily, around 1-2 dozen alerts | |||
* contact: | |||
* [https://wiki.mozilla.org/Buildbot/Talos/Sheriffing/Tree_FAQ#What_is_coalescing coalesced] by SETA?: yes | |||
* available on platforms: | |||
** Linux: 32bit (OPT builds), 64bit (OPT, PGO, ASAN builds) | |||
** Windows: 7 32bit, 10 64bit (OPT builds) | |||
** OS X: 10.10 (OPT builds) | |||
* triaging specifics: | |||
** happen very often; unless triaged, they quickly pile up | |||
** very noisy alerts; often many of the alerts turn out to be invalid | |||
** cheap to retrigger, as each test takes <20min to finish; still, one should not abuse this | |||