TestEngineering/Performance/Sheriffing/Alerts: Difference between revisions

Jump to navigation Jump to search
no edit summary
No edit summary
 
Line 15: Line 15:
** OS X: 10.10 (OPT builds only)
** OS X: 10.10 (OPT builds only)
* triaging specifics:
* triaging specifics:
=== build_metrics ===
=== build_metrics ===
* short description: Monitor build times on multiple platforms, the size of the installers and other compiler-specific insights.
* short description: Monitor build times on multiple platforms, the size of the installers and other compiler-specific insights.
Line 30: Line 31:
** when investigating, one should look for build config changes <ask :gps to provide more data>
** when investigating, one should look for build config changes <ask :gps to provide more data>
** build times often spike upwards for just a short time; they then lower to previous levels thanks to caching mechanisms set in place. We mark these as invalid alerts.
** build times often spike upwards for just a short time; they then lower to previous levels thanks to caching mechanisms set in place. We mark these as invalid alerts.
=== Autophone ===
 
* short description: Monitors mobile performance of browser ([https://wiki.mozilla.org/EngineeringProductivity/Autophone more details])
* frequency: every week or so, around 4 alerts
* contact: :bc:
* coalesced by SETA?: no
* available on platforms:
** Android: 4.2, 4.4, 6.0, 7.1
* triaging specifics:
** when investigating, one should look for Android related changes
** many of these tests are pretty noisy; often, they turn out to be invalid (one reason is devices overheat, which affects tests)
** should consider to needinfo? :bc:, to check status of suspect phone devices
** tricky to investigate; consider using also [http://phonedash.mozilla.org/ Phonedash], as it's a more precise investigation tool for mobile regressions
** retriggers are almost always needed, but results show up after a day or so
=== AWSY ===
=== AWSY ===
* short description: Are We Slim Yet monitors memory consumption by the browser ([https://wiki.mozilla.org/AWSY/Tests more details])
* short description: Are We Slim Yet monitors memory consumption by the browser ([https://wiki.mozilla.org/AWSY/Tests more details])
Confirmed users
2,197

edits

Navigation menu