Performance/Telemetry Regression Alerts

From MozillaWiki
< Performance
Revision as of 23:52, 26 June 2014 by Vladan (talk | contribs) (Initial outline)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

Overview

We have over 1,000 Telemetry probes so we need an automated way to monitor them for regressions. Noise is a major challenge, even more so than with Talos data, as Telemetry data is collected from a wide variety of computers, configurations and workloads. We require a reliable means of detecting regressions, improvements and changes in a measurement's distribution.

People

Roberto Vitillo: stats work Mark Reid: Telemetry server-side changes Avi Halachmi Vladan Djeric

Meeting notes

Tracking bug: bug 1031011

June 25, 2014: Initial meeting to discuss the approach & requirements