Performance/Telemetry Regression Alerts: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
Line 15: Line 15:
Tracking bug: {{bug|1031011}}
Tracking bug: {{bug|1031011}}


June 25, 2014: [https://etherpad.mozilla.org/telemetryAlertsJune25 Initial meeting to discuss the approach & requirements]
* June 25, 2014: [https://etherpad.mozilla.org/telemetryAlertsJune25 Initial meeting to discuss the approach & requirements]

Revision as of 23:54, 26 June 2014

Overview

We have over 1,000 Telemetry probes so we need an automated way to monitor them for regressions. Noise is a major challenge, even more so than with Talos data, as Telemetry data is collected from a wide variety of computers, configurations and workloads. We require a reliable means of detecting regressions, improvements and changes in a measurement's distribution.

People

  • Roberto Vitillo: stats work
  • Mark Reid: Telemetry server-side changes
  • Avi Halachmi
  • Vladan Djeric
  • External contributors welcome, contact vdjeric@mozilla.com

Meeting notes

Tracking bug: bug 1031011