Performance/Telemetry Regression Alerts: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(Initial outline)
 
Line 5: Line 5:
==People==
==People==


Roberto Vitillo: stats work
* Roberto Vitillo: stats work
Mark Reid: Telemetry server-side changes
* Mark Reid: Telemetry server-side changes
Avi Halachmi
* Avi Halachmi
Vladan Djeric
* Vladan Djeric
* External contributors welcome, contact vdjeric@mozilla.com


==Meeting notes==
==Meeting notes==

Revision as of 23:53, 26 June 2014

Overview

We have over 1,000 Telemetry probes so we need an automated way to monitor them for regressions. Noise is a major challenge, even more so than with Talos data, as Telemetry data is collected from a wide variety of computers, configurations and workloads. We require a reliable means of detecting regressions, improvements and changes in a measurement's distribution.

People

  • Roberto Vitillo: stats work
  • Mark Reid: Telemetry server-side changes
  • Avi Halachmi
  • Vladan Djeric
  • External contributors welcome, contact vdjeric@mozilla.com

Meeting notes

Tracking bug: bug 1031011

June 25, 2014: Initial meeting to discuss the approach & requirements