Performance/Telemetry Regression Alerts

From MozillaWiki
Jump to navigation Jump to search

Overview

We have over 1,000 Telemetry probes so we need an automated way to monitor them for regressions. Noise is a major challenge, even more so than with Talos data, as Telemetry data is collected from a wide variety of computers, configurations and workloads. We require a reliable means of detecting regressions, improvements and changes in a measurement's distribution.

People

  • Roberto Vitillo: stats work
  • Mark Reid: Telemetry server-side changes
  • Avi Halachmi
  • Vladan Djeric
  • External contributors welcome, contact vdjeric@mozilla.com

Meeting notes

Tracking bug: bug 1031011

June 25, 2014: Initial meeting to discuss the approach & requirements