Telemetry: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(→‎Firefox Devs: + analysis quirks)
Line 15: Line 15:


===Firefox Devs===
===Firefox Devs===
'''Telemetry client-side:'''
* [https://developer.mozilla.org/en-US/docs/Performance/Adding_a_new_Telemetry_probe MDN: Adding a new Telemetry probe]
* [https://developer.mozilla.org/en-US/docs/Performance/Adding_a_new_Telemetry_probe MDN: Adding a new Telemetry probe]
** [[Firefox/Data_Collection|Data collection policy]]
** [[Firefox/Data_Collection|Data collection policy]]
* [[Telemetry/Experiments|Telemetry Experiments]]
* [[Performance#Tools|Dashboards & tools built on Telemetry]]
* [https://ci.mozilla.org/job/mozilla-central-docs/Tree_Documentation/ Telemetry ping format (in-tree documentation)]
* [https://ci.mozilla.org/job/mozilla-central-docs/Tree_Documentation/ Telemetry ping format (in-tree documentation)]
** [https://github.com/mozilla/telemetry-server/blob/master/docs/PayloadFormat.md Older ping formats]
** [https://github.com/mozilla/telemetry-server/blob/master/docs/PayloadFormat.md Older ping formats]
* Telemetry health:
** [[Telemetry/Errata|Telemetry Errata: outages & known issues with collected Telemetry data]]
** [https://twitter.com/MozTelemetry Telemetry Twitter account]
** [http://ec2-50-112-66-71.us-west-2.compute.amazonaws.com:4352/# Heka dashboard showing Telemetry health], in particular the page showing [http://ec2-50-112-66-71.us-west-2.compute.amazonaws.com:4352/#sandboxes/TelemetryChannelMetrics60DaysAggregator/outputs/TelemetryChannelMetrics60DaysAggregator.nightly.cbuf submission rates & sizes]
* New "unified" Telemetry that replaces FHR's role
** [[Unified_Telemetry|Overview]]
** Unification progress: [https://bugzilla.mozilla.org/show_bug.cgi?id=1122515 tracking bug]
* Custom payloads uploaded by Telemetry:
* Custom payloads uploaded by Telemetry:
** [[Loop/Telemetry#Telemetry_Metrics|Loop (aka Firefox Hello) "ICE Failures" payload (with payload.reason="loop")]]
** [[Loop/Telemetry#Telemetry_Metrics|Loop (aka Firefox Hello) "ICE Failures" payload (with payload.reason="loop")]]
** ...there are others
** ...there are others
* Code repos:
* [[Telemetry/Experiments|Telemetry Experiments]]
** [http://mxr.mozilla.org/mozilla-central/source/toolkit/components/telemetry/ Telemetry code in desktop Firefox]
 
** [https://github.com/mozilla/telemetry-dashboard/ Telemetry dashboard code]
'''Analyzing Telemetry:'''
** [https://github.com/mozilla/telemetry-server/ AWS Telemetry backend code] - soon to be superceded by the next generation backend
* [[Performance#Tools|List of Telemetry tools (dashboards, custom analyses, and others)]]
*** [https://github.com/mozilla/telemetry-aggregator Telemetry backend code for aggregating histograms]
* [http://anthony-zhang.me/blog/telemetry-demystified/ Telemetry analysis & dashboarding overview]
* Custom analysis jobs:
* Writing custom analysis jobs:
** [http://www.robertovitillo.com/2015/01/16/next-gen-data-analysis-framework-for-telemetry/ Launch an ad-hoc analysis cluster]
** [http://www.robertovitillo.com/2015/01/16/next-gen-data-analysis-framework-for-telemetry/ Launch an ad-hoc analysis cluster]
** [http://www.robertovitillo.com/2015/03/13/simple-dashboards-with-scheduled-spark-jobs-and-plotly/ Scheduling a custom analysis job]
** [http://www.robertovitillo.com/2015/03/13/simple-dashboards-with-scheduled-spark-jobs-and-plotly/ Scheduling a custom analysis job]
** [[Telemetry/Quirks|Telemetry Quirks: things to watch out for when analysing Telemetry data]]
** [[Telemetry/Quirks|Telemetry Quirks: things to watch out for when analysing Telemetry data]]
* [[CloudServices/DataPipeline|Telemetry Server-side development documentation]]
** [[CloudServices/DataPipeline|Telemetry Server-side development documentation]]
 
'''Telemetry status:'''
* [[Telemetry/Errata|Telemetry Errata: outages & known issues with collected Telemetry data]]
* [https://twitter.com/MozTelemetry Telemetry Twitter account]
* [http://ec2-50-112-66-71.us-west-2.compute.amazonaws.com:4352/# Heka dashboard showing Telemetry health], in particular the page showing [http://ec2-50-112-66-71.us-west-2.compute.amazonaws.com:4352/#sandboxes/TelemetryChannelMetrics60DaysAggregator/outputs/TelemetryChannelMetrics60DaysAggregator.nightly.cbuf submission rates & sizes]
 
'''New "unified" Telemetry that replaces FHR:'''
* [http://anthony-zhang.me/blog/telemetry-demystified/ Unified Telemetry overview #1]
* [[Unified_Telemetry|Overview #2]]
** Unification progress: [https://bugzilla.mozilla.org/show_bug.cgi?id=1122515 tracking bug]
 
'''Code:'''
* [http://mxr.mozilla.org/mozilla-central/source/toolkit/components/telemetry/ Telemetry code in desktop Firefox]
* [https://github.com/mozilla/telemetry-dashboard/ Telemetry dashboard code]
* [https://github.com/mozilla/telemetry-server/ AWS Telemetry backend code] - soon to be superceded by the next generation backend
** [https://github.com/mozilla/telemetry-aggregator Telemetry backend code for aggregating histograms]


== Filing Bugs ==
== Filing Bugs ==

Revision as of 15:13, 9 September 2015

Telemetry

It's helpful for Mozilla's engineers to be able to measure how Firefox behaves in the real world. The Telemetry feature provides this capability by sending performance and usage info to Mozilla. As you use Firefox, Telemetry measures and collects non-personal information, such as performance, hardware, usage and customizations. It then sends this information to Mozilla on a daily basis and we use it to improve Firefox.

Accessing Telemetry Data

Aggregate Telemetry data from all submissions can be viewed on the Telemetry dashboard at telemetry.mozilla.org.

Instance Telemetry data (collected in your browser) can be viewed by typing about:telemetry into the Firefox URL bar.

Documentation

Firefox Users

Firefox Devs

Telemetry client-side:

Analyzing Telemetry:

Telemetry status:

New "unified" Telemetry that replaces FHR:

Code:

Filing Bugs

Telemetry client (in product) bugs should be filed in Toolkit::Telemetry.

Telemetry dashboard bugs should be filed in Webtools::Telemetry Dashboard

Telemetry data related bugs should be filed in Webtools::Telemetry Server

Communication

Communication Type Mechanism Audience
Asking questions #telemetry on irc.mozilla.org devs
General discussion dev-platform and fhr-dev list devs
Announcements dev-platform, dev-planning lists all

People

Project Champion
Program Management
Product Benjamin Smedberg, Vladan Djeric
UX
Client Engineering Vladan Djeric, Georg Fritzsche, Alessio Placitelli
Server Engineering Mark Reid
Data Analysis Roberto Vitillo
Privacy Sid Stamm
Legal Jishnu Menon

Reference

Out of date: