Event Telemetry

The Telemetry wiki page has more information about using Telemetry -- this page describes the Event Telemetry project.

Overview

There is a common need across teams (fx-team, mobile, test-pilot, heartbeat, …) to have a mechanism for recording, storing, sending & analysing application usage in an event-oriented format. The Data Platform team wants to support this with a common API and mechanisms for dealing with the collected data, without owning the individual measurements. The solution here is to provide common client code, a standard data format, so we can come up with common processes and tooling for data pipeline & analysis work. Historically we already send a form of UITelemetry data, but the current format is too complicated to work with and to maintain.

Dates

• ...: Event data explorable in re:dash (from pre-release channels)
• Fx52 (~2017-03-07): Event data collection implemented in Firefox Telemetry

Goals for Event Telemetry

• Enable exploratory usage behavior analysis
• Enable event data collection from Firefox and addons

Documentation

• Event Telemetry draft
• In-tree docs (to be written)

Analysis and Reporting

• Raw data using a spark cluster: https://telemetry-dash.mozilla.org/
• re:dash event data tables

Project

Client work

• Backlog as spreadsheet, with estimates
• Bug tree, phase 4: https://bugzilla.mozilla.org/show_bug.cgi?id=1122482
• Bug tree, phase 3: https://bugzilla.mozilla.org/show_bug.cgi?id=1120356 (Done)
• Bug tree, phase 2: https://bugzilla.mozilla.org/show_bug.cgi?id=1069869 (Done)
• Bug tree, phase 1: https://bugzilla.mozilla.org/show_bug.cgi?id=1040800 (Done)

Pipeline work

• Bugzilla: http://mzl.la/1KWiNST

Event Implementation Plan

• List of Event groups, events, owners etc

Client Testing

• Test cases document
• Spreadsheet to track testing

Communication

• Conversation about Event telemetry on fhr-dev: https://mail.mozilla.org/listinfo/fhr-dev
• Data verification meeting notes: https://etherpad.mozilla.org/fhr-v4-status
• IRC: #telemetry, #datapipeline, #metrics
• Weekly Meeting notes
• EPM reports

Resources / Notes

• Kickoff document
  • "Query Requirements" section has list of sample queries/questions that get asked frequently of FHR data
• Event Telemetry Data sets discussion

People and Roles

• Georg Fritzsche
• Alessio Placitelli, :Dexter (client data collection)
• Mark Reid (data pipeline, telemetry server)
• Roberto Vitillo
• Sunah Suh (Analysis)
• Rebecca Weiss (PM)
• Ilana Segall (Analysis)
• John Dorlus (Quality Engineering)
• Roberto Vitillo (Spark analysis tool, telemetry data validation)
• Thomas Huelbert (project management)