Data/Platform: Difference between revisions

more edits
(add title)
(more edits)
Line 1: Line 1:
Firefox Data Platform
=Firefox Data Platform=
 
== Overview ==
The goal of the Fx Data Platform is to make trusted Firefox data available to product managers, engineers, analysts, and others working hard to make Firefox great. In particular, we work on:
The goal of the Fx Data Platform is to make trusted Firefox data available to product managers, engineers, analysts, and others working hard to make Firefox great. In particular, we work on:


* Data collection from the browsers ([[Telemetry]])
* '''[[Telemetry]]''': Data collection from the browsers
* Infrastructure for ingesting and storing data -- Telemetry as well as other sources ([[CloudServices/DataPipeline]])
* '''[[CloudServices/DataPipeline|Data Pipeline]]''': Infrastructure for ingesting and storing data -- Telemetry as well as other sources
* Tools for analyzing data (analysis.telemetry.mozilla.org)
* Tools for analyzing data ('''[https://analysis.telemetry.mozilla.org/ Spark]''', '''[https://sql.telemetry.mozilla.org/ Re:Dash]''')
* Making core data sets available for efficient analysis
* Making core data sets available for efficient analysis


== Contact info ==
=== Contact info ===
* [[IRC|#datapipeline, #telemetry on irc.mozilla.org]]
* [[IRC|#datapipeline, #telemetry on irc.mozilla.org]]
* [https://groups.google.com/a/mozilla.com/forum/#!forum/fx-data-platform Team mailing list], [https://mail.mozilla.org/listinfo/fhr-dev Telemetry users mailing list]
* [https://groups.google.com/a/mozilla.com/forum/#!forum/fx-data-platform Team mailing list], [https://mail.mozilla.org/listinfo/fhr-dev Telemetry users mailing list]
* [https://docs.google.com/document/d/1o6Oh1SOPSprjk1wc3pVqmJ5oPDxiFZoz1Ac4ZAyc2pw/edit Weekly meeting]
* [https://docs.google.com/document/d/1o6Oh1SOPSprjk1wc3pVqmJ5oPDxiFZoz1Ac4ZAyc2pw/edit Weekly meeting]


== Planning, Sprints, Projects ==
== Docs and Resources ==
* [https://trello.com/b/WSwz1Iz8/fx-data-platform-measurement-team| Trello Board (Roadmap)]
 
* [[Data/Platform/General sprint info|General sprint information]] (capacity, priority and packing)
=== Planning Documents ===
** Client Sprint <buglist>
* [https://trello.com/b/WSwz1Iz8/fx-data-platform-quarterly-work-plan| Quarterly Plan Trello Board]
** Infrastructure and Tools Sprint: [http://mzl.la/1hybMyP| Buglist]
* [https://trello.com/b/o7o6gxdj/fx-data-platform-mentored-project-dependencies| Mentored Projects Trello Board]
* Pipeline and Tools Buglist: http://mzl.la/1hybMyP
 
=== Sprints/Projects ===
* [[Data/Platform/General sprint info|Sprint process]]
* [[Unified Telemetry]] (Completed Nov 2015)
* [[Unified Telemetry]] (Completed Nov 2015)
=== Telemetry/Data/Analysis Docs ===
* [http://gecko.readthedocs.io/en/latest/toolkit/components/telemetry/telemetry/index.html Telemetry Data]
* [[Telemetry/Custom dashboards with re:dash]]
* [https://wiki.mozilla.org/Mobile/Metrics/Redash Mobile Metrics]
* [https://github.com/mozilla/testpilot/blob/master/docs/README-METRICS.md Test Pilot]
=== Code ===
* [https://wiki.mozilla.org/CloudServices/DataPipeline#V2_Pipeline| Ingestion pipeline]
* [https://wiki.mozilla.org/CloudServices/DataPipeline#Telemetry| Tools and analysis]


== People ==
== People ==
The team working on the Fx Data Platform are from different parts of the org, and work closely with many other teams. The core team:
The team working on the Fx Data Platform are from different parts of the org, and work closely with many other teams. The core team:
* Alessio Placitelli (:Dexter)
{|class="wikitable fullwidth-table"
* Blake Imsland (:robotblake)
| Dev + Analysis || Alessio Placitelli (:Dexter), Frank Bertsch, Georg Fritzsche, Jannis Leidel (:jezdez), Mark Reid, Mauro Doglio, Mike Trinkala (:trink), Rob Miller (:RaFromBRC), Roberto Vitillo, Ryan Harter (:harter)
* Georg Fritzsche
|-
* Katie Parlante
| Ops || Blake Imsland (:robotblake), Wesley Dawson (:whd)
* Mark Reid
|-
* Mauro Doglio
| Intern || Purush Swaminathan (:purush)
* Mike Trinkala (:trink)
|-
* Purush
| Test || John Dorlus (:Silne30)
* Rob Miller (:RaFromBRC)
|-
* Roberto Vitillo
| EPM || Thomas Huelbert (:thuelbert)  
* Thomas Huelbert (:thuelbert)
|-
* Wesley Dawson (:whd)
| Mgr || Katie Parlante, RyanVM
* Ryan Harter (:harter)
|}
Confirmed users
539

edits