Data/Platform: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(add title)
(more edits)
Line 1: Line 1:
Firefox Data Platform
=Firefox Data Platform=
 
== Overview ==
The goal of the Fx Data Platform is to make trusted Firefox data available to product managers, engineers, analysts, and others working hard to make Firefox great. In particular, we work on:
The goal of the Fx Data Platform is to make trusted Firefox data available to product managers, engineers, analysts, and others working hard to make Firefox great. In particular, we work on:


* Data collection from the browsers ([[Telemetry]])
* '''[[Telemetry]]''': Data collection from the browsers
* Infrastructure for ingesting and storing data -- Telemetry as well as other sources ([[CloudServices/DataPipeline]])
* '''[[CloudServices/DataPipeline|Data Pipeline]]''': Infrastructure for ingesting and storing data -- Telemetry as well as other sources
* Tools for analyzing data (analysis.telemetry.mozilla.org)
* Tools for analyzing data ('''[https://analysis.telemetry.mozilla.org/ Spark]''', '''[https://sql.telemetry.mozilla.org/ Re:Dash]''')
* Making core data sets available for efficient analysis
* Making core data sets available for efficient analysis


== Contact info ==
=== Contact info ===
* [[IRC|#datapipeline, #telemetry on irc.mozilla.org]]
* [[IRC|#datapipeline, #telemetry on irc.mozilla.org]]
* [https://groups.google.com/a/mozilla.com/forum/#!forum/fx-data-platform Team mailing list], [https://mail.mozilla.org/listinfo/fhr-dev Telemetry users mailing list]
* [https://groups.google.com/a/mozilla.com/forum/#!forum/fx-data-platform Team mailing list], [https://mail.mozilla.org/listinfo/fhr-dev Telemetry users mailing list]
* [https://docs.google.com/document/d/1o6Oh1SOPSprjk1wc3pVqmJ5oPDxiFZoz1Ac4ZAyc2pw/edit Weekly meeting]
* [https://docs.google.com/document/d/1o6Oh1SOPSprjk1wc3pVqmJ5oPDxiFZoz1Ac4ZAyc2pw/edit Weekly meeting]


== Planning, Sprints, Projects ==
== Docs and Resources ==
* [https://trello.com/b/WSwz1Iz8/fx-data-platform-measurement-team| Trello Board (Roadmap)]
 
* [[Data/Platform/General sprint info|General sprint information]] (capacity, priority and packing)
=== Planning Documents ===
** Client Sprint <buglist>
* [https://trello.com/b/WSwz1Iz8/fx-data-platform-quarterly-work-plan| Quarterly Plan Trello Board]
** Infrastructure and Tools Sprint: [http://mzl.la/1hybMyP| Buglist]
* [https://trello.com/b/o7o6gxdj/fx-data-platform-mentored-project-dependencies| Mentored Projects Trello Board]
* Pipeline and Tools Buglist: http://mzl.la/1hybMyP
 
=== Sprints/Projects ===
* [[Data/Platform/General sprint info|Sprint process]]
* [[Unified Telemetry]] (Completed Nov 2015)
* [[Unified Telemetry]] (Completed Nov 2015)
=== Telemetry/Data/Analysis Docs ===
* [http://gecko.readthedocs.io/en/latest/toolkit/components/telemetry/telemetry/index.html Telemetry Data]
* [[Telemetry/Custom dashboards with re:dash]]
* [https://wiki.mozilla.org/Mobile/Metrics/Redash Mobile Metrics]
* [https://github.com/mozilla/testpilot/blob/master/docs/README-METRICS.md Test Pilot]
=== Code ===
* [https://wiki.mozilla.org/CloudServices/DataPipeline#V2_Pipeline| Ingestion pipeline]
* [https://wiki.mozilla.org/CloudServices/DataPipeline#Telemetry| Tools and analysis]


== People ==
== People ==
The team working on the Fx Data Platform are from different parts of the org, and work closely with many other teams. The core team:
The team working on the Fx Data Platform are from different parts of the org, and work closely with many other teams. The core team:
* Alessio Placitelli (:Dexter)
{|class="wikitable fullwidth-table"
* Blake Imsland (:robotblake)
| Dev + Analysis || Alessio Placitelli (:Dexter), Frank Bertsch, Georg Fritzsche, Jannis Leidel (:jezdez), Mark Reid, Mauro Doglio, Mike Trinkala (:trink), Rob Miller (:RaFromBRC), Roberto Vitillo, Ryan Harter (:harter)
* Georg Fritzsche
|-
* Katie Parlante
| Ops || Blake Imsland (:robotblake), Wesley Dawson (:whd)
* Mark Reid
|-
* Mauro Doglio
| Intern || Purush Swaminathan (:purush)
* Mike Trinkala (:trink)
|-
* Purush
| Test || John Dorlus (:Silne30)
* Rob Miller (:RaFromBRC)
|-
* Roberto Vitillo
| EPM || Thomas Huelbert (:thuelbert)  
* Thomas Huelbert (:thuelbert)
|-
* Wesley Dawson (:whd)
| Mgr || Katie Parlante, RyanVM
* Ryan Harter (:harter)
|}

Revision as of 23:38, 2 August 2016

Firefox Data Platform

The goal of the Fx Data Platform is to make trusted Firefox data available to product managers, engineers, analysts, and others working hard to make Firefox great. In particular, we work on:

  • Telemetry: Data collection from the browsers
  • Data Pipeline: Infrastructure for ingesting and storing data -- Telemetry as well as other sources
  • Tools for analyzing data (Spark, Re:Dash)
  • Making core data sets available for efficient analysis

Contact info

Docs and Resources

Planning Documents

Sprints/Projects

Telemetry/Data/Analysis Docs

Code

People

The team working on the Fx Data Platform are from different parts of the org, and work closely with many other teams. The core team:

Dev + Analysis Alessio Placitelli (:Dexter), Frank Bertsch, Georg Fritzsche, Jannis Leidel (:jezdez), Mark Reid, Mauro Doglio, Mike Trinkala (:trink), Rob Miller (:RaFromBRC), Roberto Vitillo, Ryan Harter (:harter)
Ops Blake Imsland (:robotblake), Wesley Dawson (:whd)
Intern Purush Swaminathan (:purush)
Test John Dorlus (:Silne30)
EPM Thomas Huelbert (:thuelbert)
Mgr Katie Parlante, RyanVM
Retrieved from "https://wiki.mozilla.org/index.php?title=Data/Platform&oldid=1142411"