CloudServices/DataPipeline: Difference between revisions
Jump to navigation
Jump to search
(Created page with "= Overview = Cloud services infrastructure for ingesting data, performing some processing tasks before routing it to other services for monitoring and reporting. The pipeline...") |
m (broken link) |
||
| Line 5: | Line 5: | ||
* IRC channel: #datapipeline | * IRC channel: #datapipeline | ||
* [https://docs.google.com/a/mozilla.com/document/d/1tzPc9hIACNi07psaQEKfpYQho8wuObC_BkMg3QEDIwA/edit#heading=h.vbs9qotdifjb Pipeline technical proposal] | * [https://docs.google.com/a/mozilla.com/document/d/1tzPc9hIACNi07psaQEKfpYQho8wuObC_BkMg3QEDIwA/edit#heading=h.vbs9qotdifjb Pipeline technical proposal] | ||
* [ https://docs.google.com/a/mozilla.com/document/d/1QGiXfQ0AHCkJNXfMPArjab8Gq8zIdqDopCBr-1qD3sc/edit?usp=sharing Reporting and monitoring overview] | * [https://docs.google.com/a/mozilla.com/document/d/1QGiXfQ0AHCkJNXfMPArjab8Gq8zIdqDopCBr-1qD3sc/edit?usp=sharing Reporting and monitoring overview] | ||
Revision as of 22:08, 18 December 2014
Overview
Cloud services infrastructure for ingesting data, performing some processing tasks before routing it to other services for monitoring and reporting. The pipeline is currently used for processing cloud services server logs. We're in the process of improving it to support desktop and device telemetry data.
Resources
- IRC channel: #datapipeline
- Pipeline technical proposal
- Reporting and monitoring overview