CloudServices/DataPipeline: Difference between revisions

m
formatting
m (formatting)
m (formatting)
Line 35: Line 35:
* Old-FHR data through pipeline? Yes/No: [telliot]
* Old-FHR data through pipeline? Yes/No: [telliot]
* Deletes & legal policy [telliot, mreid to provide cost estimate]
* Deletes & legal policy [telliot, mreid to provide cost estimate]
=== Needs more discussion ===
=== Needs more discussion ===
* Maintaining a sample data set for faster queries
* Maintaining a sample data set for faster queries
Line 48: Line 47:
* BI query example that cross references data sources
* BI query example that cross references data sources
** example: does fxa/sync increase browser usage?
** example: does fxa/sync increase browser usage?
=== To Do ===
=== To Do ===
* Q4 telemetry: (re) implement telemetry monitoring dashboards [?]
* Q4 telemetry: (re) implement telemetry monitoring dashboards [?]
Line 61: Line 59:
* Q1: implement best guess at per user sampling [trink]
* Q1: implement best guess at per user sampling [trink]
** follow up with saptarshi for more complex algorithm
** follow up with saptarshi for more complex algorithm
=== Doing ===
=== Doing ===
* Opsify stack [whd]
* Opsify stack [whd]
Line 68: Line 65:
* risk mitigation: Estimate cost of “full scan” DWH query [mreid]
* risk mitigation: Estimate cost of “full scan” DWH query [mreid]
* risk mitigation: Estimate cost of single DWH delete [mreid]
* risk mitigation: Estimate cost of single DWH delete [mreid]
=== Done ===
=== Done ===
* Parallelize sandbox filters (eg FHRSearch) [trink]
* Parallelize sandbox filters (eg FHRSearch) [trink]
* Enable Lua JIT [trink]
* Enable Lua JIT [trink]
Confirmed users
539

edits