Confirmed users
539
edits
CloudServices/DataPipeline: Difference between revisions
m
formatting
m (formatting) |
m (formatting) |
||
| Line 35: | Line 35: | ||
* Old-FHR data through pipeline? Yes/No: [telliot] | * Old-FHR data through pipeline? Yes/No: [telliot] | ||
* Deletes & legal policy [telliot, mreid to provide cost estimate] | * Deletes & legal policy [telliot, mreid to provide cost estimate] | ||
=== Needs more discussion === | === Needs more discussion === | ||
* Maintaining a sample data set for faster queries | * Maintaining a sample data set for faster queries | ||
| Line 48: | Line 47: | ||
* BI query example that cross references data sources | * BI query example that cross references data sources | ||
** example: does fxa/sync increase browser usage? | ** example: does fxa/sync increase browser usage? | ||
=== To Do === | === To Do === | ||
* Q4 telemetry: (re) implement telemetry monitoring dashboards [?] | * Q4 telemetry: (re) implement telemetry monitoring dashboards [?] | ||
| Line 61: | Line 59: | ||
* Q1: implement best guess at per user sampling [trink] | * Q1: implement best guess at per user sampling [trink] | ||
** follow up with saptarshi for more complex algorithm | ** follow up with saptarshi for more complex algorithm | ||
=== Doing === | === Doing === | ||
* Opsify stack [whd] | * Opsify stack [whd] | ||
| Line 68: | Line 65: | ||
* risk mitigation: Estimate cost of “full scan” DWH query [mreid] | * risk mitigation: Estimate cost of “full scan” DWH query [mreid] | ||
* risk mitigation: Estimate cost of single DWH delete [mreid] | * risk mitigation: Estimate cost of single DWH delete [mreid] | ||
=== Done === | === Done === | ||
* Parallelize sandbox filters (eg FHRSearch) [trink] | * Parallelize sandbox filters (eg FHRSearch) [trink] | ||
* Enable Lua JIT [trink] | * Enable Lua JIT [trink] | ||