Confirmed users
3,816
edits
Auto-tools/Projects/SfN 2013Q2: Difference between revisions
no edit summary
No edit summary |
|||
| (6 intermediate revisions by the same user not shown) | |||
| Line 19: | Line 19: | ||
** Data set ingestion rates per test per platform (ensuring we are getting the data) | ** Data set ingestion rates per test per platform (ensuring we are getting the data) | ||
** Page and pageset perf per machine per platform (identifying specific machine anomalies) | ** Page and pageset perf per machine per platform (identifying specific machine anomalies) | ||
* Begin analyzing data to optimize statistics for regression detection on each desktop Talos test (we are pretty good for tp5o, we need to look into Ts, Tsvg* and others) | * {{miss|Begin analyzing data to optimize statistics for regression detection on each desktop Talos test (we are pretty good for tp5o, we need to look into Ts, Tsvg* and others)}} | ||
** Understand if we need per-page optimizations as well for pages within pagesets (we likely do). | ** Understand if we need per-page optimizations as well for pages within pagesets (we likely do). | ||
* {{done|Analyze why we seem to not get data at times from certain platform/tree combinations.}} | * {{done|Analyze why we seem to not get data at times from certain platform/tree combinations.}} | ||
=== Milestone 2 - 2 weeks | === Milestone 2 - 2 weeks May 2 - May 16 === | ||
[Bug List: ] | [Bug List: ] | ||
* {{ | * {{miss|Develop and Deploy UI for time course data}} | ||
* Deploy changes to statistical calculations based on the analysis from test data | * Deploy changes to statistical calculations based on the analysis from test data | ||
* Fix issues w.r.t. why we are not getting data from certain platform/tree combinations | * {{done|Fix issues w.r.t. why we are not getting data from certain platform/tree combinations}} | ||
* Fix all desktop tests so that they are reporting to Datazilla | * Fix all desktop tests so that they are reporting to Datazilla | ||
=== Milestone 3 - 2 weeks | === Milestone 3 - 2 weeks May 20 === | ||
[Bug List: ] | [Bug List: ] | ||
* {{ok| (depends on ui for time course) Back fill schema with data for all projects and deploy to production}} | * {{ok| (depends on ui for time course) Back fill schema with data for all projects and deploy to production}} | ||
* Work out how to get try reporting to Datazilla by using mozilla-central as a base for the pushlog (this gives us an 80% usecase) | * {{ok| deploy time course onto production}} | ||
** Deploy try integration as a data source. | * {{drop|Work out how to get try reporting to Datazilla by using mozilla-central as a base for the pushlog (this gives us an 80% usecase)}} | ||
** {{drop|Deploy try integration as a data source.}} | |||
* {{risk|Begin analyzing data to optimize statistics for regression detection on each desktop Talos test (we are pretty good for tp5o, we need to look into Ts, Tsvg* and others}} | |||
=== Milestone 4 - 2 weeks (planned) === | |||
[Bug List: ] | |||
* Analyze the data and automatic regression emails coming in and verify that: | * Analyze the data and automatic regression emails coming in and verify that: | ||
** They are tracking graph server's/analyze_talos.py's regression emails (datazilla should be more sensitive than that method) | ** They are tracking graph server's/analyze_talos.py's regression emails (datazilla should be more sensitive than that method) | ||
| Line 40: | Line 45: | ||
** Use tools for sheriffing talos regressions, tweak as needed (find/fix) | ** Use tools for sheriffing talos regressions, tweak as needed (find/fix) | ||
* Continue analyzing the regressions coming in and the tools for sheriffing the talos regressions, tweak as needed. (find/fix) | * Continue analyzing the regressions coming in and the tools for sheriffing the talos regressions, tweak as needed. (find/fix) | ||