Confirmed users
3,376
edits
Auto-tools/Projects/Signal From Noise/Meetings/2012-05-10: Difference between revisions
Jump to navigation
Jump to search
Auto-tools/Projects/Signal From Noise/Meetings/2012-05-10 (view source)
Revision as of 17:58, 10 May 2012
, 10 May 2012→Round Table
(Created page with "= Previous Action Items = * [ctalbert,carljm,jhammel,jmaher] - look at datazilla VM * [jmaher] - identify tp5 tests that hit the internet, give christina set of numbers with thos...") |
|||
| Line 13: | Line 13: | ||
= Round Table = | = Round Table = | ||
* proposal for moving forward | |||
** focus on tdhtml and tsvg as page centric | |||
*** find a model for pages that can detect regressions with a single new data point | |||
*** display data on graphs for investigation purposes | |||
*** determine a metric to report for pass fail purposes and tracking as a page set (mochitests have pass/fail/todo, and if 1 test fails, we turn the job orange, maybe we do something similar here) | |||
** if a page doesn't fit a model then lets not run it and file a bug to investigate the page (80/20 rule here) | |||
** consider a maybe flag (probably orange) which doesn't match our model, but we cannot determine programatically that it is a regressions or measurable improvement. | |||
= Action Items = | = Action Items = | ||