Auto-tools/Projects/Signal From Noise/Q2

From MozillaWiki
< Auto-tools‎ | Projects‎ | Signal From Noise
Revision as of 14:20, 29 March 2012 by Jmaher (talk | contribs) (Created page with "= Overview = Continuing the https://wiki.mozilla.org/Auto-tools/Projects/Signal_From_Noise work done in Q1 to complete Signal From Noise. Now that we have an idea of how th...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

Overview

Continuing the [work done in Q1] to complete Signal From Noise. Now that we have an idea of how this stuff works, lets do this for all tests and create the tools for people to find regressions easier.

Goals

  • Deploy the new graph server in production
  • Send raw results to graph server
  • Create tools to reproduce and analyze local and buildbot runs

Milestone 1

  • Send raw results from all talos runs to new graph server
  • Have high level views in new graph server to achieve same functionality as existing graph server
  • Find 6 stakeholders who can participate for 30 minutes weekly to look at the new graph server and ensure it meets their needs
  • Do initial investigations of tsvg, tdhtml, ally, tscroll
  • Understand compare talos, dev.tree-planning email
    • Decide on set of features we care about for this

Milestone 2

  • Deploy tsvg and tdhtml with any recommendations
  • Deploy new graph server with basic functionality
  • Have new views in graph server for additional functionality
  • Document variance calculation and how to track it
    • ideally we would want to track this monthly
  • Have compare talos and similar tools working with patches and in staging

Milestone 3

  • Deploy ally and tscroll
  • Deploy automatic variance calculation
  • Deploy new compare talos
  • Deploy new features in graph server
Retrieved from "https://wiki.mozilla.org/index.php?title=Auto-tools/Projects/Signal_From_Noise/Q2&oldid=413726"