Auto-tools/Projects/Signal From Noise/Meetings/2013-03-28

From MozillaWiki
Jump to: navigation, search

Previous Action Items

  • [all, future] come up with a solution for retriggers
  • [jeads] outline possible corner cases where we need a solution (i.e. thresholds)
    • [jmaher, all] work with perf team to solve this, ideally per page
  • [all, future] start verifying other data, tsvg*
    • future data to verify would be ts* and counters
  • [all] turn jobs orange for tp5n
    • [jeads] - webservice for getting previous trend mean and current assessment during upload
    • [jmaher] - use new webservice, ensure job is orange from buildbot->tbpl

Datazilla

Talos

  • concern about tp5 from John Daggett, specifically about font-loading/caching and how slowing down font rendering doesn't affect tp5 numbers.
    • considering making a tFont metric
  • bug 845943 - tscroll is not very useful
    • bug 848358 - considering adding a new useful test and possibly rebuilding tscroll to be more accurate

Future

  • BenWa has proposed adding thresholds per test to the tree, everything outside the threshold would be orange and require a perf sherriff to adjust the value. (carry over)
  • we should still consider looking at the hardware pool
    • Consider splitting hardware pool
    • Consider running talos on a few builds on a set of machines over and over to see what noise metrics we get (see how much noise is based on differences in machines versus in the build and install of the product)

Round Table