Auto-tools/Projects/Signal From Noise/Meetings/2012-09-20

From MozillaWiki
Jump to: navigation, search

Previous Action Items

  • consider pulling tests out which have a zero std deviation
    • back shelved this until d.m.o/talos has a couple weeks of useful data


Regression/Improvement Auto Detection

Talos (code, deployment)

  • need to add talos commands to mach (i.e. 'mach talos dromaeojs')
    • need to test with mozharness script


  • some new graphics/canvas benchmarks in the works
  • tp5n for windows with accessibility turned on
  • possibly more updates to a11y tests this quarter
  • bug 770718 - possibly websockets tests (connections/sec, MB/sec, packets/second) this quarter, including using stoneridge. Estimate a week of work to do this, P2 for now
  • tdhml needs an overhaul, low priority

Round Table

  • [jmaher] Q4 Goals
    • data accuracy in datazilla and tools to investigate and report
    • test definitions in m-c? consumed by buildbot/talos/datazilla/etc...
    • solve the needs of developers investigating a performance regression with UI or other tools
      • solve the needs of a sheriff with UI or other tools (stretch)
    • mobile benchmarks (network loads vs other browsers)

Action Items

  • resolve android/fennec version number, also ensure product/os are proper
  • resolve redhat os naming