Previous Action Items

• consider pulling tests out which have a zero std deviation
  • back shelved this until d.m.o/talos has a couple weeks of useful data

Datazilla

Regression/Improvement Auto Detection

Talos (code, deployment)

• need to add talos commands to mach (i.e. 'mach talos dromaeojs')
  • need to test with mozharness script

Tests

• some new graphics/canvas benchmarks in the works

• tp5n for windows with accessibility turned on
• possibly more updates to a11y tests this quarter
• bug 770718 - possibly websockets tests (connections/sec, MB/sec, packets/second) this quarter, including using stoneridge. Estimate a week of work to do this, P2 for now
• tdhml needs an overhaul, low priority

Round Table

• [jmaher] Q4 Goals
  • data accuracy in datazilla and tools to investigate and report
  • test definitions in m-c? consumed by buildbot/talos/datazilla/etc...
  • solve the needs of developers investigating a performance regression with UI or other tools
    • solve the needs of a sheriff with UI or other tools (stretch)
  • mobile benchmarks (network loads vs other browsers)

Action Items

• resolve android/fennec version number, also ensure product/os are proper
• resolve redhat os naming