Previous Action Items

Status

• [gbrown] - Orange Factor review
  • last week's OF: 10.1
  • last month's OF: 13.4
  • Weekend spike in part due to DST bugs like bug 610183
• [jmaher] - played with [test-verification mode on try]. In this case running every mochitest through what we would do to verify a new test was stable. For the purposes of automation, it was scaled back to run faster:
  • launch the browser and run only the specified test, with --repeat 10
  • launch the browser and run only the specified test, do this 4 times
  • In summary, we have [~175 tests] which fail to run by themselves or with --repeat X, both on try (linux64 opt) and locally (win10 opt)

Discussion Topics

See etherpad for live notes

• [gbrown] - summary of findings from triaging bugs
  • use OrangeFactor or War on Orange report or NeglectedOranges to find bugs for frequent failures
  • examples: bug 1244707, bug 1304432
  • more thoughts in my blog
• [jmaher] - how to write a good test case. I would like to discuss and get ideas of what we should be doing to document and encourage good test case writing.
  • possibly lessons learned from [CPOWs]
  • ensuring [wiki] is up to date

New Ideas to investigate

• [jmaher] - fixing tests to be more reliable
• [gbrown] - modifying orange factor
  • bug 1315110, bug 1315275, bug 1315281 ... perhaps more to come, all blocking bug 1307197
• [TBD] - determining who is responsible for each test

Action Items

• Discussion topics for next time
  • [wlach] - debugging with 'rr'