QA/Automation/Goals

Yearly Goals for 2014

Extend the work with the community and get them more integrated into our existing projects. As a result we want to have an average number of around 10 community members working on a weekly basis
Assist the QA team and each interested community member in every of our top-level projects, and help them pro-actively in improving their skills for defining and implementing automated tests and extending or fixing test framework features

Get the MetroFirefox tests running reliably (with a max 5% failure rate) in CI production at latest at Feb 12th
Setup testing environment for Firefox accounts before it gets shipped on March 17th and work with the A-Team if further help is necessary
Organize 2 Automation training testdays for contributors to get them started and guided through the lifecycle of the test creation process. Revamp the Crowd extension for a better start
Rework the software update tests to be based on a state machine, so that they are able to run multiple updates in a row

Getting PuppetAgain support for Ubuntu started so we can lower the amount of manual maintenance of the CI cluster in the future
Increase the number of Firefox locales to test by letting each locale run at least once a week