Auto-tools/Goals/2013Q2
< Auto-tools | Goals
Our Goal in Q2 is mostly ergonomics and stability. In other words:
- Goal: Improve Developer/QA ergonomics around running and debugging automation by:
- Make running any B2G test and landing at a breakpoint in a debugger require 3 commands or less
- Improve patch review experience on bugzilla/Make bugzilla more user-centric
- Replace graph server with Datazilla for all desktop Talos tests
- Create a project branch view of B2G builds/tests that tracks commits per target, rather than per repo (all commits to any repo for unagi for instance) joint with releng
- Goal: Improve stability, reliability, and scalability of automation platforms by:
- Addressing all P1 B2G automation stability issues
- Complete native REST interface for Bugzilla
- Complete Mochitest to Mozbase port P1 bugs
- Create Microbenchmark suite
- TODO: work with lmandel to decide what perf features need attention, microBenchmarks might be scratchings on a wall and offered up as a community project
- Reduce orange factor to 5 or lower by driving awareness among developers, following up with assignees, and fixing intermittent automation failures.
- Update pulse so that its dependent (client side) libraries are current
- Create a prototype and a specification for a rig to power cycle real phones. Have a vendor selected to build the rig by end of quarter.
- Goal: Build toward our future by:
- Deploy a minimally viable TBPL replacement by end of quarter, aim to switch over mid-Q3
- Release a mozmill 2 and work with contributor community to drive toward a 2.1
- Automate a scrolling fps test using camera Eideticker measurements for Contacts, Email, Settings, and Message apps
- Create and Deploy BMO user profile data for community building and education
- Create a solid net and filter system to build a bugmaster community
- Identify 5 things we can do to increase our infrastructure capacity by 10% through more streamlined usage and bringing new capacity online. (joint with releng)
- Enable performance and test automation to run on Android x86 hardware.