Auto-tools/Goals/2013Q2: Difference between revisions
< Auto-tools | Goals
Jump to navigation
Jump to search
No edit summary |
No edit summary |
||
| Line 2: | Line 2: | ||
* '''Goal:''' Improve Developer/QA ergonomics around running and debugging automation by: | * '''Goal:''' Improve Developer/QA ergonomics around running and debugging automation by: | ||
** [[Auto-tools/Projects/B2G_Automation|Add debugger support to B2G testrunners]] | ** {{ok|[[Auto-tools/Projects/B2G_Automation|Add debugger support to B2G testrunners]]}} | ||
** [[Auto-tools/Projects/Bugzilla_2013Q2|Improve patch review experience on bugzilla/Make bugzilla more user-centric]] | ** {{risk|[[Auto-tools/Projects/Bugzilla_2013Q2|Improve patch review experience on bugzilla/Make bugzilla more user-centric]]}} | ||
** [[Auto-tools/Projects/SfN_2013Q2|Replace graph server with Datazilla for all desktop Talos tests]] | ** {{risk|[[Auto-tools/Projects/SfN_2013Q2|Replace graph server with Datazilla for all desktop Talos tests]]}} | ||
** Create a project branch view of B2G builds/tests that tracks commits per target, rather than per repo (all commits to any repo for unagi for instance) joint with releng | ** {{ok|Create a project branch view of B2G builds/tests that tracks commits per target, rather than per repo (all commits to any repo for unagi for instance) joint with releng}} | ||
* '''Goal:''' Improve stability, reliability, and scalability of automation platforms by: | * '''Goal:''' Improve stability, reliability, and scalability of automation platforms by: | ||
** [[Auto-tools/Projects/B2G_Automation|Addressing all P1 B2G automation stability issues]] | ** {{ok|[[Auto-tools/Projects/B2G_Automation|Addressing all P1 B2G automation stability issues]]}} | ||
** [[Auto-tools/Projects/Bugzilla_2013Q2|Complete native REST interface for Bugzilla]] | ** {{risk|[[Auto-tools/Projects/Bugzilla_2013Q2|Complete native REST interface for Bugzilla]]}} | ||
** [[Auto-tools/Projects/Mochitest_on_Mozbase|Complete Mochitest to Mozbase port]] | ** {{risk|[[Auto-tools/Projects/Mochitest_on_Mozbase|Complete Mochitest to Mozbase port]]}} | ||
** Create POC Microbenchmark suite to get feedback from developers for its usefulness - waiting on confirmation from perf team on this priority | ** {{drop|Create POC Microbenchmark suite to get feedback from developers for its usefulness - waiting on confirmation from perf team on this priority}} | ||
*** standup webpagetest.org on the stoneridge hardware to provide speed index metrics for the necko team. This replaces the microboenchmark goal as it is more important as per the perf team. | *** {{ok|standup webpagetest.org on the stoneridge hardware to provide speed index metrics for the necko team. This replaces the microboenchmark goal as it is more important as per the perf team.}} | ||
** Reduce orange factor to 5 or lower (for the last three weeks of the quarter) by driving awareness among developers, following up with assignees, and fixing intermittent automation failures. | ** {{ok|Reduce orange factor to 5 or lower (for the last three weeks of the quarter) by driving awareness among developers, following up with assignees, and fixing intermittent automation failures.}} | ||
** [[Auto-tools/Projects/TreeHerder_2013Q2|Update pulse so that its dependent (client side) libraries are current for its use in Tree Herder]] | ** {{risk|[[Auto-tools/Projects/TreeHerder_2013Q2|Update pulse so that its dependent (client side) libraries are current for its use in Tree Herder]]}} | ||
** [[Auto-tools/Projects/Phone_Rack_2013Q2|Create a prototype and a specification for a rig to power cycle real phones. Have a vendor selected to build the rig by end of quarter.]] | ** {{ok|[[Auto-tools/Projects/Phone_Rack_2013Q2|Create a prototype and a specification for a rig to power cycle real phones. Have a vendor selected to build the rig by end of quarter.]]}} | ||
* '''Goal:''' Build toward our future by: | * '''Goal:''' Build toward our future by: | ||
** [[Auto-tools/Projects/TreeHerder_2013Q2|Deploy a minimally viable TBPL replacement by end of quarter, aim to switch over mid-Q3]] | ** {{risk|[[Auto-tools/Projects/TreeHerder_2013Q2|Deploy a minimally viable TBPL replacement by end of quarter, aim to switch over mid-Q3]]}} | ||
** [[Auto-tools/Projects/Mozmill_2.0_2013Q2|Release a mozmill 2 and work with contributor community to drive toward a 2.1]] | ** {{ok|[[Auto-tools/Projects/Mozmill_2.0_2013Q2|Release a mozmill 2 and work with contributor community to drive toward a 2.1]]}} | ||
** [[Auto-tools/Projects/Eideticker_Scrolling_FPS_B2G_2013Q2|Automate a scrolling fps test using camera Eideticker measurements for Contacts, Email, Settings, and Message apps]] | ** {{done|[[Auto-tools/Projects/Eideticker_Scrolling_FPS_B2G_2013Q2|Automate a scrolling fps test using camera Eideticker measurements for Contacts, Email, Settings, and Message apps]]}} | ||
** [[Auto-tools/Projects/Bugzilla_2013Q2|Create and Deploy BMO user profile data for community building and education]] | ** {{risk|[[Auto-tools/Projects/Bugzilla_2013Q2|Create and Deploy BMO user profile data for community building and education]]}} | ||
** [[Auto-tools/Projects/Bugmaster_2013Q2|Create a solid net and filter system to build a bugmaster community]] | ** {{ok|[[Auto-tools/Projects/Bugmaster_2013Q2|Create a solid net and filter system to build a bugmaster community]]}} | ||
** [[Auto-tools/Projects/Infraload_2013Q2|Identify 5 things we can do to increase our infrastructure capacity by 10% through more streamlined usage and bringing new capacity online. (joint with releng)]] | ** {{risk|[[Auto-tools/Projects/Infraload_2013Q2|Identify 5 things we can do to increase our infrastructure capacity by 10% through more streamlined usage and bringing new capacity online. (joint with releng)]]}} | ||
** [[Auto-tools/Projects/Androidx86_2013Q2|Enable performance and test automation to run on Android x86 hardware, investigate Android 2.3.x support on Pandas.]] | ** {{ok|[[Auto-tools/Projects/Androidx86_2013Q2|Enable performance and test automation to run on Android x86 hardware, investigate Android 2.3.x support on Pandas.]]}} | ||
Revision as of 01:22, 21 May 2013
Our Goal in Q2 is mostly ergonomics and stability. In other words:
- Goal: Improve Developer/QA ergonomics around running and debugging automation by:
- [ON TRACK] Add debugger support to B2G testrunners
- [AT RISK] Improve patch review experience on bugzilla/Make bugzilla more user-centric
- [AT RISK] Replace graph server with Datazilla for all desktop Talos tests
- [ON TRACK] Create a project branch view of B2G builds/tests that tracks commits per target, rather than per repo (all commits to any repo for unagi for instance) joint with releng
- Goal: Improve stability, reliability, and scalability of automation platforms by:
- [ON TRACK] Addressing all P1 B2G automation stability issues
- [AT RISK] Complete native REST interface for Bugzilla
- [AT RISK] Complete Mochitest to Mozbase port
- [DROPPED] Create POC Microbenchmark suite to get feedback from developers for its usefulness - waiting on confirmation from perf team on this priority
- [ON TRACK] standup webpagetest.org on the stoneridge hardware to provide speed index metrics for the necko team. This replaces the microboenchmark goal as it is more important as per the perf team.
- [ON TRACK] Reduce orange factor to 5 or lower (for the last three weeks of the quarter) by driving awareness among developers, following up with assignees, and fixing intermittent automation failures.
- [AT RISK] Update pulse so that its dependent (client side) libraries are current for its use in Tree Herder
- [ON TRACK] Create a prototype and a specification for a rig to power cycle real phones. Have a vendor selected to build the rig by end of quarter.
- Goal: Build toward our future by:
- [AT RISK] Deploy a minimally viable TBPL replacement by end of quarter, aim to switch over mid-Q3
- [ON TRACK] Release a mozmill 2 and work with contributor community to drive toward a 2.1
- [DONE] Automate a scrolling fps test using camera Eideticker measurements for Contacts, Email, Settings, and Message apps
- [AT RISK] Create and Deploy BMO user profile data for community building and education
- [ON TRACK] Create a solid net and filter system to build a bugmaster community
- [AT RISK] Identify 5 things we can do to increase our infrastructure capacity by 10% through more streamlined usage and bringing new capacity online. (joint with releng)
- [ON TRACK] Enable performance and test automation to run on Android x86 hardware, investigate Android 2.3.x support on Pandas.