Test Pilot/2017Q2: Difference between revisions
Jump to navigation
Jump to search
mNo edit summary |
mNo edit summary |
||
| Line 10: | Line 10: | ||
! Objective 1 | ! Objective 1 | ||
! Extend Test Pilot so it is capable of mobile experiments | ! Extend Test Pilot so it is capable of mobile experiments | ||
! | ! 1 | ||
! | ! | ||
|- | |- | ||
| KR1 | | KR1 | ||
| Develop a mobile Test Pilot strategy document | | Develop a mobile Test Pilot strategy document | ||
| | | <span style="color:green;font-weight:bold;">1</span> | ||
| | | [https://docs.google.com/document/d/1IDnU4UhMHtnWRfss3zAfPKiw1Lm2Yxrn5yU8TEwZB5Y/edit#heading=h.u68xe8sazvrm Mobile Strategy Document] | ||
|- | |- | ||
| KR2 | | KR2 | ||
| Deliver 3 business canvases for 3 ideas to experiment with on mobile | | Deliver 3 business canvases for 3 ideas to experiment with on mobile | ||
| | | <span style="color:green;font-weight:bold;">1</span> | ||
| | | Voice Fill, Notes, Send. [https://docs.google.com/presentation/d/1eUFr-LIjUqtUUV3RvQqEZU5t7Nz7Tpe2VDDkEN5d9a0/edit Link] | ||
|- | |- | ||
| | | | ||
| Line 30: | Line 30: | ||
! Objective 2 | ! Objective 2 | ||
! Grow user engagement | ! Grow user engagement | ||
! | ! .73 | ||
! | ! | ||
|- | |- | ||
| KR1 | | KR1 | ||
| Receive 50 experiment ideas, suggestions, or patches | | Receive 50 experiment ideas, suggestions, or patches | ||
| | | <span style="color:green;font-weight:bold;">1</span> | ||
| | | 46 ideas on discourse + Idea Board. Jared has a crazy de-duping dashboard that will spit out numbers next quarter. Calling this 50 because some discourse ideas list several suggestions. | ||
|- | |- | ||
| KR2 | | KR2 | ||
| Conduct field research that results in 10 feature cards ready for UX | | Conduct field research that results in 10 feature cards ready for UX | ||
| | | <span style="color:green;font-weight:bold;">1</span> | ||
| | | [https://trello.com/b/TjEN1biU/test-pilot Feature cards] | ||
|- | |- | ||
| KR3 | | KR3 | ||
| Test 3 contributor value hypotheses and publish the results | | Test 3 contributor value hypotheses and publish the results | ||
| | | <span style="color:red;font-weight:bold;">.2</span> | ||
| <ul><li>Voting up/down possible new experiments to help us choose and help people feel more involved</li><li>Writing up ideas for other users on how they are using experiments (e.g. snooze tabs seems to be something that people could develop productivity tips around)</li><li>Do a better job telling the story of Test Pilot. There's something here about content that TP is generating in terms of an approach to ideation and experimenting</li></ul> | | <ul><li>Voting up/down possible new experiments to help us choose and help people feel more involved</li><li>Writing up ideas for other users on how they are using experiments (e.g. snooze tabs seems to be something that people could develop productivity tips around)</li><li>Do a better job telling the story of Test Pilot. There's something here about content that TP is generating in terms of an approach to ideation and experimenting</li></ul>First idea: 0. Second idea: We have the ideas, they aren't written. Much gnashing of teeth. 10%. Third idea: We have a plan, but we haven't done it. John is going to slide-in with a patch. 10% | ||
|- | |- | ||
| | | | ||
| Line 55: | Line 55: | ||
! Objective 3 | ! Objective 3 | ||
! Find, guide, and graduate ideas and experiments into features so that Test Pilot is a proven valuable input to the future direction of Firefox | ! Find, guide, and graduate ideas and experiments into features so that Test Pilot is a proven valuable input to the future direction of Firefox | ||
! | ! .87 | ||
! | ! | ||
|- | |- | ||
| KR1 | | KR1 | ||
| Using survey technology, get at least an 80% response rate from Firefox stakeholders regarding the value and direction of Test Pilot | | Using survey technology, get at least an 80% response rate from Firefox stakeholders regarding the value and direction of Test Pilot | ||
| | | <span style="color:green;font-weight:bold;">1</span> | ||
| | | We got 100% of 80%. John will summarize and have a report by end of next week. | ||
|- | |- | ||
| KR2 | | KR2 | ||
| Build 1 prototype experiment to launch in Q3 | | Build 1 prototype experiment to launch in Q3 | ||
| | | <span style="color:green;font-weight:bold;">1</span> | ||
| | | [https://fileshare.stage.mozaws.net/ File Share] (Project is getting renamed to Send so that URL will probably break...) | ||
|- | |- | ||
| KR3 | | KR3 | ||
| Landing Firefox Screenshots in Firefox | | Landing Firefox Screenshots in Firefox with a clear path to release | ||
| | |<span style="color:green;font-weight:bold;">1</span> | ||
| | | Screenshots is in Firefox! | ||
|- | |- | ||
| KR4 | | KR4 | ||
| Add 10 backlog issues from user tests of Firefox Screenshots | | Add 10 backlog issues from user tests of Firefox Screenshots | ||
| | | <span style="color:green;font-weight:bold;">1</span> | ||
| | | [https://docs.google.com/presentation/d/1FqJ2bUdfLmBFKFnzqV5UAOGr0yPE1_WE1T2gjh28UAU/edit Link] | ||
|- | |- | ||
| KR5 | | KR5 | ||
| Implement 4 feature cards for Test Pilot | | Implement 4 feature cards for Test Pilot | ||
| | |<span style="color:green;font-weight:bold;">1</span> | ||
| | | Newsfeed, Feedback buttons, storing experiments people participated in, web-only experiments | ||
|- | |- | ||
| KR6 | | KR6 | ||
| Collect data from 100000 pulse submissions | | Collect data from 100000 pulse submissions | ||
| | |<span style="color:red;font-weight:bold;">.4</span> | ||
| | | Around 40000. [https://sql.telemetry.mozilla.org/queries/4379#8742 Link to cumulative submissions] | ||
|- | |- | ||
| KR7 | | KR7 | ||
| 32% of users send something to their Min Vid playlist queue | | 32% of users send something to their Min Vid playlist queue | ||
| | |<span style="color:orange;font-weight:bold;">.71</span> | ||
| | | Final count is on page 2 of the dashboard. Final count is 22.7% of users. | ||
|} | |} | ||
Latest revision as of 16:59, 6 July 2017
Test Pilot 2017 Q2 Objectives and Key Results
| Final Status (Jun 30) | Comments | ||
|---|---|---|---|
| Objective 1 | Extend Test Pilot so it is capable of mobile experiments | 1 | |
| KR1 | Develop a mobile Test Pilot strategy document | 1 | Mobile Strategy Document |
| KR2 | Deliver 3 business canvases for 3 ideas to experiment with on mobile | 1 | Voice Fill, Notes, Send. Link |
| Objective 2 | Grow user engagement | .73 | |
| KR1 | Receive 50 experiment ideas, suggestions, or patches | 1 | 46 ideas on discourse + Idea Board. Jared has a crazy de-duping dashboard that will spit out numbers next quarter. Calling this 50 because some discourse ideas list several suggestions. |
| KR2 | Conduct field research that results in 10 feature cards ready for UX | 1 | Feature cards |
| KR3 | Test 3 contributor value hypotheses and publish the results | .2 |
|
| Objective 3 | Find, guide, and graduate ideas and experiments into features so that Test Pilot is a proven valuable input to the future direction of Firefox | .87 | |
| KR1 | Using survey technology, get at least an 80% response rate from Firefox stakeholders regarding the value and direction of Test Pilot | 1 | We got 100% of 80%. John will summarize and have a report by end of next week. |
| KR2 | Build 1 prototype experiment to launch in Q3 | 1 | File Share (Project is getting renamed to Send so that URL will probably break...) |
| KR3 | Landing Firefox Screenshots in Firefox with a clear path to release | 1 | Screenshots is in Firefox! |
| KR4 | Add 10 backlog issues from user tests of Firefox Screenshots | 1 | Link |
| KR5 | Implement 4 feature cards for Test Pilot | 1 | Newsfeed, Feedback buttons, storing experiments people participated in, web-only experiments |
| KR6 | Collect data from 100000 pulse submissions | .4 | Around 40000. Link to cumulative submissions |
| KR7 | 32% of users send something to their Min Vid playlist queue | .71 | Final count is on page 2 of the dashboard. Final count is 22.7% of users. |