Test Pilot/2017Q4
From MozillaWiki
Test Pilot 2017 Q4 Objectives and Key Results
| Final Status (Dec 31) | Comments | ||
|---|---|---|---|
| Objective 1 | Improve Test Pilot so that the Test Pilot program is a pleasure to use and improves engagement with experiments. | 1 | |
| KR1 | Implement 3 new features inspired by user feedback or x-functional need | 1 | Done: Photonization, Componetization, and the Featured Experiment Hero area. |
| KR2 | Produce a document defining process and interactions with teams | 1 | giant RACI document |
| KR3 | Publish 12 blog posts on the Test Pilot blog | 1 | 12 done. Might even get 13! |
| Objective 2 | Grow Screenshots usage and expand offered features so that people find Screenshots to be a useful tool. | .43 | |
| KR1 | Implement 3 new features inspired by user feedback | .67 | Finished highly requested features: copy-image-to-clipboard and download-only mode. Didn't quite get Annotations shipped. |
| KR2 | Publish results from 3 A/B tests | 0 | A/B tests written, but ran out of time to ship them. No results published yet. |
| KR3 | Get 5000 total pieces of feedback from survey | 0 | Survey written, but ran out of time to ship them. |
| KR4 | Deliver a document planning Screenshots interaction with Firefox | 1 | Document finished although the plan will evolve with the committee that came out of the all hands github+relman meeting. |
| KR5 | Demonstrate via a dashboard that Screenshots is within RAIL guidelines | .5 | We instrumented the add-on in Firefox and made a dashboard but are not within RAIL guidelines. Calling this halfway. |
| Objective 3 | Find, guide, and graduate ideas and experiments into features so that Test Pilot is a proven valuable input to the future direction of Firefox | .93 | |
| KR1 | In Firefox Send, do a total of four new features or new A/B tests | 1 | Shipped password support, and multi-downloads. Two A/B tests around Firefox promotions. |
| KR2 | Complete UX spec for Tab Split | 1 | done |
| KR3 | Deliver a working prototype of the Theme Experiment | 1 | done |
| KR4 | Deliver a document planning a design sprint in Q1 | 1 | done |
| KR5 | Publish graduation reports for four experiments | .65 | Pulse, Activity Stream (going live tomorrow morning. Add a link if you're reading this plz). Sharon has a .15 worth of a draft written for Snooze Tabs also which will be published soon. |
Updates
Non-Goals
- We elected not to have any retention related goals because it didn't seem like we have enough time in a quarter to decide on a change, implement it, and measure it for any meaningful amount of time.
