Test Pilot/2017Q4

From MozillaWiki
Jump to: navigation, search

Test Pilot 2017 Q4 Objectives and Key Results

Final Status (Dec 31) Comments
Objective 1 Improve Test Pilot so that the Test Pilot program is a pleasure to use and improves engagement with experiments. 1
KR1 Implement 3 new features inspired by user feedback or x-functional need 1 Done: Photonization, Componetization, and the Featured Experiment Hero area.
KR2 Produce a document defining process and interactions with teams 1 giant RACI document
KR3 Publish 12 blog posts on the Test Pilot blog 1 12 done. Might even get 13!
Objective 2 Grow Screenshots usage and expand offered features so that people find Screenshots to be a useful tool. .43
KR1 Implement 3 new features inspired by user feedback .67 Finished highly requested features: copy-image-to-clipboard and download-only mode. Didn't quite get Annotations shipped.
KR2 Publish results from 3 A/B tests 0 A/B tests written, but ran out of time to ship them. No results published yet.
KR3 Get 5000 total pieces of feedback from survey 0 Survey written, but ran out of time to ship them.
KR4 Deliver a document planning Screenshots interaction with Firefox 1 Document finished although the plan will evolve with the committee that came out of the all hands github+relman meeting.
KR5 Demonstrate via a dashboard that Screenshots is within RAIL guidelines .5 We instrumented the add-on in Firefox and made a dashboard but are not within RAIL guidelines. Calling this halfway.
Objective 3 Find, guide, and graduate ideas and experiments into features so that Test Pilot is a proven valuable input to the future direction of Firefox .93
KR1 In Firefox Send, do a total of four new features or new A/B tests 1 Shipped password support, and multi-downloads. Two A/B tests around Firefox promotions.
KR2 Complete UX spec for Tab Split 1 done
KR3 Deliver a working prototype of the Theme Experiment 1 done
KR4 Deliver a document planning a design sprint in Q1 1 done
KR5 Publish graduation reports for four experiments .65 Pulse, Activity Stream (going live tomorrow morning. Add a link if you're reading this plz). Sharon has a .15 worth of a draft written for Snooze Tabs also which will be published soon.



  • We elected not to have any retention related goals because it didn't seem like we have enough time in a quarter to decide on a change, implement it, and measure it for any meaningful amount of time.