Test Pilot/2016Q3

2016 Q3 Goals

• Objective: Grow the Test Pilot user base.
• Key Results:
  • Grow total Test Pilot user base by 66%
  • Add localization support to Test Pilot and get 80% of users using Test Pilot in their first choice language.
  • All new Test Pilot experiments support localization when appropriate.
  • Get 6% of our legacy users into the new Test Pilot program.
  • Remove Firefox Accounts integration

• Objective: Make it easy for existing Test Pilot users to learn about new experiments and start using them.
• Key Results:
  • Get new experiment within 24 hours of launch at a rate 10% higher than our baseline engagement ratio.
  • Implement a notification system in Test Pilot
  • 5% of active Test Pilot users share an experiment socially

• Objective: Demonstrate that the Test Pilot experiment life cycle is valuable and sustainable.
• Key Results:
  • Ensure at least one experiment graduates
  • Ensure at least one new experiment is publicly available
  • Publish conclusions
  • Build an offboarding process

Non-Goals

The below were discussed as part of our goal setting but were not selected. They are included here for posterity and/or future planning.

• Objective: Expose standardized experiment performance data in an easily consumable format
• Key Results:
  • Build a standardized “report card” with high level statistics
  • Send an automated weekly summary email to executives