Test Pilot/2016Q3: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
mNo edit summary
Line 1: Line 1:
=== 2016 Q3 Goals ===


* '''Objective:'''  Grow the Test Pilot user base.
Test Pilot Q3 Objectives and Key Results
* '''Key Results:'''
** Grow total Test Pilot user base by 66%
** Add localization support to Test Pilot and get 80% of users using Test Pilot in their first choice language.
** All new Test Pilot experiments support localization when appropriate.
** Get 6% of our legacy users into the new Test Pilot program.
** Remove Firefox Accounts integration


* '''Objective:''' Make it easy for existing Test Pilot users to learn about new experiments and start using them.  
{| class="wikitable"
* '''Key Results:'''
!
** Get new experiment within 24 hours of launch at a rate 10% higher than our baseline engagement ratio.
!
** Implement a notification system in Test Pilot
! Final Status (Sep 30)
** 5% of active Test Pilot users share an experiment socially
! Comments
|-
! Objective 1
! Grow the Test Pilot user base.
!
!
|-
| KR1
| Grow total Test Pilot user base by 66%
|
|
|-
| KR2
| Add localization support to Test Pilot and get 80% of users using Test Pilot in their first choice language.
|
|
|-
| KR3
| All new Test Pilot experiments support localization when appropriate.
|
|
|-
| KR4
| Get 6% of our legacy users into the new Test Pilot program.
|
|
|-
| KR5
| Remove Firefox Accounts integration.
| <span style="color:green;font-weight:bold;">1.0</span>
|
|-
|
|
|
|
|-
! Objective 2
! Make it easy for existing Test Pilot users to learn about new experiments and start using them.
!
!
|-
| KR1
| Get new experiment within 24 hours of launch at a rate 10% higher than our baseline engagement ratio.
|
|
|-
| KR2
| Implement a notification system in Test Pilot
|
|
|-
| KR3
| 5% of active Test Pilot users share an experiment socially
|
|
|-
|
|
|
|
|-
! Objective 3
! Demonstrate that the Test Pilot experiment life cycle is valuable and sustainable.
!
!
|-
| KR1
| Ensure at least one experiment graduates
|
|
|-
| KR2
| Ensure at least one new experiment is publicly available
| <span style="color:green;font-weight:bold;">1.0</span>
| No More 404s
|-
| KR3
| Publish conclusions
|
|
|-
| KR4
| Build an offboarding process
|
|
|}


* '''Objective:''' Demonstrate that the Test Pilot experiment life cycle is valuable and sustainable. 
* '''Key Results:'''
**  Ensure at least one experiment graduates
**  Ensure at least one new experiment is publicly available
**  Publish conclusions
**  Build an offboarding process


=== Non-Goals ===
=== Non-Goals ===

Revision as of 21:19, 16 September 2016

Test Pilot Q3 Objectives and Key Results

Final Status (Sep 30) Comments
Objective 1 Grow the Test Pilot user base.
KR1 Grow total Test Pilot user base by 66%
KR2 Add localization support to Test Pilot and get 80% of users using Test Pilot in their first choice language.
KR3 All new Test Pilot experiments support localization when appropriate.
KR4 Get 6% of our legacy users into the new Test Pilot program.
KR5 Remove Firefox Accounts integration. 1.0
Objective 2 Make it easy for existing Test Pilot users to learn about new experiments and start using them.
KR1 Get new experiment within 24 hours of launch at a rate 10% higher than our baseline engagement ratio.
KR2 Implement a notification system in Test Pilot
KR3 5% of active Test Pilot users share an experiment socially
Objective 3 Demonstrate that the Test Pilot experiment life cycle is valuable and sustainable.
KR1 Ensure at least one experiment graduates
KR2 Ensure at least one new experiment is publicly available 1.0 No More 404s
KR3 Publish conclusions
KR4 Build an offboarding process


Non-Goals

The below were discussed as part of our goal setting but were not selected. They are included here for posterity and/or future planning.

  • Objective: Expose standardized experiment performance data in an easily consumable format
  • Key Results:
    • Build a standardized “report card” with high level statistics
    • Send an automated weekly summary email to executives
Retrieved from "https://wiki.mozilla.org/index.php?title=Test_Pilot/2016Q3&oldid=1148102"