Test Pilot/Graduation

From MozillaWiki
Jump to: navigation, search

Overview

THIS DOCUMENT IS A DRAFT

Graduation is a process that needs to be considered before an experiment has launched in Test Pilot.

Roles

  • Experiment Product Manager: this person is responsible for pushing the experiment forward. Day to day decisions involving the experiment.
  • Firefox Product Manager: this person is a part of the core Firefox Product Team and can make decisions on product priority and resourcing.
  • Strategy & Insights: this team is a major contributor in our metrics and survey data.

Process

The process starts with getting agreement between experiment owners, and Firefox product managers on the goals and success criteria for the experiment in Test Pilot.

1. Approve the initial Product Hypothesis Document

Please use this template: https://docs.google.com/document/d/1ViXNAWEFTfSI_NW8C7ta2JDG4g5exzQFkcyv5I2UA8Y/edit

This document should be in an approved state before the experiment launches in Test Pilot.

It should answer questions about

   * what is the goal? doing something crazy; what is the realistic priority to ship in Firefox?
   * how much does Test Pilot success effect the agreed upon priority?
   * how likely will this thing be resourced?
   * how long will the experiment be in Test Pilot?
Title Role
Experiment Product Manager responsible
Firefox Product Manager responsible
Strategy & Insights contributing

Example: Tracking Protection

Name Title Role
John Gruen Experiment Product Manager responsible
Peter Dol Firefox Product Manager responsible
Matt Grimes Strategy & Insights contributing

Product Hypothesis Document: https://docs.google.com/document/d/1g1aKpaRuhSu13sU09aKDvKCkXgYzdjXwL4yU06xk17M/edit

Example: Page Shot

Name Title Role
John Gruen Experiment Product Manager responsible
Peter Dol Firefox Product Manager responsible
Matt Grimes Strategy & Insights contributing

Product Hypothesis Document: https://docs.google.com/document/d/1UhCdV7Vb82VyEjBPUyU2F4wBX-lcZWfjN42XWCHmaNM/edit

2. Reporting on progress against the PHD, and recommend amendments

TODO: who is doing this?

3. Recommendations on graduation and final decision

4. Publish learnings