Test Pilot: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
No edit summary
 
(75 intermediate revisions by 9 users not shown)
Line 1: Line 1:
[[image:IdeaTownSticker.png|baseline|right|600px]]
Other languages: [[Pt-Pt:Teste Piloto|Portuguese-Pt]]


Test Pilot is an opt-in platform that allows us to perform controlled tests of new high-visibility product concepts in the general release channel of Firefox. It is not intended to replace trains for most features, nor is it a test bed for concepts we do not believe have a strong chance of shipping in general release. Rather, it is reserved for features that require user-feedback, testing, and tuning before they ship with the browser.
== The Test Pilot program ended in January 2019. ==
'''To read more, please see: [https://medium.com/firefox-test-pilot/adios-amigo-51bec2a00072 Adios, Amigos]. The information below is being retained for posterity. Thanks to all who traveled along with us!'''


= Goal =
= What is Test Pilot? =
Test Pilot is a series of stepping stones intended to take a rough concept to a shipping Firefox feature or Add-on.


* Test Pilot will let us take larger risks with product concepts, giving us a cheap avenue to test and validate product concepts.
Test Pilot combines iterative prototyping, user research, and an opt-in user-facing testing platform. Experiments will go through phases which are designed to evaluate new feature concepts quickly and at low cost.


= Communications =
'''Test Pilot will let us take larger risks with product concepts, giving us an inexpensive avenue to test and validate product concepts.'''
 
Visit https://testpilot.firefox.com/ to try it out!
 
Read our [[Test_Pilot/mission|Mission and Vision statements]]
 
== How does Test Pilot Work? ==
 
Each phase of Test Pilot consists of prototype building and evaluation through user testing. Only in the third phase is any prototype deployed to the Test Pilot application itself.
 
[[File:Test-initiator-journey-summary.png|1000px]]
<br/><br/>
The following diagram provides a more detailed view of the process:
<br/>
[[File:Test-initiator-journey.png|1000px]]
<br/><br/>
[https://wiki.mozilla.org/images/e/ee/Test-initiator-journey.png View full diagram]
 
== Who is the Audience for Test Pilot? ==
'''Test Pilot is for people who like Firefox.'''
* They consciously choose to use Firefox
* They appreciate our unique community
* Not afraid of trying new things
* Don’t need to be technical
 
Test Pilot is currently in development for Desktop Firefox.  We are interested in exploring similar systems on our mobile platforms, but do not have user stories for these cases at this time.
 
== Who Builds and Manages Test Pilot? ==
 
Test Pilot is run by two groups of people: the '''Build Team''' responsible for day to day engineering, UX, and product processes and '''Mission Control''', a group of cross-disciplinary members of the Firefox team tasked with steering individual projects and the Test Pilot project as a whole.
 
Team members are amplifiers for people participating in the program.  When a person or group submits an idea to Test Pilot they are starting a process in which they should expect to be involved until a conclusion is reached.
 
Test Pilot team members help participants progress through the Test Pilot process in whichever ways are needed - from boiling an idea down to get at a measurable core concept, documenting an idea thoroughly, iterating on designs and prototypes, assisting with coding, communicating with appropriate teams around Mozilla, and helping uplift a successful idea to its next stage in life.  An analogy could be made between Test Pilot team members and consultants.
 
== How Can I Contribute To Test Pilot? ==
 
==== If you have an idea, feel free to reach out ====
* Chat with us on IRC in {{IRC|testpilot}} ([http://chat.mibbit.com/?server=irc.mozilla.org&channel=#testpilot webchat])
* Contribute to our [https://discourse.mozilla-community.org/c/test-pilot Discourse forums].
 
==== Or just chat with a Build Team member individually ====


=== Team ===
{| class="wikitable"
{| class="wikitable"
|-
|-
Line 17: Line 59:
! QA
! QA
|-
|-
| Nick Chapman
| John Gruen (irc: jgruen)
| Bryan Bell
| Sevaan Franks (irc: sevaan)
| [[User:clouserw|Wil Clouser]]
| [[User:clouserw|Wil Clouser]] (irc: clouserw)
| Peter deHaan
| Peter deHaan (irc:pdehaan)
|-
|-
|  
|  
| John Gruen
|  
| Chuck Harmston
| Donovan Preston (irc: fzzzy)
|
| Paul Oiegas (irc: pauloiegasSV)
|-
|-
|  
|  
|  
|  
| Jared Hirsch
| Jared Hirsch (irc: _6a68)
|
| Cosmin Muntean (irc: CosminMCG)
|-
|-
|  
|  
|  
|  
| Dave Justice
| Dave Justice (irc: JSON_voorhees)
|
|-
|-
|  
|  
|  
|  
| Les Orchard
| Les Orchard (irc: lorchard)
|
|-
|
|
| Danny Coates (irc: dcoates)
|-
|
|
| Ian Bicking (irc: ianbicking)
|-
|
|
| [[User:Marniepw|Marnie Pasciuto-Wood]]
|-
|
| 
|}
|}


=== Find us on IRC or email ===
==== Looking for code? ====
* Chat with us on IRC in [irc://irc.mozilla.org/#testpilot #testpilot]
 
* Join our [https://mail.mozilla.org/listinfo/testpilot-dev public mailing list]
Test Pilot is made up of a server and an add-on -- you can [https://github.com/mozilla/testpilot check out the code on Github]. 
 
==== Product Planning and User Experience ====
* [https://www.lucidchart.com/documents/view/bc257f5b-d2f9-4e23-8c60-fdb91b274bc6/0 Test Pilot system flow diagram 2017/01/10]
* [https://invis.io/Q77S1H6ZC Current UX mockups for Test Pilot site and addon]
* [https://docs.google.com/presentation/d/1Qv5s7OoMi2iTjKM-1SMMdEcLgMhrxJ8jS8DCKBAonxE/edit?usp=sharing Test Pilot Presentation from the London all-hands]
 
* [[Test_Pilot/2016Q3|2016 Q3 OKRs]]
* [[Test_Pilot/2016Q4|2016 Q4 OKRs]]
* [[Test_Pilot/2017Q1|2017 Q1 OKRs]]
* [[Test_Pilot/2018Q1|2018 Q1 OKRs]]
* [[Test_Pilot/2018Q2|2018 Q2 OKRs]]
* [[Test_Pilot/2018Q3|2018 Q3 OKRs]]
* [[Test_Pilot/2018Q4|2018 Q4 OKRs]]
 
==== Found a bug? ====
 
You can ask questions or leave comments in our [https://discourse.mozilla-community.org/c/test-pilot Discourse user forums].


=== Public Meetings ===
If you'd like to file a bug, Test Pilot and its experiments use Github Issues for bug tracking:


{{#widget:Widget:Google Calendar
* Test Pilot site or add-on: https://github.com/mozilla/testpilot/issues/new
|id=mozilla.com_6n2hkpbghraeootqkbjde2o3r4@group.calendar.google.com
* Screenshots: https://github.com/mozilla-services/screenshots/issues/new
|title=Firefox Test Pilot
* Min Vid: https://github.com/meandavejustice/min-vid/issues/new
}}
* Notes: https://github.com/mozilla/notes/issues/new
* Send: https://github.com/mozilla/send/issues/new


You can also [https://calendar.google.com/calendar/ical/mozilla.com_6n2hkpbghraeootqkbjde2o3r4%40group.calendar.google.com/public/basic.ics import this calendar] into any iCal-capable calendar application.
= Website URLs =


Many of our meetings have [[Test_Pilot/meetings|public meeting notes]].
* Production: https://testpilot.firefox.com/
* Stage: https://testpilot.stage.mozaws.net/


= Get Involved =
= List of Test Pilot Experiments =


<div style="
[https://wiki.mozilla.org/Test_Pilot/Experiment_Pipeline Experiment Pipeline]
  background: #dcf2a7;
  background-image: -webkit-linear-gradient(top, #dcf2a7, #d5ed85);
  background-image: -moz-linear-gradient(top, #dcf2a7, #d5ed85);
  background-image: -ms-linear-gradient(top, #dcf2a7, #d5ed85);
  background-image: -o-linear-gradient(top, #dcf2a7, #d5ed85);
  background-image: linear-gradient(to bottom, #dcf2a7, #d5ed85);
  -webkit-border-radius: 15;
  -moz-border-radius: 15;
  border-radius: 15px;
  font-family: Arial;
  font-size: 20px;
  padding: 10px 20px 10px 20px;
  width:400px;
  text-align:center;">
[https://docs.google.com/a/mozilla.com/forms/d/1ik_XwGc_5knDDKEmPRu8xK7qzHc-LBlZG5SmSNExod4/viewform Submit an idea!]
</div>


=== Looking for code? ===
= More Pages =
* [https://github.com/mozilla/idea-town The website]
* [https://github.com/mozilla/idea-town/tree/master/addon The add-on]
* [https://github.com/mozilla/idea-town-splash The splash site]


=== User Experience ===
* [[Test_Pilot/UX_Workflows|Test Pilot UX Workflows]]
* [[Test_Pilot/Mission_Control|Test Pilot Mission Control]]
* [[Test_Pilot/Data_Governance|Test Pilot Data Governance]]
* [[Test_Pilot/Metrics|Test Pilot Metrics]]
* [[Test_Pilot/Roadmap|Test Pilot Feature Roadmap]]


* [https://invis.io/RT42BZZVC Mockups]
[[File:Choppy.png|right|30px]]


=== Found a bug? ===
= Archive =
<div class="NavFrame collapsed">
  <div class="NavHead">Click to expand</div>
  <div class="NavContent">
===== Obsolete UX and Planning Documents =====


* Right now, finding us on IRC or reporting the bug on github issues is your best bet.  Bugzilla component coming soon.
These documents aren't currently used for building Test Pilot. They are linked here to preserve the project's history.


= Experiments =
* [https://people.mozilla.org/~jgruen/test-pilot/ Old Clickable Site Mockup]
* [https://invis.io/RT42BZZVC Old Mockups]
* [https://docs.google.com/a/mozilla.com/presentation/d/1126B7CDIkxTRkZXGD3OK5L-kx1xkbeydHV7QBnsT0rE/edit?usp=sharing Post-Launch User Research deck (Mozilla private)]


* [[Firefox/Universal_Search|Universal Search]]
  </div>
</div>

Latest revision as of 00:55, 30 January 2019

Other languages: Portuguese-Pt

The Test Pilot program ended in January 2019.

To read more, please see: Adios, Amigos. The information below is being retained for posterity. Thanks to all who traveled along with us!

What is Test Pilot?

Test Pilot is a series of stepping stones intended to take a rough concept to a shipping Firefox feature or Add-on.

Test Pilot combines iterative prototyping, user research, and an opt-in user-facing testing platform. Experiments will go through phases which are designed to evaluate new feature concepts quickly and at low cost.

Test Pilot will let us take larger risks with product concepts, giving us an inexpensive avenue to test and validate product concepts.

Visit https://testpilot.firefox.com/ to try it out!

Read our Mission and Vision statements

How does Test Pilot Work?

Each phase of Test Pilot consists of prototype building and evaluation through user testing. Only in the third phase is any prototype deployed to the Test Pilot application itself.

Test-initiator-journey-summary.png

The following diagram provides a more detailed view of the process:
Test-initiator-journey.png

View full diagram

Who is the Audience for Test Pilot?

Test Pilot is for people who like Firefox.

  • They consciously choose to use Firefox
  • They appreciate our unique community
  • Not afraid of trying new things
  • Don’t need to be technical

Test Pilot is currently in development for Desktop Firefox. We are interested in exploring similar systems on our mobile platforms, but do not have user stories for these cases at this time.

Who Builds and Manages Test Pilot?

Test Pilot is run by two groups of people: the Build Team responsible for day to day engineering, UX, and product processes and Mission Control, a group of cross-disciplinary members of the Firefox team tasked with steering individual projects and the Test Pilot project as a whole.

Team members are amplifiers for people participating in the program. When a person or group submits an idea to Test Pilot they are starting a process in which they should expect to be involved until a conclusion is reached.

Test Pilot team members help participants progress through the Test Pilot process in whichever ways are needed - from boiling an idea down to get at a measurable core concept, documenting an idea thoroughly, iterating on designs and prototypes, assisting with coding, communicating with appropriate teams around Mozilla, and helping uplift a successful idea to its next stage in life. An analogy could be made between Test Pilot team members and consultants.

How Can I Contribute To Test Pilot?

If you have an idea, feel free to reach out

Or just chat with a Build Team member individually

Product User Experience Engineering QA
John Gruen (irc: jgruen) Sevaan Franks (irc: sevaan) Wil Clouser (irc: clouserw) Peter deHaan (irc:pdehaan)
Donovan Preston (irc: fzzzy) Paul Oiegas (irc: pauloiegasSV)
Jared Hirsch (irc: _6a68) Cosmin Muntean (irc: CosminMCG)
Dave Justice (irc: JSON_voorhees)
Les Orchard (irc: lorchard)
Danny Coates (irc: dcoates)
Ian Bicking (irc: ianbicking)
Marnie Pasciuto-Wood

Looking for code?

Test Pilot is made up of a server and an add-on -- you can check out the code on Github.

Product Planning and User Experience

Found a bug?

You can ask questions or leave comments in our Discourse user forums.

If you'd like to file a bug, Test Pilot and its experiments use Github Issues for bug tracking:

Website URLs

List of Test Pilot Experiments

Experiment Pipeline

More Pages

Choppy.png

Archive

Retrieved from "https://wiki.mozilla.org/index.php?title=Test_Pilot&oldid=1206898"