Telemetry/Experiments: Difference between revisions

Document that some parts of the process are not strictly required
(Document that some parts of the process are not strictly required)
Line 11: Line 11:
== Data Collection ==
== Data Collection ==


Before building an experiment, contact [https://mozillians.org/en-US/u/bsmedberg/ bsmedberg] or a data-collection peer to talk about experiment design and how the results of the experiment will be measured and reported. Depending on the nature of the experiment and its data-collection system, he may require additional privacy or security review.
For experiments that intend to collect new data, a data collection review is required. Before building such an experiment, contact [https://mozillians.org/en-US/u/bsmedberg/ bsmedberg] or a data-collection peer to talk about experiment design and how the results of the experiment will be measured and reported. Depending on the nature of the experiment and its data-collection system, he may require additional privacy or security review.


== Engineering ==
== Engineering ==
Line 51: Line 51:
== Staging ==
== Staging ==


To deploy an experiment, write a patch to http://hg.mozilla.org/webtools/telemetry-experiment-server/ for experiment deployment, and bsmedberg or a peer can review. Pushes there auto-deploy to the staging server at https://telemetry-experiment-dev.allizom.org/. QA should verify the experience on the staging server, including data collection.
To deploy an experiment, write a patch to http://hg.mozilla.org/webtools/telemetry-experiment-server/ for experiment deployment, and bsmedberg or a peer can review. Pushes there auto-deploy to the staging server at https://telemetry-experiment-dev.allizom.org/. For experiments that involve a nontrivial amount of new code or changes, the QA team is available is available to verify the experience on the staging server, including data collection. To request QA sign-off, refer to the [[QA/Telemetry|QA Guide For Telemetry Experiments]] - [https://mozillians.org/en-US/u/RyanVM/ Ryan VanderMeulen] is the QA lead for experiments.
 
* [[QA/Telemetry|QA Guide For Telemetry Experiments]] - [https://mozillians.org/en-US/u/RyanVM/ Ryan VanderMeulen] is the QA lead for experiments


== Final Deployment ==
== Final Deployment ==
Confirmed users
586

edits