Firefox/Recipe Server/Shield Variants: Difference between revisions
Gregg.lind (talk | contribs) (→Data Collection: expanded details.) |
m (added survey data collection) |
||
| Line 16: | Line 16: | ||
* Usage hours | * Usage hours | ||
* Study info: Variation Name, Study Name | * Study info: Variation Name, Study Name | ||
* Answers provided in followup survey | |||
Mechanism: | Mechanism: | ||
Revision as of 21:30, 10 March 2016
Shield Variants is a feature that asks a random population of users to help us try out new products, features, and ideas. This feedback helps Mozilla to make more informed product decisions based on actual user needs
Shield Variants are available on channels. Participation in an individual study is opt-in and any and all data being collected will be declared prior to joining the study. After confirming willingness to participation, a self expiring add-on will be installed on the user's machine. At the end of the study period, the add-on will expire and return the user's system to the previous state. When the add-on expires, the user will be asked to fill out a survey based on their experience.
Shield Variants can be targeted at various populations by specifying conditions in a Recipe. Additional configurations and conditions can be set through the add-on for the individual study.
Product Approval
Product approval is required to run a Shield Variant. Shield Variants must be approved by a Firefox product manager and a core member of the Shield Team. For experiments which have no user-visible effects, this approval is trivial.
Data Collection
By default, Shield Variants will collect this data:
- Firefox was used
- Usage hours
- Study info: Variation Name, Study Name
- Answers provided in followup survey
Mechanism:
- at STARTUP, SHUTDOWN, INSTALL, UNINSTALL, - send a `x-shield-trials` packet containing the Unified Telemetry Environment.
Additional measures may be added to individual studies pending approval from a data steward. All data collected will be disclosed prominently to the user at the time of consent.
Engineering
Shield Variants are a special type of restartless extension. They can do anything a regular restartless extension can do.
Lifecycle
Shield Variants live for a fixed period and are uninstalled by the system at the end date or after the specified elapsed time.
Extension Signing
Shield Variants need to be signed to run in FF 42+, just like all other add-ons.
Staging
Shield Variant staging is performed by the core Shield Team with QA by Chris Hartjes.
Final Deployment
Final deployment of a Shield Variant must be approved by a Firefox Product Manager and the core Shield Team.