QA/Telemetry
< QA
Jump to navigation
Jump to search
Telemetry Experiments
| Feature | Status | Lead Engineer | QA Lead | Status |
| Telemetry Experiments | Incremental Improvements | Benjamin Smedberg | Kamil Jozwiak | OK |
Project Goal
Allow Mozilla to deploy experiments to a statistically-relevant population of users and measure the results.
Project Summary
With telemetry experiments enabled, Firefox will periodically retrieve a list of experiments from a secure server if the user meets the specified condition(s). Possible conditions include:
- Product
- Version
- OS
- Channel
- Build ID
- Language
- Sample ratio
Each experiment will include the following information:
- experiment ID
- specific conditions for running the experiment
- experiment start date & end date
- experiment duration
- XPI URL & hash
Test Plan
- The Telemetry Experiment test plan can be found: Here
Experiments
| Experiment | Start Date | End Date | Max Runtime | Channel | Locale(s) | Sample Rate | Test Plan | Current Status |
| Reorder about:newtab tiles | 01-Jan-2014 | 15-May-2014 | 5.0 days | Nightly | N/A | 25% | Here | Completed |
| Search Experiment | 01-Jul-2014 | 30-Sep-2014 | 28.0 days | BETA | en-US | 50% | Here | Currently in Progress |
| Automatic Translation | 27-Jun-2014 | 01-Aug-2014 | 36.0 days | Aurora | de | 100% | Here | Currently in Progress |
| OOPP container unload timeout tester | 01-Jul-2014 | 02-Sep-2014 | 42.0 days | BETA | N/A | 5% | Here | Currently in Progress |
| Automatic Translation | 16-Jul-2014 | 25-Nov-2014 | 126.0 days | BETA | pl | 100% | Here | Currently in Progress |
| Automatic Translation | 16-Jul-2014 | 25-Nov-2014 | 126.0 days | BETA | tr | 100% | Here | Currently in Progress |
| Automatic Translation | 16-Jul-2014 | 25-Nov-2014 | 126.0 days | BETA | vi | 100% | Here | Currently in Progress |
Telemetry Experiments Documentation
- Setup & Installing Telemetry Staging Server
- Setting about:config Preferences
- Browser Console Commands
- Setting up Telemetry Logging
- Changing Experiments Browser Channel
- Installing Multiple Experiments
- Removing experiments.json
- Experiments Manifests (developers)
- Editing Extensions (XPI Files)
QA Contact Information
If you have any questions or issues regarding telemetry, you can contact me via the following methods:
Internet Relay Chat (IRC): [Quickest Response]
- Nick: kjozwiak
- Channels: #fhr #qa, #security
- IRC Setup: https://wiki.mozilla.org/IRC
Email: [Slowest Response]
- kjozwiak [at] mozilla.com
- kamiljoz [at] gmail.com