QA/Telemetry: Difference between revisions
< QA
Jump to navigation
Jump to search
| Line 53: | Line 53: | ||
| '''Max Runtime''' | | '''Max Runtime''' | ||
| '''Channel''' | | '''Channel''' | ||
| '''Locale''' | |||
| '''Sample Rate''' | | '''Sample Rate''' | ||
| '''Current Status''' | | '''Current Status''' | ||
| Line 61: | Line 62: | ||
| 5.0 days | | 5.0 days | ||
| Nightly | | Nightly | ||
| N/A | |||
| 25% | | 25% | ||
| {{StatusHealthy|status= Completed}} | | {{StatusHealthy|status= Completed}} | ||
| Line 69: | Line 71: | ||
| 28.0 days | | 28.0 days | ||
| BETA | | BETA | ||
| en-US | |||
| 50% | | 50% | ||
| style="background:#9CE9F0;" | Currently in Progress | | style="background:#9CE9F0;" | Currently in Progress | ||
| Line 77: | Line 80: | ||
| 36.0 days | | 36.0 days | ||
| Aurora | | Aurora | ||
| de | |||
| 100% | | 100% | ||
| style="background:#9CE9F0;" | Currently in Progress | | style="background:#9CE9F0;" | Currently in Progress | ||
Revision as of 07:12, 20 July 2014
Telemetry Experiments
| Feature | Status | Lead Engineer | QA Lead | Status |
| Telemetry Experiments | Incremental Improvements | Benjamin Smedberg | Kamil Jozwiak | OK |
Project Goal
Allow Mozilla to deploy experiments to a statistically-relevant population of users and measure the results.
Project Summary
With telemetry experiments enabled, Firefox will periodically retrieve a list of experiments from a secure server if the user meets the specified condition(s). Possible conditions include:
- Product
- Version
- OS
- Channel
- Build ID
- Language
- Sample ratio
Each experiment will include the following information:
- experiment ID
- specific conditions for running the experiment
- experiment start date & end date
- experiment duration
- XPI URL & hash
Test Plan
- The Telemetry Experiment test plan can be found: Here
Experiments
| Experiment | Start Date | End Date | Max Runtime | Channel | Locale | Sample Rate | Current Status |
| Reorder about:newtab tiles | 01-Jan-2014 | 15-May-2014 | 5.0 days | Nightly | N/A | 25% | Completed |
| Search Experiment | 01-Jul-2014 | 30-Sep-2014 | 28.0 days | BETA | en-US | 50% | Currently in Progress |
| Automatic Translation | 27-Jun-2014 | 01-Aug-2014 | 36.0 days | Aurora | de | 100% | Currently in Progress |
Telemetry Experiments Documentation
- Setup & Installing Telemetry Staging Server
- Setting about:config Preferences
- Browser Console Commands
- Setting up Telemetry Logging
- Changing Experiments Browser Channel
- Installing Multiple Experiments
- Removing experiments.json
- Experiments Manifests (developers)
- Editing Extensions (XPI Files)
QA Contact Information
If you have any questions or issues regarding telemetry, you can contact me via the following methods:
Internet Relay Chat (IRC): [Quickest Response]
- Nick: kjozwiak
- Channels: #fhr #qa, #security
- IRC Setup: https://wiki.mozilla.org/IRC
Email: [Slowest Response]
- kjozwiak [at] mozilla.com
- kamiljoz [at] gmail.com