QA/Telemetry: Difference between revisions
< QA
Jump to navigation
Jump to search
| Line 64: | Line 64: | ||
| Nightly | | Nightly | ||
| N/A | | N/A | ||
| 25% | | style="text-align:center;" | 25% | ||
| [Link] | | [Link] | ||
| style="background:#9D9; text-align:center;" | Completed | | style="background:#9D9; text-align:center;" | Completed | ||
| Line 74: | Line 74: | ||
| BETA | | BETA | ||
| en-US | | en-US | ||
| 50% | | style="text-align:center;" | 50% | ||
| [Link] | | [Link] | ||
| style="background:#9CE9F0; text-align:center;" | Currently in Progress | | style="background:#9CE9F0; text-align:center;" | Currently in Progress | ||
| Line 84: | Line 84: | ||
| Aurora | | Aurora | ||
| de | | de | ||
| 100% | | style="text-align:center;" | 100% | ||
| [Link] | | [Link] | ||
| style="background:#9CE9F0; text-align:center;" | Currently in Progress | | style="background:#9CE9F0; text-align:center;" | Currently in Progress | ||
Revision as of 07:21, 20 July 2014
Telemetry Experiments
| Feature | Status | Lead Engineer | QA Lead | Status |
| Telemetry Experiments | Incremental Improvements | Benjamin Smedberg | Kamil Jozwiak | OK |
Project Goal
Allow Mozilla to deploy experiments to a statistically-relevant population of users and measure the results.
Project Summary
With telemetry experiments enabled, Firefox will periodically retrieve a list of experiments from a secure server if the user meets the specified condition(s). Possible conditions include:
- Product
- Version
- OS
- Channel
- Build ID
- Language
- Sample ratio
Each experiment will include the following information:
- experiment ID
- specific conditions for running the experiment
- experiment start date & end date
- experiment duration
- XPI URL & hash
Test Plan
- The Telemetry Experiment test plan can be found: Here
Experiments
| Experiment | Start Date | End Date | Max Runtime | Channel | Locale | Sample Rate | Test Plan | Current Status |
| Reorder about:newtab tiles | 01-Jan-2014 | 15-May-2014 | 5.0 days | Nightly | N/A | 25% | [Link] | Completed |
| Search Experiment | 01-Jul-2014 | 30-Sep-2014 | 28.0 days | BETA | en-US | 50% | [Link] | Currently in Progress |
| Automatic Translation | 27-Jun-2014 | 01-Aug-2014 | 36.0 days | Aurora | de | 100% | [Link] | Currently in Progress |
Telemetry Experiments Documentation
- Setup & Installing Telemetry Staging Server
- Setting about:config Preferences
- Browser Console Commands
- Setting up Telemetry Logging
- Changing Experiments Browser Channel
- Installing Multiple Experiments
- Removing experiments.json
- Experiments Manifests (developers)
- Editing Extensions (XPI Files)
QA Contact Information
If you have any questions or issues regarding telemetry, you can contact me via the following methods:
Internet Relay Chat (IRC): [Quickest Response]
- Nick: kjozwiak
- Channels: #fhr #qa, #security
- IRC Setup: https://wiki.mozilla.org/IRC
Email: [Slowest Response]
- kjozwiak [at] mozilla.com
- kamiljoz [at] gmail.com