Telemetry/2012-Q4-Goals

Client

Improve Adoption Rate

• [DONE] bug 699806 make it possible to enable Telemetry by default on Nightly and Aurora channels
• [DONE] bug 737596 make it possible to enable Telemetry by default on Nightly and Aurora channels (mobile)
• [DONE] bug 701178 Add new descriptive/warning text to Aurora and Nightly pages
• [DONE] bug 725987 Create Telemetry (opt-out) notification for Nightly and Aurora (mobile)

Persistent Telemetry

• [DONE] bug 772552 add telemetry for number of saved pings loaded at startup
• [DONE] bug 748520 resend failed telemetry pings

Data Enhancement

• [MISSED] bug 786788 Distribution Prediction, Build Migration and Early/New Adopters
• [DONE] bug 816166 Add log_sum to exp histogram ping data
• [DONE] bug 746319 Modification of Telemetry Packet to include extra information
• [DONE] bug 778123 provide metadata in histogram definitions for doing automatic field trials

Note: bug 778123 is a stretch goal

about:telemetry

• [DONE] bug 733105 Make about:telemetry more consumable
• [DONE] bug 661881 Implement about:telemetry

General Cleanup

• [DEFER] bug 794948 Port Telemetry writes to OS.File
• [MISSED] bug 789975 Extremely long pause while collecting telemetry information on the main thread
• [MISSED] bug 769844 Special characters in TelemetryPing properties are lost when sent to the server
• [MISSED] bug 798366 Intermittent crash in test_obj_group.xul, test_pluginstream_newstream.html, test_html5_tree_construction_part2.html [@ libpthread-2.11.so@0xe6ad | unixSync | xSync]
• [DONE] bug 797237 Port Telemetry tests to mochitests

bug 794948 has been deprioritized in favour of session store work.

Server

See the Metrics Q4 iteration plan for details on when these issues are expected to be complete.

Backend

• [MISSED] BIV-114 (bug 707280) Need simple queries
• [MISSED] METRICS-333 Telemetry server side histogram bucket validation

Other

• [DROPPED] STATMOD-22 (bug 776720) Provide field-trial capability

Metrics concluded that STATMOD-22 will not be completed

Bugs

• [DONE] BIV-91 (bug 792888) Some Firefox UI functionality is blocked for minutes on end while the data loads

Augment Existing dashboard

• [MISSED] BIV-85 (bug 699670) Add sum/average/stddev to telemetry dashboard
• [DONE] BIV-109 (bug 723601 Histogram selector should regex match inside the histogram name
• [MISSED] BIV-110 (bug 679522) Display distribution of simple values and allow filtering based on them
• [DONE] bug 809825 Consider removing or changing "Comparing last week with previous 3" in Telemetry Evolution
• [DONE] bug 712061 Create short URL for Telemetry dashboard

Filtering

• [MISSED] STATMOD-31 bug 761327 Telemetry evolution does not show data for non-windows platform

Dependent on resources

The following are lower priority issues that are Q4 stretch goals.

Q3 rollover

• [DEFER] METRICS-994 (bug 765014) Telemetry evolution: allow combining data from multiple builds to make up for lack of data
• [DEFER] BIV-7 (bug 701915) Need graph query tools

Q4

• [DEFER] BIV-111 (bug 713147) Exported images are require auth, url sucks
• [DEFER] BIV-112 (bug 761751)Provide a link to changesets from telemetry UI
• [DEFER] BIV-113 (bug 765100 Add .sum/uptime mode to evolution

Incoming during Q4

• [DEFER] bug 816239 Provide histogram comparisons based on build id
• [DEFER] bug 816242 make the evolution graph look more like bcolloran's startup report. Display quantiles, graph the submission rate, etc