Telemetry/2013-02-21

From MozillaWiki
Jump to: navigation, search

Metrics/Telemetry 2013-02-21

Attendees: Vladan Djeric, Daniel Einspanjer, Annie Elliott, Taras Glek, Lawrence Mandel, Irving Reid

Metrics org changes

Gilbert has left Mozilla. Metrics will now be organized with Annie, Daniel and Saptarshi reporting directly to Jay. Annie is responsible for BI/dashboarding, Daniel is responsible for backend, and Saptarshi is responsible for the analysts.

Status

Idle-daily ping
  • Metrics concerns
    • load on system (ip filtering hasn't made a significant change)
    • how is the data coming in (seeing docs appear over multiple days but volume of requests we see doesn't match up with volume consumed for storage)
    • data quality from analysis point of view (docs from misbehvaing clients are ultimately polluting data)
  • Don't have a really good handle on any of the concerns - if we can understand why a client is misbehaving then we can understand the risk better
  • Source is a variety of locations, no significant outlier - lot of countries, lots of ISPs
  • Irving suggested finding a sympathetic sys admin to get profile from a machine
    • Daniel will investigate by doing IP org lookups to look for places where we might be able to get the profile of the actual client.
  • Nathan saw some odd values for timestamps, perhaps machines with bad system clocks
METRICS-1366 Investigate spikes in Telemetry submissions
  • Investigation ongoing
  • Daniel - past two weeks this has taken a background processing task
  • Daniel - still fairly high priority, p2
  • Taras - given that this is distributed across channels let's focus on nightly so that we can get chromehangs and related data
BIV-85 (bug 699670) Add sum/average/stddev to telemetry dashboard
BIV-224 (bug 810034) Telemetry Dashboard session timeout is too quick
  • Landed in production early this week. Now notifies user before session times out.
METRICS-1356 (bug 778809) Build script to output distribution of simple measure values for bucket tuning
  • On track to close 2013-02-22
BIV-114 (bug 707280) Need simple queries
  • Harsha worked on this during the week and finished most of it today.
  • Prerelease version is available, some further tweaks to be made tomorrow and Monday (Feb 21).
METRICS-1363 (bug 821403) Make raw shutdown times available
  • Depends on BIV-114
  • This is a test case for the simple queries feature, will be delivered early next week.
BIV-110 (bug 679522) Display distribution of simple values and allow filtering based on them
  • Dev work on track with simple query script.
  • Metrics will provide an example of using the script for this purpose and go over it with perf when you are ready.

Other

  • Taras: We want to figure out how to measure opt-in for Telemetry. We've recently changed the opt-in for FHR and need to know if opt-in rates decrease after it is released.