Identity/Metrics: Difference between revisions
< Identity
Jump to navigation
Jump to search
| Line 20: | Line 20: | ||
# '''One Metric That Matters: Total number of Firefox Accounts''' https://bugzilla.mozilla.org/show_bug.cgi?id=972105 | # '''One Metric That Matters: Total number of Firefox Accounts''' https://bugzilla.mozilla.org/show_bug.cgi?id=972105 | ||
# '''Accounts created per day''' https://bugzilla.mozilla.org/show_bug.cgi?id=968973 | # '''Accounts created per day''' https://bugzilla.mozilla.org/show_bug.cgi?id=968973 | ||
#* '''Higher Priority Segmentations''': https://bugzilla.mozilla.org/show_bug.cgi?id=968990 | |||
#* '''Lower Priority Segmentatons''': https://bugzilla.mozilla.org/show_bug.cgi?id=969003 | |||
#* We'll get other auth server endpoints as well, in particular account/login and cert/sign | |||
# '''Active daily users''' https://bugzilla.mozilla.org/show_bug.cgi?id=968983 | # '''Active daily users''' https://bugzilla.mozilla.org/show_bug.cgi?id=968983 | ||
# '''UX flow analysis''' https://bugzilla.mozilla.org/show_bug.cgi?id=969007 (lower priority) | # '''UX flow analysis''' https://bugzilla.mozilla.org/show_bug.cgi?id=969007 (lower priority) | ||
Revision as of 22:12, 21 February 2014
Last updated: 2014/02/21
Firefox Accounts
Stakeholders
- Product Managers, including PMs for services that rely on FxA: what does FxA adoption look like?
- UX: are users successful, where do they get stuck?
User Stories
Metrics/Monitoring requirements/priorities driven by user stories
- all metrics story bugs in bugzilla
- Nutshell Summary written for a Feb 2014 meeting
Infrastructure
- Blocking on development environment: logging stack with production data (heka, elasticsearch, kibana)
Metrics
- One Metric That Matters: Total number of Firefox Accounts https://bugzilla.mozilla.org/show_bug.cgi?id=972105
- Accounts created per day https://bugzilla.mozilla.org/show_bug.cgi?id=968973
- Higher Priority Segmentations: https://bugzilla.mozilla.org/show_bug.cgi?id=968990
- Lower Priority Segmentatons: https://bugzilla.mozilla.org/show_bug.cgi?id=969003
- We'll get other auth server endpoints as well, in particular account/login and cert/sign
- Active daily users https://bugzilla.mozilla.org/show_bug.cgi?id=968983
- UX flow analysis https://bugzilla.mozilla.org/show_bug.cgi?id=969007 (lower priority)
Monitoring
- Users failing to create/sign in to service https://bugzilla.mozilla.org/show_bug.cgi?id=974130
Dependencies
- First pass PM/UX metrics logged: https://github.com/mozilla/fxa-auth-server/issues/372
- All FxA prod data in Heka/ES/somewhere kparlante and trink can access
- fxa-auth-server API changes to collect pass through information: https://github.com/mozilla/fxa-auth-server/issues/351
Timeline
Resources
- Notes from meetings with svcops: https://id.etherpad.mozilla.org/fxa-metrics-monitoring
- PM/UX related user stories: https://id.etherpad.mozilla.org/fxacct-metrics-user-stories
- QA/SE Monitoring user stories: https://id.etherpad.mozilla.org/fxa-monitoring-user-stories
- Shared Services : Describes shared services for heka/elasticsearch/kibana deployments. FxA will likely use its own deployment, based on this one.
- FHR work happening separately (Desktop: https://bugzilla.mozilla.org/show_bug.cgi?id=958561, Android: https://bugzilla.mozilla.org/show_bug.cgi?id=891600)
- https://wiki.mozilla.org/ADI
- Minimum Viable Metrics : The original design for minimum set of metrics required before going live with real accounts. Original plan was WMF & Marketplace on FxOs, Sync actually went first (Desktop & Android).
Older Notes
- https://id.etherpad.mozilla.org/fxacct-metrics
- https://id.etherpad.mozilla.org/fxacct-mvm
- https://id.etherpad.mozilla.org/fxacct-mvm-details
- https://id.etherpad.mozilla.org/fxacct-metrics-fraud-detection