Identity/Metrics

Last updated: 2014/02/10

Firefox Accounts

Stakeholders

• Product Managers, including PMs for services that rely on FxA: what does FxA adoption look like?
• UX: are users successful, where do they get stuck?
• QA, Dev, Ops: Is the service responsive? Where are errors happening?
• OpsSec, AppSec: Fraud detection

Use Cases

• PM/UX related use cases: https://id.etherpad.mozilla.org/fxacct-metrics-user-stories
• QA/SE related use cases: https://id.etherpad.mozilla.org/fxa-monitoring-user-stories

Timeline

• Unsorted
  • First pass PM/UX metrics logged: https://github.com/mozilla/fxa-auth-server/issues/372
  • ADU metric logged
  • ADU working on dev stack
• Feb 7
  • All FxA prod data in Heka/ES/somewhere kparlante and trink can access
  • PM/UX use cases logged in bugzilla : [[Metrics%20Story&resolution=---&resolution=DUPLICATE&classification=Client%20Software&query_format=advanced&short_desc_type=allwordssubstr&component=Server%3A%20Firefox%20Accounts&product=Mozilla%20Services Stories in Bugzilla]]
  • QA/SE use cases logged in bugzilla
  • Roadmap/timeline documented
  • kparlante to document endpoints for trink, so he can configure heka for response time use cases
  • ADU metric defined
• Feb 14
  • Response time dashboard working end to end on dev stack (with production data)
• Feb 21
  • Accounts created/day use case working on dev stack
• Feb 28

Resources

• Minimum Viable Metrics : The original design for minimum set of metrics required before going live with real accounts. Original plan was WMF & Marketplace on FxOs, Sync actually went first (Desktop & Android).
• Shared Services : Describes shared services for heka/elasticsearch/kibana deployments. FxA will likely use its own deployment, based on this one.
• Svcops Timeline Planning
• Notes from meetings with svcops: https://id.etherpad.mozilla.org/fxa-metrics-monitoring
• https://wiki.mozilla.org/ADI

Older Notes

• https://id.etherpad.mozilla.org/fxacct-metrics
• https://id.etherpad.mozilla.org/fxacct-mvm
• https://id.etherpad.mozilla.org/fxacct-mvm-details
• https://id.etherpad.mozilla.org/fxacct-metrics-fraud-detection

Persona

• Persona Metrics