Firefox OS/Metrics: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(Roadmap)
(edited)
Line 90: Line 90:
**Inclusion of device metrics in A/B testing (likely to be moved beyond 2.5)
**Inclusion of device metrics in A/B testing (likely to be moved beyond 2.5)
**[https://bugzilla.mozilla.org/1179004 OTA collection of App Startup time, device startup time (1179004)].  
**[https://bugzilla.mozilla.org/1179004 OTA collection of App Startup time, device startup time (1179004)].  
**Accuracy of Retention [https://bugzilla.mozilla.org/1198164, FTU ping should include info on whether User opt-in for metrics 1198164]
*Activations
*Activations
** [https://bugzilla.mozilla.org/1171685 FTU Ping: Avoid counting repeat pings from a known device. 1171685.]
** [https://bugzilla.mozilla.org/1171685 FTU Ping: Avoid counting repeat pings from a known device. 1171685.]
Line 98: Line 99:
**[https://bugzilla.mozilla.org/1152000 Framework (Metabug: 1152000) to collect custom Metrics and histogram]
**[https://bugzilla.mozilla.org/1152000 Framework (Metabug: 1152000) to collect custom Metrics and histogram]
**[https://bugzilla.mozilla.org/1181295 Converge the collection of items under "FxOS Health Report" branding. (1181295)]
**[https://bugzilla.mozilla.org/1181295 Converge the collection of items under "FxOS Health Report" branding. (1181295)]
**Support for Non Phone devices: [https://bugzilla.mozilla.org/1171685 Using TV serial number to avoid counting repeat pings. 1171685.]  
**Non Phone devices support: [https://bugzilla.mozilla.org/1171685 Using TV serial number to avoid counting repeat pings. 1171685.]  
**B2GDroid Support (In planning)
**B2GDroid Support ([https://bugzilla.mozilla.org/show_bug.cgi?id=1198338 B2GDroid Metric Collection 1198338])
**AddOns Support (In planning)
**AddOns Support (In planning [https://bugzilla.mozilla.org/1198346: AddOns Metric collection 1198346])
 
|
|
|-
|-

Revision as of 00:20, 27 August 2015

Goals

The FxOS Metrics project enables making data driven decisions for the following:

  • Understanding how FxOS is doing in the market versus product/business goals
  • Gaining insights from quantitative and qualitative data, to enable improve the product/business goals
  • Understanding usage models, to improve future product development and opportunities
  • Determining effectiveness of marketing campaigns.

Metrics

Customer lifecycle Metrics to be collected Dashboard
Acquiring Customers
  • Partners/Channels though which devices are sold
 Dashboard: Choose Operator/OEM/Country combination of channel

Activation of Devices

  • Total number of Activated devices
 Dashboard: Choose 'All' in SW/Operator/OEM/ to get a count

Retention Of Customers

  • MAU (Monthly Active Users)
  • Apps usage per month
  • Performance (App Startup time, Power consumption)
 In Progress
Revenue
  • Number of searches done
  • Paid App Downloads
 In Progress
Referral
  • Net Promoter Score
    • Recommendations from Users
    • User Satisfaction Factor
 Future

Roadmap

FxOS Release Metrics to be collected Bugs
1.3
  • Engg: 986701,997960
  • Legal: 980920
  • Privacy: 992487
2.1
  • Client: 982663
  • Legal: 1021259, 1109429
2.2
2.5
Mid-2016 (In Planning) (In Planning)
  • Activation
    • Optimizing FTU: % of signups to Moz services: FxAccounts, FMD
  • Retention
    • Advanced A/B testing
    • Churn Rate & User Lifecycle Analysis (In planning)
  • Referral
    • Net Promoter Score (User Satisfaction Factor)
End-2016 (In Planning)
  • Retention
    • Content Recommendation Engine based on usage (User Benefit)

User Stories

Virtual Team

  • Device Engg: Tamara Hills, Gregor Wagner, Russ Nicoletti
  • Device QA: Shing Lyu
  • Server Metrics: Dave Zeber, John Jensen
  • Engg Program Mgmt: Michael Treese
  • Planning: Dominik Strohmeier
  • Product Mgmt: Ravi Dandu
  • Marketplace Product Mgmt: David Bialer
  • Marketplace Program Mgmt: tbd
  • Marketplace Engg: Andy McKay, Rob Hudson
  • Alumni: Marshall Culpepper, Hema Koka

Links

Retrieved from "https://wiki.mozilla.org/index.php?title=Firefox_OS/Metrics&oldid=1092217"