Update:RequirementsStats

From MozillaWiki
Jump to navigation Jump to search
The printable version is no longer supported and may have rendering errors. Please update your browser bookmarks and please use the default browser print function instead.

This a wishlist of AMO and Addons key metrics.

Some of these metrics already exist in various parts of the AMO admin control panel but may require consolidation

STATUS

TO DO

  • Map out the user flows and indicate what we currently measure and what we need to measure at each point in the flow (e.g. instrument button clicks, count impressions, etc...)
  • Draw the Venn of users and how they breakdown along different dimensions
  • Should we add an uninstall ping?
  • What happens when an add-on updates itself to version n+1 but doesn't include localization data for an existing locale? (e.g. you have pl installed and then upgrade to n+1 which doesn't have a pl localization resources)
  • Add a time element to ALL of the data below

Global

  • % of Firefox users who have "tried" an add-on (and absolute number) [May be impossible to measure]
  • % of Firefox users with 1 add-on installed (and absolute number)
  • % of Firefox users with 2 add-ons installed (and absolute number)
  • % of Firefox users with 3 add-ons installed (and absolute number)
  • % of Firefox users with 4 add-ons installed (and absolute number)
  • % of Firefox users with 5 add-ons installed (and absolute number)
  • % of Firefox users with at more than 5 add-ons installed (and absolute number)
  • Histogram based on number of add-ons installed

Add-ons Population

(Ap=AMO-hosted public, As=AMO-hosted sandboxed, N=Non-AMO hosted)

  • Total add-on population: grand total (by Ap, As, N)
  • Per app by add-on type: Extensions Themes, Dictionaries, Search Plugins, Plugins & Lang Packs (by Ap, As, N)
  • Total add-on population for Mozilla platform
    • Firefox
    • Thunderbird
    • Seamonkey
    • Sunbird
    • Flock, Miro, Songbird, etc...
  • Competitor offerings: Safari plugins, IE add-ons, Opera

Add-ons Velocity

During the last week/month, which category areas have seen the most activity? (Top 10)

    • Most addons updates & nominated from sandbox
    • Most user reviews
    • Most user discussion
  • Top 20 most highly rated addons for all time/last week/last month
  • For specific add-on, which ones have had the most activity. As a % of reviews/download, reviews/update ping, etc... (or other buzz metric)

Add-ons Downloads & Activity

  • Total number of addons downloaded all time/last week/last month
    • By Browser Version
    • By Operating System
    • By Locale
    • By geoip?
  • Top 20 most downloaded addons for all time/last week/last month
  • Top 20 most downloaded (non-recommended) addons for all time/last week/last month
  • Peak Session Count for last week, last month, average session count per day

Add-On Usage

  • Total number of active daily pings (today, avg for last week, avg for last month)
    • By Locale
    • By Browser Version
    • By OS
  • Total number of active users
  • Average number of Addons Per User
  • Percent of Firefox Users with at least n add-ons
  • Top 100 most update ping'ed add-ons
    • By Browser Version
    • By OS
    • By Locale
  • Overall distribution of specific add-ons vs. Firefox add-on user population

Basic Site Stats (urchin/Google Analytics)

  • Page Views
    • {By Browser Version, OS}
  • Unique Users
  • Session Counts
  • Click paths
  • Singular add-on impression data (how often is X shown). Need to consider PV's as well as API
  • Top 50 search terms
    • {By AMO Site Locale - e.g. 60% en-US, etc...}

Localization Stats

  • For each supported locale
    • Add-On Availability/Coverage
    • Add-On Metadata Availability/Coverage
    • AMO Localization

Localization Metrics for langpack producers

  • This is not just AMO but the main l10n work in the product
  • Pings from active users
  • Downloads (separate from upgrades)
  • CSV format
  • Platform data

Addons Developers view

  • Downloads per week/month (preferably as CSV data) - to see new user penetration. Should differentiate upgraders from new users
  • Pings per week/month - to see active users.

Editor Community Metrics

  • How many Reviews are currently in the Moderation Queue
  • How many Add-Ons are currently in the Pending Updates Queue
  • How many Add-Ons are currently in the Nominated Queue

Efficiency measure - Over the last week/month

  • How many Reviews were processed from the Moderation Queue
  • How many Add-Ons were processed from the Pending Updates Queue
  • How many Add-Ons were processed from the Nominated Queue
  • What is the average time in the queue? Is the avg age improving over time?
  • How many editors do we have?
  • What percentage of the work over the past week/month is done by each editor?