Support/MetricsDashboardPRD/Metrics: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
No edit summary
No edit summary
Line 2: Line 2:


=Legend=
=Legend=
Unless specified, all metrics are collected weekly and displayed for the last week.  
Unless specified, metrics are '''range specific'''. This means they are collected weekly, displayed for the last week, and cannot be displayed for other date ranges. For example, the "number of KB contributors" metric cannot be collected daily and accumulated to display the weekly metric, since the same contributors might have been active during several days, making the weekly metric incorrect.
* '''+''' : metric can accumulate and should be collected daily, even though we probably want to display the result as a weekly total. These metrics would support a custom date range if we added UI for it.
 
* '''@''' : this date range dependent metric should be collected monthly, in addition to weekly.
Unless specified, metrics are coming from the TikiWiki db (using SQL queries).
 
* '''+''' : metric is not range specific and should be collected daily even though we will display the metric with the weekly date range by default. Metrics that are not range specific will support a custom date range if/when we add UI for it.
* '''@''' : this range specific metric should be collected monthly ''and'' weekly.
* '''(Om)''' : metric is coming from Omniture
 
=Date ranges=
* Last week -- this is the default range and is supported by all metrics
* Last month -- only supported by '''+''' and '''@''' metrics, as explained above
* Custom date range -- only supported by '''+''' metrics, as explained above


=Metrics=
=Metrics=
Line 10: Line 19:
'''Overview'''
'''Overview'''
* @Number of unique visitors (Om)
* @Number of unique visitors (Om)
* +Number of new forum threads (Tiki)
* +Number of new forum threads
* +Number of new live chats (Tiki)
* +Number of new live chats  
* +Number of new KB articles (Tiki)
* +Number of new KB articles
* Number of active contributors (Calculated from other metrics)
* Number of active contributors  
* Number of new contributors (ditto)
* Number of new contributors
* +Number of new registered accounts
* +Number of new registered accounts
* @Combined total CSAT score (for KB, forum, chat)
* @Combined total CSAT score (for KB, forum, chat)
Line 49: Line 58:
* +Number of chats with problem solved
* +Number of chats with problem solved
* +Number of chats to follow up on
* +Number of chats to follow up on
* % chats answered (could be calculated from the "number of chats" metrics above)
* chats answered % (could be calculated from the "number of chats" metrics above)
* % chats solved (could be calculated from the "number of chats" metrics above)
* chats solved % (could be calculated from the "number of chats" metrics above)
* % chats to follow up on (could be calculated from the "number of chats" metrics above)
* chats to follow up on % (could be calculated from the "number of chats" metrics above)
* +Number of hours open
* +Number of hours open
* @CSAT score
* @CSAT score
Line 76: Line 85:
* +Number of front page hits/inproduct front page hits (Om)
* +Number of front page hits/inproduct front page hits (Om)
* Time spent on page (should be on Om) [djst: not possible to get other than a distribution average. i think we might give this one a miss]
* Time spent on page (should be on Om) [djst: not possible to get other than a distribution average. i think we might give this one a miss]
* Was this helpful votes and % (Tiki)
* Was this helpful votes and %
* Was this understandable votes and % (Tiki)
* Was this understandable votes and %
* '''CSAT score and vote count (Tiki)'''
* CSAT score and vote count
* '''Calculated score'''
* Calculated score
* '''Calculated helpfulness'''
* Calculated helpfulness


'''Locale-based metrics''' --  
'''Locale-based metrics''' --  

Revision as of 08:56, 9 April 2009

Here are all the sections. You'll note that some metrics are in more than one section.

Legend

Unless specified, metrics are range specific. This means they are collected weekly, displayed for the last week, and cannot be displayed for other date ranges. For example, the "number of KB contributors" metric cannot be collected daily and accumulated to display the weekly metric, since the same contributors might have been active during several days, making the weekly metric incorrect.

Unless specified, metrics are coming from the TikiWiki db (using SQL queries).

  • + : metric is not range specific and should be collected daily even though we will display the metric with the weekly date range by default. Metrics that are not range specific will support a custom date range if/when we add UI for it.
  • @ : this range specific metric should be collected monthly and weekly.
  • (Om) : metric is coming from Omniture

Date ranges

  • Last week -- this is the default range and is supported by all metrics
  • Last month -- only supported by + and @ metrics, as explained above
  • Custom date range -- only supported by + metrics, as explained above

Metrics

Overview

  • @Number of unique visitors (Om)
  • +Number of new forum threads
  • +Number of new live chats
  • +Number of new KB articles
  • Number of active contributors
  • Number of new contributors
  • +Number of new registered accounts
  • @Combined total CSAT score (for KB, forum, chat)

Knowledge base (All tiki queries)

  • +Number of modified articles
  • +Number of new articles
  • Number of active KB contributors
  • Number of new KB contributors
  • @ratio of votes that say articles are helpful (%)
  • ratio of votes that say articles are easy to understand (%)
  • @CSAT score
  • +Number of CSAT votes

Forums (All tiki queries)

  • +New forum threads
  • +Number of replies by contributors (total)
  • Number of threads in each status category (after 1 week)
  • Number of threads with no replies for over 1 week
  • Number of active contributors
  • Number of new contributors
  • @CSAT score
  • +Number of CSAT votes

Live Chat Many of these aren't done with queries so there will be some work with zzxc here.

  • +New chat requests
  • Number of active contributors
  • Number of new contributors
  • +Number of chats answered
  • +Number of chats with problem solved
  • +Number of chats to follow up on
  • chats answered % (could be calculated from the "number of chats" metrics above)
  • chats solved % (could be calculated from the "number of chats" metrics above)
  • chats to follow up on % (could be calculated from the "number of chats" metrics above)
  • +Number of hours open
  • @CSAT score
  • +Number of CSAT votes

Traffic and usage All of these come from Omniture unless otherwise noted

  • +Total pages hits
  • @Number of unique visitors
  • Start page # entries and bounce rate
  • Inproduct start page # entries and bounce rate
  • +Number of searches
  • +Number of people who go to Ask a question
    • from a KB article,
    • from a search results page,
    • directly.
  • Number of people who go to Ask a question and then go to forums, live chat [djst: please clarify this one, cheng]
  • Top search terms (from search plugin ideally)

KB article metrics -- This will ideally be ALL of the KB articles with metrics for each. If this is too hard to do, we should store the data and present the bolded metrics as a top-5 articles per category.

  • +Number of page hits (Om)
  • +Number of search-hits (Om)
  • +Number of front page hits/inproduct front page hits (Om)
  • Time spent on page (should be on Om) [djst: not possible to get other than a distribution average. i think we might give this one a miss]
  • Was this helpful votes and %
  • Was this understandable votes and %
  • CSAT score and vote count
  • Calculated score
  • Calculated helpfulness

Locale-based metrics -- Store data for all locales, present only 5 for each.

  • Rank of locales by activity
  • Rank of locales by completeness
  • Rank of locales by number of visitors (Om)