Unified Telemetry/Status reports/TopLineKPI's/currentReport

Top level KPI status report March 21, 2016

Overall Project Health

Last week: Green.

This week: Green.

Project scope and deliverables

Team is responsible for making sure the engagement ratio is justified and appearing on dashboards. As per Product Management, the ratios that are being targeted (and their date) are:

  • FF desktop (Q1) - done
  • FxA (Q1) - done
  • Mobile (iOS + android) (Q2)
  • Best of web - pocket (Q1) done and hello (Q2)
  • Test pilot (Q2)
  • Activity stream (Q2)

Exec Summary

  • Firefox desktop ratio, FxA and Pocket now appears on summary dashboard
  • next set of deliverables being planned:
    • Mobile - early Q2 using the same structure as was used for desktop engagement ratio. Need to retire risk around ping quality.
    • Hello - Mid May commitments to partner. Kick off this week.
  • Need to understand the impact of moving from using activity date versus submission date (engagment ratio calculations) and plan work to update existing dashboards

Kpi's and delivery status

Description of KPI Status Active user definition justification doc target date / link to dashboard next steps implementation tracking ticket
Firefox desktop ratio green done done see "ratio" need to plan steps 2&3 bugzilla
Firefox accounts green done same as FF desktop 3/8 wire up to top level dashboard bugzilla
Firefox Mobile - iOS yellow TBD TBD TBD Meeting with teams to understand how the ratio is gathered and visualized bugzilla
Firefox Mobile - fennec yellow TBD TBD TBD Meeting with teams to understand how the ratio is gathered and visualized bugzilla
Pocket green done done done wire up data to dahsboard, monitor bugzilla
Hello yellow done done dashboard landing spot? bugzilla
Test Pilot red in progress test pilot is being tasked with MVP - python notebook and viz. No further PM actions at this time. bugzilla
Activity Stream red yes same as test pilot bugzilla

Accomplished for Last Period

  • KPis dashboard went live with fixes
  • Begun planning next phase, identifying risk and resourcing for next rev of deliverables.


Planned for Upcoming Period

  • Mobile - Early Q2
    • Ping quality issue - when can we switch the dashboard on.
  • Mau/Dau calculations - construct python notebook showing formulation with core ping
  • Hello (System level add-on) - kick off meeting
    • understand if we use UT, may require the integration of server side metrics


Outstanding requests not yet road mapped into a release

Description State Owner Plan to Resolve/Mitigation Target Date
Do all items live on a top level dashboard new team Yes, as possible done
pocket and hello do not have unique dashboards for top line KPI's in process team adding to pocket to top line, hello tbd TBD
iOS and Android - use adjust dashboard for KPI's? new team/Mobile ratio does not appear on adjust dashboard, Q2 is goal for bring UT based numbers to populate dashboard TBD
iOS and Android - when does mobile use UT to generate ratio and whats the cut over plan in process team/Mobile timing TBD TBD

Important Links/References