Unified Telemetry/Status reports/TopLineKPI's/currentReport
From MozillaWiki
Top level KPI status report May 20, 2016
Overall Project Health
Last week: Green.
This week: Yellow.
Project scope and deliverables
Team is responsible for making sure the engagement ratio is justified and appearing on dashboard. As per Product Management, the ratios that are being targeted (and their date) are:
- FF desktop (Q1) - done
- FxA (Q1) - done
- Mobile (iOS + android) (Q2)
- Best of web - pocket (Q1) done and hello (Q2/Q3)
- Test pilot (Q2)
- Activity stream (Q2)
- DevTools (Q3)
- Push (Q3)
- Search volume (Q3)
Exec Summary
- Hello in yellow due to tight timeframe
- Android Engagement ratio in yellow due to needing more time in production for validation than quarter allows
- decision to make topline KPI as landing page at https://metrics.services.mozilla.com/
- test pilot as next KPI
Kpi's and delivery status
| Description of KPI | Status | Active user definition | justification doc | target date / link to dashboard | next steps | implementation tracking ticket |
|---|---|---|---|---|---|---|
| Firefox desktop ratio | green | done | done | see "ratio" | need to plan steps 2&3 | bugzilla |
| Firefox accounts | green | done | same as FF desktop | 3/8 | wire up to top level dashboard | bugzilla |
| Firefox Mobile - iOS | yellow | TBD | TBD | TBD | Meeting with teams to understand how the ratio is gathered and visualized | bugzilla |
| Firefox Mobile - fennec | Green | TBD | TBD | Q2 | Meeting with teams to understand how the ratio is gathered and visualized | bugzilla |
| green | done | done | done | Done | bugzilla | |
| Hello | yellow | done | done | dashboard landing spot? | bugzilla | |
| Test Pilot | green | in progress | Q2 | test pilot is being tasked with MVP - python notebook and viz. No further PM actions at this time. | bugzilla | |
| Activity Stream | red | yes | same as test pilot | bugzilla |
Accomplished for Last Period
- Test pilot data in s3 bucket (needs to be loaded into presto)
- Once in presto re:dash has a reserved space for dashboard
- Activity stream in Presto
Planned for Upcoming Period
- Saptarshi and Rebecca speaking of the engagement ratio and possible changes.
- Seasonality versus trends
- KPI page as landing page (main link https://metrics.services.mozilla.com/ goes to kpis dashboard)
Over to ops for implementation
- Test pilot on dashboard
Outstanding requests not yet road mapped into a release
| Description | State | Owner | Plan to Resolve/Mitigation | Target Date |
|---|---|---|---|---|
| Do all items live on a top level dashboard | new | team | Yes, as possible | done |
| pocket and hello do not have unique dashboards for top line KPI's | in process | team | adding to pocket to top line, hello tbd | TBD |
| iOS and Android - use adjust dashboard for KPI's? | new | team/Mobile | ratio does not appear on adjust dashboard, Q2 is goal for bring UT based numbers to populate dashboard | TBD |
| iOS and Android - when does mobile use UT to generate ratio and whats the cut over plan | in process | team/Mobile | timing TBD | TBD |
Important Links/References
- PRD (WIP)
- this includes data format, UI mock ups and delivery schedule
- Bug tree
- weekly meeting notes
