Firefox/Desktop Onboarding/OKRs/Q3

From MozillaWiki
Jump to: navigation, search

Aug 2, 2017

Doc - 2017 Firefox Desktop Onboarding OKR's

Overall Q3 Score: 80.42%

Q3 OKR Progress

Objective Key Result Confidence Features Notes
Aug 2 Aug 16 Aug 30 Sep 13 Score
1. Improve Firefox retention 1.1 Land onboarding tour overlay with QA sign-off (no blocking bugs) going into beta 100% 100% -- 100% 100%
1.2 Land onboarding tour notifications with QA sign-off (no blocking bugs) going into beta 100% 100% -- 100% 100%
  • Bug 1357008 - [User Story] [Tour Notification] As Firefox team, we want to send tour notifications of product features that we believe matter to user
1.3 Land new user tour content for v57 with QA sign-off (no blocking bugs) going into beta 100% 100% -- 100% 100%
  • Bug 1268708 - [meta] Allow a like-new experience for returning users
  • 8/2/2017
    • Data analysis was conducted
    • May not need to run another experiement on this
1.4 Run experiment related to data migration which identifies the cause of changes in retention
  • Analyze data migration telemetry to identify causes in retention.
66.7% 66.7% -- 75% 75%
  • 8/2/2017
    • Data analysis was conducted
    • May not need to run another experiement on this
  • 8/16/2017
    • Need to clarify with pdol on next steps. Keeping confidence level the same till then.
  • 8/20/2017
    • we were able to identify correlation
    • need to do more exploration and iterative implementation to figure out exact technically cause and possible solution that will overall help retention.
  • 8/20/2017
    • Septarshi has ran thhroughh analysis and findings with thhe team and engineering teams have discussed possible options to reduce jank that will
1.5 Publish draft UX spec for product documentation which includes 8 individual product areas 75% -- -- -- 0%
2. Learn about Chrome churners, and about first Firefox session actions 2.1 Identify top three reasons Chrome users leave Chrome and suggest actionable ways to lure Chrome users to Firefox 73.3% 100% -- 100% 100%
  • 8/16/17
    • Study in progress. Will be able to analyze qualitative data and make actionable suggestions by end of quarter.
  • 10/4/2017
  • jdavidson is working with business strategy teams to circulate findings to enact change. mmayo is looking at a "switch from Chrome to Firefox" page and findings were shared with dtensor's team.
    • action item: Pdol and Jdavidson to sync up with moz.org team to find more information about this web page.
2.2 Run heartbeat study, publish top 3 things user do immediately after opening Firefox 76.7% 100% -- 25% 0%
  • TBD
  • 8/16/2017
    • Study is on pause. Kamyar is confident that we will conduct study and analyze data by end of quarter.
  • 8/20/2017
    • rrayborn has a study ready but has not launched yet.
  • 10/4/2017
    • no new status. we are still unsure if this went out.
2.3 Publish top 5 correlations between telemetry attributes in first 10 minutes (or first session) of use and churn after day 0 60% 60% -- 25% 90%
  • file:///Users/mozilla/Library/Containers/com.apple.mail/Data/Library/Mail%20Downloads/AB80A5CC-8A8E-4E65-98FF-93849AC1F3F9/first_session_roughdraft3.html
  • 8/2/2017
    • Many unknowns. Need to clarify status.
  • 8/16/2017
    • Keeping the confidence level the same as last week till we talk to pdol and septarshi
  • 8/20/2017
    • Preliminary findings have been shared with cmore and pdol.
  • 10/4/2017
    • findings looked at 3 week retention and not first 10 minutes. Although did cover first session. Findings were a list of behaviors that people did in the first session of between churners vs. retainers.
3. Keep existing / lapsed users* 3.1 Land updating user tour content for v57 with QA sign-off (no blocking bugs) going into beta [existing / lapsed users] 86.6% 86.6% -- 100% 100%
3.2 Land profile refresh for lapsed users for v57 with QA sign-off (no blocking bugs) going into beta 80% 80% -- 100% 100%
  • Bug 1369255 - Profile clean-up option in stub installer
3.3 Land new user tour for lapsed users for v57 with QA sign-off (no blocking bugs) going into beta 86.7% 86.7% -- 100% 100%
3.4 Complete implementation of v57 preview content (for What’s New page) (to land in v56 dot release) 53.3% 53.3% -- 100% 100%
  • Bug 1360461 - [UX] Pre-Photon In-product message UX Specs
  • 8/16/2017
    • verdi clarifying next steps in meeting today. Keeping confidence level the same till we get more information.
  • 8/20/2017
    • Completed by content and marketing team. Page is built [here].