Leanplum Contextual Hints: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
Line 41: Line 41:
! Hyp. # !! Message Name !! Trigger !! Targets  
! Hyp. # !! Message Name !! Trigger !! Targets  
|-
|-
| H1 || Launch Promote - Default Browser || App Start || Test: en-USPost-test: en, en-gb, en-ca, de, zh-tw inUS, CA, AU, UK, DE, TW, HK, SG  
| H1 || Launch app - Default Browser promotion || App Start || Test: en-US 10% of release population, Post-test: en, en-gb, en-ca, de, zh-tw inUS, CA, AU, UK, DE, TW, HK, SG  
|-
|-
| H1 || Load Bookmark - Promote Default Browser || Load bookmark || Test: en-USPost-test: en, en-gb, en-ca, de, zh-tw inUS, CA, AU, UK, DE, TW, HK, SG  
| H1 || Load Bookmark - Default Browser promotion || Load bookmark || Test: en-US 10% of release population, Post-test: en, en-gb, en-ca, de, zh-tw inUS, CA, AU, UK, DE, TW, HK, SG  
|-
|-
| H2 || Firefox launches - add-ons promotion || App start || Test: en-US Post-test: en, en-gb, en-ca, de, zh-tw in US, CA, AU, UK, DE, TW, HK, SG  
| H2 || Launch app - Add-ons promotion || App start || Test: en-US 10% of release population, Post-test: en, en-gb, en-ca, de, zh-tw in US, CA, AU, UK, DE, TW, HK, SG  
|-
|-
| H3 || Save Password - Promote Sync || Save password || Test: en-USPost-test: en, en-gb, en-ca, de, zh-tw inUS, CA, AU, UK, DE, TW, HK, SG  
| H3 || Save Password - Sync promotion || Save password || Test: en-US 10% of release population, Post-test: en, en-gb, en-ca, de, zh-tw inUS, CA, AU, UK, DE, TW, HK, SG  
|}
|}
For more detail about the triggers and deep links in Android, please go to this page[http://gecko.readthedocs.io/en/latest/mobile/android/fennec/mma.html]
For more detail about the triggers and deep links in Android, please go to this page[http://gecko.readthedocs.io/en/latest/mobile/android/fennec/mma.html]

Revision as of 20:41, 5 July 2017

Test Plan (iOS & Android) - July 2017

Goal:

With the initial implementation of the Leanplum SDK into our mobile browser products, we want to start A/B testing contextual hints to increase retention.

Overarching Hypothesis:

We believe that by promoting contextual hints that helps users explore and change settings within the browser, we will drive DAUs and retention.

iOS

iOS Hypothesis 1:

We believe that by promoting Focus to our privacy conscious users inside Firefox, we will increase installs and DAUs in Focus, and increase retention on both apps (We know that users who have Focus and Firefox installed retain better (Adjust)).

iOS Hypothesis 2:

We believe that by promoting Sync to our users inside Firefox, we will increase DAUs and retention as Firefox Account data shows that users with 2 synced devices retain longer.

Hyp. # Message Name Trigger Targets
H1 Opened New Tab - Focus Promotion Open new tab Test: en-US 10% of release population, Post-test: en, en-gb, de, zh-tw
H2 Open Bookmark - Sync Promotion Open bookmark Test: en-US 10% of release population, Post-test: en, en-gb, de, zh-tw
H3 Save Bookmark - Sync Promotion Save bookmark Test: en-US 10% of release population, Post-test: en, en-gb, de, zh-tw

Android

Android Hypothesis 1:

We believe that by prompting users to change their default browser to Firefox, we will increase DAUs and retention.

Android Hypothesis 2:

We believe that by promoting add-ons to our users inside Firefox, we will increase DAUs and retention.

Android Hypothesis 3:

We believe that by promoting Sync to our users inside Firefox, we will increase DAUs and retention as Firefox Account data shows that users with 2 synced devices retain longer.

Hyp. # Message Name Trigger Targets
H1 Launch app - Default Browser promotion App Start Test: en-US 10% of release population, Post-test: en, en-gb, en-ca, de, zh-tw inUS, CA, AU, UK, DE, TW, HK, SG
H1 Load Bookmark - Default Browser promotion Load bookmark Test: en-US 10% of release population, Post-test: en, en-gb, en-ca, de, zh-tw inUS, CA, AU, UK, DE, TW, HK, SG
H2 Launch app - Add-ons promotion App start Test: en-US 10% of release population, Post-test: en, en-gb, en-ca, de, zh-tw in US, CA, AU, UK, DE, TW, HK, SG
H3 Save Password - Sync promotion Save password Test: en-US 10% of release population, Post-test: en, en-gb, en-ca, de, zh-tw inUS, CA, AU, UK, DE, TW, HK, SG

For more detail about the triggers and deep links in Android, please go to this page[1]