MozillaWiki

QA/Fennec/LeanPlum Integration iOS: Difference between revisions

Page Discussion

QA/Fennec/LeanPlum Integration iOS (view source)

Revision as of 08:50, 7 September 2017

1,072 bytes removed ,  7 September 2017
→‎Results
 
(28 intermediate revisions by the same user not shown)
Line 16: Line 16:
== Scope of testing ==
== Scope of testing ==
*The testing will be focus on
*The testing will be focus on
**P0 trigger:  open Firefox 2 times during the last 7 days
**P0 deeplink: push the dialog when user open Firefox


*P1 Triggers:
*Events Trigged:
**Loads articles
** First Launch
**Visiting a website 
**Dismiss Onboarding
**Download videos or any other media 
** Second Launch
**SavePassword
** The App is Launched
**SaveBookmark
** Opening a New Tab
**LoadBookmark
** Interacting with the URL bar
**Interact with search url area
** Bookmarking a Page
**When user take a screenshot
** Opening a Bookmark
**When user “Clear Private Data”
** Open Telephone link
** Opening MailTo link from a Web Page
** Clear Private Data
** Download Videos / Media
** Save Password and Login from Door Hangar
** Open Login Manager
** Download Focus
** Download Pocket
** Tap "Share" button
** Sign in to FxA
** Tap "Reader View" button


*P1 Deep links:
*User Attribute:
**Link to Set Default Browser settings  
**Focus Installed
**Link to specific Add-on page
**Klar Installed
**Link to sync signup/sign in
**Mailto preference
**Link to default search engine settings  
**Signed In Sync
**Link to “Save as PDF” feature
**Telemetry Opt In
**Take user directly to a Sign up for a newsletter
**App version
**Pocket Installed
 
*Deep links:
**Link to Sync settings
**Link to default mail app settings
**Link to default search engine settings
**Link to bookmark dialog / page 
**Link to history dialog
**Link into New Tabs settings
**Link into Homepage settings
**Link into Private Data settings
**Link to New Private Tab (or a way to highlight/bubble new private tab mask)
**Link to general settings page


== Environments ==
== Environments ==
Testing will be performed on following devices:  
Testing will be performed on following devices:  
* Phones
* Phones
** Android 4 -> Android 7
** iPhone 7 -> iOS 10.3.3
* Tablet
* Tablet
** Android 4 -> Android 7
** iPad Air 2 -> 10.3.3


== Specifications ==
== Specifications ==
*Doc: https://docs.google.com/document/d/19tKqSi8pQF2P21yLFfLtndmSKDjOtkYVdM1yWAWAmX8/edit#heading=h.e5cqukfqdea6
*Doc: https://docs.google.com/document/d/1VODMs1FIK8NpxpbeUFZDX7LXDI2pQ6wYASkJ0lIc_qk/edit
*In-app message is to inform/promote users of browser features that may be contextually relevant to them to increase engagement/retention
*In-app message is to inform/promote users of browser features that may be contextually relevant to them to increase engagement/retention
*Onboarding is to optimize the first Run experience per market and promote specific features  
*Onboarding is to optimize the first Run experience per market and promote specific features  
Line 52: Line 73:


== User stories ==
== User stories ==
* As Mozilla, we want to control the target users we push messages to by country and by locale
* As a privacy conscious user, I want to be informed that Firefox offers a simple and fast privacy focused browser called Focus
* As Mozilla, we want to push in app messages to users based on event triggers
* As a conscious user, I want to be aware of some relevant and helpful features within the app
* As a user, when I click on the push notification or in app message, I want to be taken directly to the page where I can take immediate actions
* As Mozilla, we want to change the onboarding feature introduction by users/countries so we can perform A/B testing
* As Mozilla, we want to push notifications (if we chooses to) to users even when Firefox is not running
* As a user, I want to stop receiving push notifications from Mozilla
 
== Acceptance Criteria==


= Testing details =
= Testing details =
== Test Cases==
*[https://docs.google.com/spreadsheets/d/1_ssHYnB5vmfkeCXCg66Tr0dku_oNF7NVvsl1bXojORo/edit#gid=0 Test Case LeanPlum]


== Testing days==
== Testing days==
===Date:2017-05-24===
===Date:2017-08-16===
* Created Test Plan
* Created Test Plan
===Date:2017-05-25===
 
* Created [https://docs.google.com/spreadsheets/d/1_ssHYnB5vmfkeCXCg66Tr0dku_oNF7NVvsl1bXojORo/edit#gid=0| Test Cases] - initial draft
== Test Cases==
===Date:2017-05-31===
===Date:2017-08-21===
* Tested on Nightly 55 with Nexus 5 (Android 6.0.1), Nexus 6 (Android 7.0) & Huawei Honor 5X (Android 5.1.1)
* Created [https://testrail.stage.mozaws.net/index.php?/suites/view/1380&group_by=cases:section_id&group_id=5702&group_order=asc | Test Cases]
* Logged Bugs:
 
**{{Bug|1368970}} - [LeanPlum] - Tapping on device back button doesn't dismiss the prompt
===Date:2017-08-23===
**{{Bug|1368995}} - [LeanPlum] - Prompt not shown when download a media content
* [https://testrail.stage.mozaws.net/index.php?/runs/view/5827&group_by=cases:section_id&group_order=asc | Started Test run] on:
**{{Bug|1369013}} - [LeanPlum] - Keyboard not displayed when going back from the Search Engine trigger
** iPhone 7 (10.3.3)
**{{Bug|1369006}} - [LeanPlum] - Default Browser is still triggered even if Firefox is set as the default browser
** iPad Air 2 (10.3.3)
**{{Bug|1368971}} - [LeanPlum] - Save as PDF infinite loop
 
===Date:2017-06-06===
===Date:2017-08-25===
* Tested on Nightly 55 with Nexus 5 (Android 6.0.1), Nexus 6 (Android 7.0), LG G4 (Android 5.1), Oneplus Two (Android 6.0.1), Samsung Galaxy Note 4 (Android 5.0.1) & Samsung Galaxy S4 (Android 4.4.2)
* [https://testrail.stage.mozaws.net/index.php?/runs/view/5827&group_by=cases:section_id&group_order=asc | Finished Test run] on:
* Logged Bugs:
** iPhone 7 (10.3.3)
**{{Bug|1370515}} - [LeanPlum] - Promote Sync triggered on account creation/login
** iPad Air 2 (10.3.3)
===Date:2017-07-21===
 
* Updated [https://docs.google.com/spreadsheets/d/1_ssHYnB5vmfkeCXCg66Tr0dku_oNF7NVvsl1bXojORo/edit#gid=487515512| Test Cases] - Waiting for approval from Nevin
===Date:2017-08-29===
===Date:2017-07-31===
* Bug verification and updated Test Run accordingly
* Ran [https://docs.google.com/spreadsheets/d/1_ssHYnB5vmfkeCXCg66Tr0dku_oNF7NVvsl1bXojORo/edit#gid=487515512| Test Cases]
* Logged Bugs:
**{{Bug|1385853}} - [LeanPlum] - Default browser is still triggered if app was set as default from another app
**{{Bug|1385819}} - [LeanPlum] - Focus promotion still displayed after installing Focus


=Bug Work=
=Bug Work=
==Tracking bugs==
==Tracking bugs==
* Meta bug
* Meta bug
**{{Bug|1351571}} - [meta] Android Leanplum Integration
**{{Bug|1337434}} - [Meta] iOS Leanplum Integration
<onlyinclude>
<onlyinclude>
<bugzilla>
<bugzilla>
{
{
     "blocks": "1351571",
     "blocks": "1337434",
     "include_fields": "id, priority, summary, status, assigned_to",
     "include_fields": "id, priority, summary, status, assigned_to",
     "order": "Status"
     "order": "Status"
Line 111: Line 120:
== Results ==
== Results ==
'''Nightly testing'''
'''Nightly testing'''
* in progress
* Completed


'''Beta testing'''
'''Beta testing'''
*n/a
* Completed
Simon.basca
483

edits

Retrieved from "https://wiki.mozilla.org/Special:MobileDiff/1178512...1180001"