QA/Fennec/LeanPlum: Difference between revisions

← Older edit

QA/Fennec/LeanPlum (view source)

Revision as of 11:58, 15 September 2017

2,016 bytes added , 15 September 2017

→‎Tracking bugs

Sorina.florean

3,360

edits

@@ Line 4: / Line 4: @@
 == Ownership ==
-Developer contact: [mailto:x@y.com X]
+Developer contact: [mailto:nechen@mozilla.com Nevin Chen [:nechen]]
 QA: [mailto:bogdan.surd@softvision.ro Bogdan Surd [:bogdan]] [mailto:sorina.florean@softvision.ro Sorina Florean [:sorina]]
 == Overall Status ==
-<small>'''<font color="green">[NOT LANDED]</font>'''</small> Nightly 55:
+<small>'''<font color="green">[LANDED]</font>'''</small> Nightly 56: 31-05-2017
-<small>'''<font color="red">[NOT LANDED]</font>'''</small> Beta 55:
+<small>'''<font color="green">[LANDED]</font>'''</small> Beta 56:
+'''Push Notifications:'''
+<small>'''<font color="green">[LANDED]</font>'''</small> Nightly 57: 21-08-2017
 = Testing Summary =
@@ Line 20: / Line 24: @@
 *P1 Triggers:
-**Loads articles (reader mode ready)
+**Loads articles
-**Visiting a website (with match to past history) x times
+**Visiting a website
-**Download videos or any other media (x times)
+**Download videos or any other media
-**SavePassword (Save password and login) (x times)
+**SavePassword
-**SaveBookmark (x times)
+**SaveBookmark
-**LoadBookmark (x times) (loading the bookmark URL)
+**LoadBookmark
 **Interact with search url area
-**When user take a screenshot  X times
+**When user take a screenshot
-**When user “Clear Private Data”(OK)
+**When user “Clear Private Data”
 *P1 Deep links:
-**Link to Set Default Browser settings  [firefox://default_browser]
+**Link to Set Default Browser settings
-**Link to specific Add-on page [url]
+**Link to specific Add-on page
-**Link to sync signup/sign in [firefox://sign_up]
+**Link to sync signup/sign in
-**Link to default search engine settings  [firefox://preferences_search]
+**Link to default search engine settings
-**Link to “Save as PDF” feature [firefox://save_as_pdf]
+**Link to “Save as PDF” feature
-**Take user directly to a Sign up for a newsletter [url]
+**Take user directly to a Sign up for a newsletter
 == Environments ==
@@ Line 46: / Line 50: @@
 == Specifications ==
+*Doc: https://docs.google.com/document/d/19tKqSi8pQF2P21yLFfLtndmSKDjOtkYVdM1yWAWAmX8/edit#heading=h.e5cqukfqdea6
 *In-app message is to inform/promote users of browser features that may be contextually relevant to them to increase engagement/retention
 *Onboarding is to optimize the first Run experience per market and promote specific features
 *Push notification is to reactive user’s Lifecycle journey
 == User stories ==
@@ Line 56: / Line 61: @@
 * As Mozilla, we want to change the onboarding feature introduction by users/countries so we can perform A/B testing
 * As Mozilla, we want to push notifications (if we chooses to) to users even when Firefox is not running
-* As a user, I want to stop receiving push notifications from Mozilla
 == Acceptance Criteria==
@@ Line 62: / Line 66: @@
 = Testing details =
 == Test Cases==
-*[https://moztrap.mozilla.org/manage/case/xxxxx/ Test Case title]
+*[https://docs.google.com/spreadsheets/d/1_ssHYnB5vmfkeCXCg66Tr0dku_oNF7NVvsl1bXojORo/edit#gid=0 Test Case LeanPlum]
 == Testing days==
 ===Date:2017-05-24===
 * Created Test Plan
+===Date:2017-05-25===
+* Created [https://docs.google.com/spreadsheets/d/1_ssHYnB5vmfkeCXCg66Tr0dku_oNF7NVvsl1bXojORo/edit#gid=0| Test Cases] - initial draft
+===Date:2017-05-31===
+* Tested on Nightly 55 with Nexus 5 (Android 6.0.1), Nexus 6 (Android 7.0) & Huawei Honor 5X (Android 5.1.1)
+* Logged Bugs:
+**{{Bug|1368970}} - [LeanPlum] - Tapping on device back button doesn't dismiss the prompt
+**{{Bug|1368995}} - [LeanPlum] - Prompt not shown when download a media content
+**{{Bug|1369013}} - [LeanPlum] - Keyboard not displayed when going back from the Search Engine trigger
+**{{Bug|1369006}} - [LeanPlum] - Default Browser is still triggered even if Firefox is set as the default browser
+**{{Bug|1368971}} - [LeanPlum] - Save as PDF infinite loop
+===Date:2017-06-06===
+* Tested on Nightly 55 with Nexus 5 (Android 6.0.1), Nexus 6 (Android 7.0), LG G4 (Android 5.1), Oneplus Two (Android 6.0.1), Samsung Galaxy Note 4 (Android 5.0.1) & Samsung Galaxy S4 (Android 4.4.2)
+* Logged Bugs:
+**{{Bug|1370515}} - [LeanPlum] - Promote Sync triggered on account creation/login
+===Date:2017-07-21===
+* Updated [https://docs.google.com/spreadsheets/d/1_ssHYnB5vmfkeCXCg66Tr0dku_oNF7NVvsl1bXojORo/edit#gid=487515512| Test Cases] - Waiting for approval from Nevin
+===Date:2017-07-31===
+* Ran [https://docs.google.com/spreadsheets/d/1_ssHYnB5vmfkeCXCg66Tr0dku_oNF7NVvsl1bXojORo/edit#gid=487515512| Test Cases]
+* Logged Bugs:
+**{{Bug|1385853}} - [LeanPlum] - Default browser is still triggered if app was set as default from another app
+**{{Bug|1385819}} - [LeanPlum] - Focus promotion still displayed after installing Focus
+===Date:2017-09-14===
+* Ran [https://docs.google.com/spreadsheets/d/1_ssHYnB5vmfkeCXCg66Tr0dku_oNF7NVvsl1bXojORo/edit#gid=487515512| Test Cases]
+* Devices: Asus ZenPad 8(Android 6.0.1), Huawei MediaPad M2 (Android 5.1.1), Motorola Nexus 6 (Android 7.1.1)
+===Date:2017-09-15===
+* Pre-release SignOff:GREEN, feature looks stable, no new issues found
+* REport: https://testrail.stage.mozaws.net/index.php?/reports/view/583
 =Bug Work=
 ==Tracking bugs==
 * Meta bug
 **{{Bug|1351571}} - [meta] Android Leanplum Integration
 <onlyinclude>
 <bugzilla>
@@ Line 92: / Line 131: @@
 '''Beta testing'''
-*n/a
+*in progress