QA/Fennec/LeanPlum Integration iOS: Difference between revisions
Jump to navigation
Jump to search
Full Query
Simon.basca (talk | contribs) |
Simon.basca (talk | contribs) |
||
| (27 intermediate revisions by the same user not shown) | |||
| Line 16: | Line 16: | ||
== Scope of testing == | == Scope of testing == | ||
*The testing will be focus on | *The testing will be focus on | ||
* | *Events Trigged: | ||
** | ** First Launch | ||
** | **Dismiss Onboarding | ||
**Download | ** Second Launch | ||
** | ** The App is Launched | ||
** | ** Opening a New Tab | ||
** | ** Interacting with the URL bar | ||
** | ** Bookmarking a Page | ||
** | ** Opening a Bookmark | ||
** | ** Open Telephone link | ||
** Opening MailTo link from a Web Page | |||
** Clear Private Data | |||
** Download Videos / Media | |||
** Save Password and Login from Door Hangar | |||
** Open Login Manager | |||
** Download Focus | |||
** Download Pocket | |||
** Tap "Share" button | |||
** Sign in to FxA | |||
** Tap "Reader View" button | |||
* | *User Attribute: | ||
**Link to | **Focus Installed | ||
**Link to | **Klar Installed | ||
**Link to | **Mailto preference | ||
**Link to | **Signed In Sync | ||
**Link to | **Telemetry Opt In | ||
** | **App version | ||
**Pocket Installed | |||
*Deep links: | |||
**Link to Sync settings | |||
**Link to default mail app settings | |||
**Link to default search engine settings | |||
**Link to bookmark dialog / page | |||
**Link to history dialog | |||
**Link into New Tabs settings | |||
**Link into Homepage settings | |||
**Link into Private Data settings | |||
**Link to New Private Tab (or a way to highlight/bubble new private tab mask) | |||
**Link to general settings page | |||
== Environments == | == Environments == | ||
Testing will be performed on following devices: | Testing will be performed on following devices: | ||
* Phones | * Phones | ||
** iPhone | ** iPhone 7 -> iOS 10.3.3 | ||
* Tablet | * Tablet | ||
** iPad Air 2 -> 10.3.3 | ** iPad Air 2 -> 10.3.3 | ||
== Specifications == | == Specifications == | ||
*Doc: https://docs.google.com/document/d/ | *Doc: https://docs.google.com/document/d/1VODMs1FIK8NpxpbeUFZDX7LXDI2pQ6wYASkJ0lIc_qk/edit | ||
*In-app message is to inform/promote users of browser features that may be contextually relevant to them to increase engagement/retention | *In-app message is to inform/promote users of browser features that may be contextually relevant to them to increase engagement/retention | ||
*Onboarding is to optimize the first Run experience per market and promote specific features | *Onboarding is to optimize the first Run experience per market and promote specific features | ||
| Line 52: | Line 73: | ||
== User stories == | == User stories == | ||
* As a privacy conscious user, I want to be informed that Firefox offers a simple and fast privacy focused browser called Focus | |||
* As a conscious user, I want to be aware of some relevant and helpful features within the app | |||
* As a user | |||
* As a user, I want to | |||
= Testing details = | = Testing details = | ||
== Testing days== | == Testing days== | ||
===Date:2017- | ===Date:2017-08-16=== | ||
* Created Test Plan | * Created Test Plan | ||
===Date:2017- | |||
* Created [https:// | == Test Cases== | ||
===Date:2017- | ===Date:2017-08-21=== | ||
* | * Created [https://testrail.stage.mozaws.net/index.php?/suites/view/1380&group_by=cases:section_id&group_id=5702&group_order=asc | Test Cases] | ||
===Date:2017-08-23=== | |||
* [https://testrail.stage.mozaws.net/index.php?/runs/view/5827&group_by=cases:section_id&group_order=asc | Started Test run] on: | |||
** iPhone 7 (10.3.3) | |||
** iPad Air 2 (10.3.3) | |||
** | |||
===Date:2017-08-25=== | |||
* [https://testrail.stage.mozaws.net/index.php?/runs/view/5827&group_by=cases:section_id&group_order=asc | Finished Test run] on: | |||
** iPhone 7 (10.3.3) | |||
** iPad Air 2 (10.3.3) | |||
===Date:2017- | |||
* | ===Date:2017-08-29=== | ||
===Date:2017- | * Bug verification and updated Test Run accordingly | ||
* | |||
=Bug Work= | =Bug Work= | ||
==Tracking bugs== | ==Tracking bugs== | ||
* Meta bug | * Meta bug | ||
**{{Bug| | **{{Bug|1337434}} - [Meta] iOS Leanplum Integration | ||
<onlyinclude> | <onlyinclude> | ||
<bugzilla> | <bugzilla> | ||
{ | { | ||
"blocks": " | "blocks": "1337434", | ||
"include_fields": "id, priority, summary, status, assigned_to", | "include_fields": "id, priority, summary, status, assigned_to", | ||
"order": "Status" | "order": "Status" | ||
| Line 111: | Line 120: | ||
== Results == | == Results == | ||
'''Nightly testing''' | '''Nightly testing''' | ||
* | * Completed | ||
'''Beta testing''' | '''Beta testing''' | ||
* | * Completed | ||
Latest revision as of 08:50, 7 September 2017
Overview
Purpose
The purpose of this wiki is to serve as a general test plan for verifying that we can create MVP Triggers and Deeplinks for Mobile Marketing Automation
Ownership
Developer contact: Susheel Daswani [slack - @sdaswani]
QA: Simion Basca [slack - @sbasca]
Overall Status
[LANDED] Master 10-08-2017
[NOT LANDED] Beta 9.0
Testing Summary
Scope of testing
- The testing will be focus on
- Events Trigged:
- First Launch
- Dismiss Onboarding
- Second Launch
- The App is Launched
- Opening a New Tab
- Interacting with the URL bar
- Bookmarking a Page
- Opening a Bookmark
- Open Telephone link
- Opening MailTo link from a Web Page
- Clear Private Data
- Download Videos / Media
- Save Password and Login from Door Hangar
- Open Login Manager
- Download Focus
- Download Pocket
- Tap "Share" button
- Sign in to FxA
- Tap "Reader View" button
- User Attribute:
- Focus Installed
- Klar Installed
- Mailto preference
- Signed In Sync
- Telemetry Opt In
- App version
- Pocket Installed
- Deep links:
- Link to Sync settings
- Link to default mail app settings
- Link to default search engine settings
- Link to bookmark dialog / page
- Link to history dialog
- Link into New Tabs settings
- Link into Homepage settings
- Link into Private Data settings
- Link to New Private Tab (or a way to highlight/bubble new private tab mask)
- Link to general settings page
Environments
Testing will be performed on following devices:
- Phones
- iPhone 7 -> iOS 10.3.3
- Tablet
- iPad Air 2 -> 10.3.3
Specifications
- Doc: https://docs.google.com/document/d/1VODMs1FIK8NpxpbeUFZDX7LXDI2pQ6wYASkJ0lIc_qk/edit
- In-app message is to inform/promote users of browser features that may be contextually relevant to them to increase engagement/retention
- Onboarding is to optimize the first Run experience per market and promote specific features
- Push notification is to reactive user’s Lifecycle journey
User stories
- As a privacy conscious user, I want to be informed that Firefox offers a simple and fast privacy focused browser called Focus
- As a conscious user, I want to be aware of some relevant and helpful features within the app
Testing details
Testing days
Date:2017-08-16
- Created Test Plan
Test Cases
Date:2017-08-21
- Created | Test Cases
Date:2017-08-23
- | Started Test run on:
- iPhone 7 (10.3.3)
- iPad Air 2 (10.3.3)
Date:2017-08-25
- | Finished Test run on:
- iPhone 7 (10.3.3)
- iPad Air 2 (10.3.3)
Date:2017-08-29
- Bug verification and updated Test Run accordingly
Bug Work
Tracking bugs
- Meta bug
- bug 1337434 - [Meta] iOS Leanplum Integration
23 Total; 1 Open (4.35%); 13 Resolved (56.52%); 9 Verified (39.13%);
Signoff
Criteria
- All test cases should be executed
- All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed
Results
Nightly testing
- Completed
Beta testing
- Completed