QA/Fennec/LeanPlum

Overview

Purpose

The purpose of this wiki is to serve as a general test plan for verifying that we can create MVP Triggers and Deeplinks for Mobile Marketing Automation

Ownership

Developer contact: X

QA: Bogdan Surd [:bogdan] Sorina Florean [:sorina]

Overall Status

[NOT LANDED] Nightly 55:

[NOT LANDED] Beta 55:

Testing Summary

Scope of testing

• The testing will be focus on
  • P0 trigger: open Firefox 2 times during the last 7 days
  • P0 deeplink: push the dialog when user open Firefox

• P1 Triggers:
  • Loads articles
  • Visiting a website
  • Download videos or any other media
  • SavePassword
  • SaveBookmark
  • LoadBookmark
  • Interact with search url area
  • When user take a screenshot
  • When user “Clear Private Data”

• P1 Deep links:
  • Link to Set Default Browser settings
  • Link to specific Add-on page
  • Link to sync signup/sign in
  • Link to default search engine settings
  • Link to “Save as PDF” feature
  • Take user directly to a Sign up for a newsletter

Environments

Testing will be performed on following devices:

• Phones
  • Android 4 -> Android 7
• Tablet
  • Android 4 -> Android 7

Specifications

• In-app message is to inform/promote users of browser features that may be contextually relevant to them to increase engagement/retention
• Onboarding is to optimize the first Run experience per market and promote specific features
• Push notification is to reactive user’s Lifecycle journey

User stories

• As Mozilla, we want to control the target users we push messages to by country and by locale
• As Mozilla, we want to push in app messages to users based on event triggers
• As a user, when I click on the push notification or in app message, I want to be taken directly to the page where I can take immediate actions
• As Mozilla, we want to change the onboarding feature introduction by users/countries so we can perform A/B testing
• As Mozilla, we want to push notifications (if we chooses to) to users even when Firefox is not running
• As a user, I want to stop receiving push notifications from Mozilla

Testing details

Test Cases

• Test Case LeanPlum

Testing days

Date:2017-05-24

• Created Test Plan

Date:2017-05-25

• Created Test Cases - intial draft
  • https://docs.google.com/spreadsheets/d/1_ssHYnB5vmfkeCXCg66Tr0dku_oNF7NVvsl1bXojORo/edit#gid=0

Bug Work

Tracking bugs

• Meta bug
  • bug 1351571 - [meta] Android Leanplum Integration

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 429 [1] => Unknown Error ) ) 1

Signoff

Criteria

• All test cases should be executed
• All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed

Results

Nightly testing

• in progress

Beta testing

• n/a