Overview

Purpose

The purpose of this wiki is to serve as a general test plan for verifying that the user is receiving dialog boxes

Ownership

Developer contact: Nevin Chen [:nechen]

QA: Bogdan Surd [:bogdan] Sorina Florean [:sorina]

Overall Status

[LANDED] Nightly 59:

[LANDED] Beta 59:

Testing Summary

Scope of testing

• The testing will be focus on verifying that user is receiving dialog boxes

Environments

Testing will be performed on following devices:

• Phones
  • Android 4 -> Android 8
• Tablet
  • Android 4 -> Android 7

Specifications

• In-app message is to inform/promote users of browser features that may be contextually relevant to them to increase engagement/retention
• Onboarding is to optimize the first Run experience per market and promote specific features
• Push notification is to reactive user’s Lifecycle journey

Bookmarks Hint

Reader Mode Hint

User stories

• As Mozilla, we want to control the target users we push messages to by country and by locale
• As Mozilla, we want to push in app messages to users based on event triggers
• As a user, when I click on the push notification or in app message, I want to be taken directly to the page where I can take immediate actions

Testing details

Test Cases

• Test Case

Testing days

Date:2017-11-23

• Test Plan Creation

Date:2017-11-24

• Test Cases Creation

Date:2017-12-07

• Ran full test cases suites for mid-Nightly SignOff, Status: GREEN
  • https://testrail.stage.mozaws.net/index.php?/reports/view/714

Date:2018-02-15

• Ran full test cases suites for pre-Release SignOff, Status: GREEN
  • https://testrail.stage.mozaws.net/index.php?/reports/view/801

Bug Work

Tracking bugs

• https://trello.com/c/Cdf2iDpk/3180-enable-leanplum-banner-feature-for-onboarding-test

1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);

Signoff

Criteria

• All test cases should be executed
• All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed

Results

Nightly testing

• There were no blockers found while testing this feature.
• All bugs are fixed and verified

Beta testing

• There were no blockers found while testing this feature.
• All bugs are fixed and verified