QA/Fennec/Update copy for in-app feedback solicitation + make it web-based

From MozillaWiki
< QA‎ | Fennec
Jump to: navigation, search

Overview

Purpose

The purpose of this wiki is to serve as a general test plan for verifying that in-app feedback solicitation is updated and it is web based

Ownership

Developer contacts:

QA:

Overall Status

[LANDED] Nightly 48

[LANDED] Aurora 47

[LANDED] Beta 46

Testing Summary

Scope of testing

The testing will be focus on

  • Verifying that in-app feedback solicitation is updated
  • Feedback page is web based

Environments

Testing will be performed on devices having the following Android versions:

  • Phones
    • 2.3.x
    • 4.x
    • 5.x
    • 6.0
  • Tablet
    • 4.x
    • 5.x
    • 6.0

Specifications

User stories

  • As a user, I want the feedback to be web based
  • As a user, I want the in-app feedback solicitation to be updated

Acceptance Criteria

Testing details

Test Cases

Testing days

Date: 2016-03-11

  • Exploratory on Latest Nightly and Aurora

Date: 2016-03-15

  • Exploratory on Latest Nightly and Aurora

Date: 2016-03-24

  • Exploratory on Latest Nightly and Aurora using Asus ZenPad 8 (Android 5.0.2)

Date: 2016-04-04

  • Exploratory on Latest Nightly and Aurora using Prestigio Grace X5 (Android 4.4.2)
  • Screenshots:

Date: 2016-04-15

  • Exploratory on Latest Nightly and Aurora using Asus ZenPad 8 (Android 5.0.2) and Nexus 5 (Andoid 6.0.1)

Date: 2016-04-20

  • Exploratory on Latest Aurora using LG G4 (Android 5.1)

Date: 2016-05-05

  • Exploratory testing on Beta 2 using LG G4 (Android 5.1) and Asus ZenPad 8 (Android 5.0.2)

Date: 2016-05-12

  • Exploratory testing
  • Logged bug:
    • bug 1272333 - Firefox feedback page is not displayed in Guest Mode in 47 Beta 4

Date: 2016-05-19

  • Exploratory testing on 47 Beta 6 with Nexus 5 (Android 6.0.1) - Firefox feedback page is displayed in Guest Mode, after tapping Firefox home button for 15 times

Date: 2016-05-24

  • Exploratory testing on:
    • Firefox 47 Beta 6 with Nexus 5 (Android 6.0.1) and Samsung Galaxy R (Android 2.3.4)
    • Aurora 48 (2016-05-24) - crash : bug 1006018 - crash in java.lang.IllegalArgumentException: Prompt:ShowTop was not registered at org.mozilla.gecko.EventDispatcher.unregisterListener(EventDispatcher.java)
    • Nightly 49 (2016-05-18) with Nexus 5 (Android 6.0.1)

Date: 2016-05-27

  • Exploratory testing on latest Aurora (2016-05-26) with LG G4 (Android 5.1)
    • Firefox feedback page is displayed in Guest Mode and normal browsing

Bug Work

Tracking bugs

  • Meta bug
    • bug 1225676 - [tracker] Port fennec feedback form to input
Full Query
ID Priority Summary Status Assigned to
1223625 -- differentiate between in-product feedback and Input-hosted feedback for Firefox for Android RESOLVED Will Kahn-Greene [:willkg] ET needinfo? me
1235416 -- Add locales to input RESOLVED
1235902 -- Support actions from links in hosted feedback page RESOLVED :Margaret Leibovic
1239513 -- Replace about:feedback with page hosted on input.mozilla.org RESOLVED :Margaret Leibovic

4 Total; 0 Open (0%); 4 Resolved (100%); 0 Verified (0%);


Still issues

N/A

Bug fixed

[RESOLVED FIXED] Bug 1223625 - differentiate between in-product feedback and Input-hosted feedback for Firefox for Android
[RESOLVED FIXED] Bug 1235416 - Add locales to input
[RESOLVED FIXED] Bug 1235902 - Support actions from links in hosted feedback page
[RESOLVED FIXED] Bug 1239513 - Replace about:feedback with page hosted on input.mozilla.org

Signoff

Criteria

  • All test cases should be executed
  • All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed

Results

Nightly testing

  • There were no blockers found while testing this feature.
  • All bugs are fixed and verified

Aurora testing

  • There were no blockers found while testing this feature.
  • All bugs are fixed and verified

Beta testing

  • There were no blockers found while testing this feature.
  • All bugs are fixed and verified