Overview

Purpose

The purpose of this wiki is to serve as a general test plan for verifying that Tab Queues work as expected on Android M.

Ownership

Developer contact: Sebastian Kaspari (:sebastian)

QA: Teodora Vermesan (:TeoVermesan

Overall Status

[LANDED] Nightly 46: first landed on - 2016-01-20

[LANDED] Aurora 46: first landed on - 2016-01-26

[LANDED] Beta 46 1: first landed on - 2016-03-08

Testing Summary

Scope of testing

The testing will be focus on

• verifying that Tab Queue's Settings UX is updated to offer a "shortcut" so users can go to enable "Permit drawing over other apps".

Environments

Testing will be performed on following devices:

• Phones
  • 6.x
• Tablet
  • 6.x

Specifications

• Problem: All Tab Queue users on Android M will not be able to continue using Tab Queues unless they go into System Settings, find Firefox, and enable "Permit drawing over other apps".
• Solution:
  • For M users: Update Tab Queue's Settings UX to offer a "shortcut" so users can go to enable "Permit drawing over other apps". All M users (immediately after they enable Tab Queues) will need to do this OR
  • Use "Heads up" notifications as a way to circumvent the need for users to go into this part of System Settings.
    • This would then be inconsistent with other versions
    • Questions:
      • How reliable is this solution?
      • Do we expect it to be our long term solution?
• Android notification bar

• Model flow

Testing details

Test Cases

• "Open multiple links" - enabled and "Draw over other apps" disabled
• - "Open multiple links" - disabled and "Draw over other apps" disabled

Testing days

Date:18-01-2016

• If "Draw over other apps" - disabled

• If "Draw over other apps" - enabled

Date:01-02-2016

• If "Draw over other apps" - disabled and "Open multiple links" - disabled

• New bug:

Bug 1244722 Tab Queue issues with "Draw over other apps" disabled

• If "Draw over other apps" - disabled and "Open multiple links" - enabled

Date:03-02-2016

• Exploratory:

Scenarios:

1. First both versions have "Draw over other apps" set to "No": -On Aurora I try to enable "Open multiple links" feature: but the dialog is still displayed and the option is not enabled. "Draw over other apps" is set to "Yes". -On Nightly works ok. "Draw over other apps" is set to "Yes" also.

Now both versions have "Draw over other apps" set to "Yes". I clear data, set the option to "No" and try the same steps. -First tried with Nightly and works ok -Then tried with Aurora: "Open multiple links" option is enabled and no dialog to turn on "Draw over other apps" is shown. "Draw over other apps" remains set to "No" for Aurora and "Yes" to Nightly.

2. Restart the device and repeat the above steps with the other version first:

Both versions have "Draw over other apps" set to "No": -On Nightly I try to enable "Open multiple links" feature: but the dialog is still displayed and the option is not enabled. "Draw over other apps" is set to "Yes" -On Aurora works ok. "Draw over other apps" is set to "Yes", also

Now both versions have "Draw over other apps" set to "Yes". I clear data, set the option to "No" and try the same steps. -First tried with Aurora and works ok. -Then tried with Nightly: "Open multiple links" option is enabled and no dialog to turn on "Draw over other apps" is shown. "Draw over other apps" remains set to "No" for Nightly and "Yes" to Aurora

Bug Work

Tracking bugs

• bugs to track the feature

ex:

Full Query

ID	Summary	Priority	Status
1205216	API 23: SYSTEM_ALERT_WINDOW permission is not granted automatically and can't be requested	--	RESOLVED
1244241	Tab queue permission notification is missing quotes	--	VERIFIED
1244722	Tab Queue issues with "Draw over other apps" disabled	--	VERIFIED

3 Total; 0 Open (0%); 1 Resolved (33.33%); 2 Verified (66.67%);

Issues

[ASSIGNED] Bug 1244722 - Tab Queue issues with "Draw over other apps" disabled
[NEW] Bug 1245556 - Dismiss Tab Queue Notification Permission from notification bar when choosing "Go to Settings"

Bug fixed

[RESOLVED FIXED] Bug 1205216 - API 23: SYSTEM_ALERT_WINDOW permission is not granted automatically and can't be requested
[RESOLVED FIXED] Bug 1244241 - Tab queue permission notification is missing quotes

↳ 2016-02-03 : verified fixed on Firefox for Android 47.0a1 (2016-02-03) using Nexus 6 (Android 6.0)

[RESOLVED FIXED] Bug 1212830 - (runtime-permissions) [meta] Android 6.0: Support for runtime permissions
[RESOLVED FIXED] Bug 1207194 - (targetSdkVersion23) [meta] Set targetSdkVersion = 23s

Signoff

Criteria

• All test cases should be executed
• All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed

Results

Nightly, Aurora and Beta testing

• Tab Queue issues with "Draw over other apps" disabled when both Aurora and Nightly are installed
• "Open multiple links" - disabled and "Draw over other apps" disabled
  • after opening 4 external links, the following prompt is displayed: "Open multiple links? Save them until the next time you open Firefox. Turn on Permit drawing over other apps" "Not now" and "Go to Settings"
  • "Permit drawing over other apps" is enabled
  • "Open multiple links" option is enabled
• "Open multiple links" - disabled and "Draw over other apps" enabled
  • feature is enabled from settings
• "Open multiple links" - enabled and "Draw over other apps" disabled
  • opening an external link will display a notification in the android notification bar: To "open multiple links", please enable the "Draw over other apps permission for Nightly. Go to Settings
  • Bug 1245556 - Dismiss Tab Queue Notification Permission from notification bar when choosing "Go to Settings"