QA/Fennec/Custom tabs in settings

From MozillaWiki
< QA‎ | Fennec
Jump to: navigation, search
Last updated: 2017/03/20

Overview

Purpose

The purpose of this wiki is to serve as a general test plan for verifying that Android mobile phone users can change the way they see the tabs in the tabs tray.

Ownership

Developer contact:

QA: Oana Horvath (:oanah)

Overall Status

[LANDED] Nightly: 2016-12-09

[LANDED] Aurora: 2017-01-28

[LANDED] Beta: 2017-03-08

Testing Summary

Scope of testing

The testing will focus on verifying that the "Compact tabs" setting was added in Fennec's General settings, on Android phones, allowing the users to change the layout of the tabs tray.

Environments

Testing will be performed on following devices:

  • Phones
    • 4.x
    • 5.x
    • 6.x
    • 7.0
  • Tablet
    • 4.x
    • 5.x

Specifications

  • bug 1202861 - (compact-tabs) Add "Compact tabs" settings item under "Customize"
  • Compact tabs view in tabs tray
CT-spec2.png

User stories

  • As a user, I want to be able to switch the way I view my tabs opened in the tabs tray, choosing between a two column versus one column layout.

Acceptance Criteria

  • All Test cases have passed and all bugs were fixed.

Testing details

Test Cases

Testing days

Date: 01-10-2017

  • Verified Bug 1202861 on Nightly 53.0a1.
  • Devices:
    • LG G4 Android 5.1;
    • Lenovo A536 Android 4.4.2.

Date: 02-23-2017

  • Created Test Plan
  • Created Test Cases

Date: 02-27-2017

  • Tested on Aurora 53.0a2, with the devices:
  • Verified bug:
    • Bug 1323952 - Add A/B experiment for compact tabs


Date: 03-01-2017

  • Testing on Aurora 53.0a2, on:
  • Verified bug:
    • Bug 1310081 - Convert tabs tray grid to use a RecyclerView

Date: 03-15-2017

Feature testing & l10n on Beta 53.0b2, with:

    • Prestigio Grace X5 (Android 4.4.2)
    • Huawei Honor 5X (Android 5.1.1)
    • LG G4 (Android 6.0)
    • Asus ZenPad 8.0 Z380KL (Android 6.0.1)

Bug Work

Tracking bugs

  • bugs to track the feature

ex:

Full Query
ID Summary Priority Status
1202861 Add "Compact tabs" settings item under "Customize" -- VERIFIED
1203182 Add telemetry for "Compact tabs" in Settings -- RESOLVED
1310081 Convert tabs tray grid to use a RecyclerView P3 VERIFIED
1323945 Update copy for compact tabs -- VERIFIED
1323951 Compact tabs setting shows up on tablets -- VERIFIED
1323952 Add A/B experiment for compact tabs -- VERIFIED

6 Total; 0 Open (0%); 1 Resolved (16.67%); 5 Verified (83.33%);


Signoff

Criteria

  • All Test cases have passed and all bugs are fixed.

Results

Nightly testing

  • Passed

Aurora testing

  • Passed

Beta testing

  • Passed