QA/Fennec/Default to "Always restore for Tabs" settings pref

From MozillaWiki
< QA‎ | Fennec
Jump to: navigation, search

Overview

Purpose

The purpose of this wiki is to serve as a general test plan for verifying that the "Always restore for Tabs" settings pref is set to default

Ownership

Developer contact: Andrzej Hunt

QA: sorina

Overall Status

[LANDED] Nightly 48: first landed on - 2016-03-24

[LANDED] Aurora 48: 2016-04-27

[LANDED] Beta 48b1:2016-06-08

Testing Summary

Scope of testing

The testing will be focus on

  • Verifying that the default option for "Restore Tabs" setting is "Always restore for Tabs"

Environments

Testing will be performed on following devices:

  • Phones
    • 4.x
    • 5.x
    • 6.x
    • 7.x
  • Tablet
    • 4.x
    • 5.x
    • 6.x

Specifications

  • Default should always be when user opens app, to restore / show latest tabs opened. We discussed to change this from default off to default on.

User stories

  • As a (new) user, I want, by default, have previously opened tabs automatically restored when restarting Firefox to continue where I left of
  • As a (new) user, I want to disable the feature to have previously opened tabs automatically restored when restarting Firefox
  • As a user, I want to be able to close all tabs before I exit the app with one click

Acceptance Criteria

  • User, by default on, can restore tabs on restart of Firefox
  • As an existing user, having this setting on, will keep it as it
  • User can disable and enable this feature via settings preference

Testing details

Test Cases

Testing days

Date: 2016-03-24

  • Test plan creation

Date: 2016-04-07

  • Exploratory testing

Date: 2016-04-14

  • Exploratory testing: device LG G4 (Android 5.1)
    • Install Nightly with a clean profile and open a few pages in different tabs;
    • Restart Nightly; all tabs are restored;
    • Go to Settings→Advanced→Restore tabs. The default option is "Always restore".

Date: 2016-04-21

  • Exploratory testing on latest Nightly: device Asus ZenPad 8 (Android 5.0.2)

Date: 2016-05-04

  • Exploratory testing on latest Aurora: device Nexus 5 (Android 6.0.1)

Date: 2016-06-15

  • Exploratory testing on Firefox 48 Beta 1 and Aurora 49 with:
    • Nexus 5 (Android 6.0.1)
    • Asus Transformer Pad (Android 4.2.1)
    • Prestigio Grace X5 (Android 4.4.2)

Date: 2016-07-06

  • Exploratory testing on latest Nightly with LG G4 (Android 5.1)
  • Verified bug:
    • bug 1228593 - Opened tabs are not restored after quitting Fennec with 'Clear on exit' and 'Always restore tabs' options enabled

Bug Work

Tracking bugs

  • Meta bug
    • bug 1219343 - Default to "Always restore" for "Tabs" settings pref

Bugzilla query error


Still issues

[NEW] Bug 1228593 - Opened tabs are not restored after quitting Fennec with 'Clear on exit' and 'Always restore tabs' options enabled

Bug fixed

NA

Signoff

Criteria

  • All test cases should be executed
  • All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed


Results

Nightly testing

  • There were no blockers found while testing this feature.
  • All bugs are fixed and verified

Aurora testing

  • There were no blockers found while testing this feature.
  • All bugs are fixed and verified

Beta testing

  • There were no blockers found while testing this feature.
  • All bugs are fixed and verified