QA/Fennec/Fennec Bookmark Management

From MozillaWiki
< QA‎ | Fennec
Jump to: navigation, search

Overview

Purpose

The purpose of this wiki is to serve as a general test plan for verifying that Bookmark management is supported by Fennec and works correctly

Ownership

Developer contact: [1]

QA: Sorina Florean [:sorina]

Overall Status

[LANDED] Nightly 58

[LANDED] Beta 58

Testing Summary

Scope of testing

The testing will be focus on

  • Verifying that folders can be moved/removed/renamed
  • Verifying that can add a new folder
  • Verifying that a bookmark can be added
  • Verifying that a bookmark can be edited/moved/renamed

Environments

Testing will be performed on following devices:

  • Phones
    • 4.x
    • 5.x
    • 6.0
    • 7.1
  • Tablet
    • 4.x
    • 5.x
    • 6.0
    • 7.0

Specifications

User stories

  • As a user, I want to create, remove and move folders
  • As a user, I want to create folders within folders to help me manage my bookmarks
  • As a user, I want to to be able to move both bookmarks and folders into folders
  • As a user, I want to delete multiple folders and bookmarks at once
  • As a user, I want to move multiple bookmarks and folders from within 1 folder to 1 other folder
  • As a user, I want to move the order of a bookmark within a folder (one at a time)
  • As a user, I want that bookmark changes that I made on my Firefox for android to be reflected on my other Firefox Sync enabled devices
  • As a user, I want that bookmark menu to be easy to use

Acceptance Criteria

Testing details

Test Cases

Testing days

Date:2017-03-24

  • Created Test Plan

Date:2017-04-18

  • Draft 1 for Test Cases

Date:2017-06-19

  • Feature under Switchboard Experiment: install add-on, and in about:experiments enable full-bookmark-management
  • Exploratory testing on latest Nightly (55.0a1-2017/06/19) with Huawei MediaPad M2 (Android 5.1.1)
  • New bugs found during testing:
    • bug 1374273 - Fennec Bookmark Management: Folders added before sync are not displayed
    • bug 1374264 - Fennec Bookmark Management: Folder order incorrect if no sync is performed
    • bug 1374251 - Fennec Bookmark Management: Name of folder not saved when parent folder is changed as well

Date:2017-07-05

  • Exploratory testing on latest Nightly (56.0a1-2017/07/04) with Huawei MediaPad M2 (Android 5.1.1), LG G4 (Android 6.0)
  • Finished Test Cases
  • New bugs found during testing:
    • bug 1378335 - Fennec Bookmark Management: Keyboard not displayed when adding a new folder
    • bug 1378336 - Fennec Bookmark Management: Reading List folder displayed between bookmark folders
  • Verified bugs:
    • bug 1329128 - Fennec Bookmark Management: Allow users to create, remove and move folders

Date:2017-07-14

Date:2017-07-28

Date:2017-10-23

Date:2017-10-30

Date:2017-11-16

Date:2017-11-27

  • Ran full suite of test and exploratory with Nexus 5 (Android 6.0.1), Honor 8 (Android 7.0) and Huawei MediaPad M2 (Android 5.1.1) on 58 Beta 5
  • Verified bug 1417918 - Folder Bookmark Management: Keyword not saved when parent folder is changed as well
  • Still important issues:
    • bug 1270535 - Add "undo" action in snackbar when bookmark is edited or removed
    • bug 1378336 - Fennec Bookmark Management: Reading List folder displayed between bookmark folders
    • bug 1374264 - Fennec Bookmark Management: Folder order incorrect if no sync/sync is performed

Date:2017-12-29

Date:2018-02-01

Bug Work

  • Meta bug
Full Query
ID Priority Summary Status Resolution
775672 P3 Bookmark tags support NEW
1232439 P1 Full-page edit bookmark dialog RESOLVED FIXED
1270535 P5 Add "undo" action in snackbar when bookmark is edited or removed NEW
1329128 P1 Fennec Bookmark Management: Allow users to create, remove and move folders VERIFIED FIXED
1329130 P1 Fennec Bookmark Management: Allow users to created nested folders RESOLVED DUPLICATE
1329131 P1 Fennec Bookmark Management: Allow users to move bookmarks and folders into folders VERIFIED FIXED
1329133 P5 Fennec Bookmark Management: Allow users to delete multiple bookmarks and folders at once NEW
1329134 P5 Fennec Bookmark Management: Allow users to move multiple bookmarks and folders from within 1 folder to 1 other folder NEW
1329135 P3 Fennec Bookmark Management: Allow users to move the order of a bookmark within a folder (one at a time only) NEW
1329136 P1 Fennec Bookmark Management: Bookmarks updated with new management features will continue to work with Firefox Sync RESOLVED WORKSFORME
1329138 P1 Fennec Bookmark Management: Collect information on how many users manage bookmarks using folders (create folder, remove folder, move bookmarks/folders into folders) RESOLVED FIXED
1329140 P3 Fennec Bookmark Management: Collect information on how many users move the order of a bookmark NEW
1332547 P5 Simplify fennec bookmark menu items NEW
1342354 P1 Add pref on/off switch for new bookmark features RESOLVED FIXED
1343985 P1 Investigate bookmark sync improvements necessary to support full-blown bookmarks management RESOLVED DUPLICATE
1347095 P1 Copy strings for the new bookmark management functions RESOLVED WORKSFORME
1364644 P1 Version-based syncing of bookmarks RESOLVED FIXED
1369900 -- [findbugs] Unnecessary boxing/unboxing in LocalBrowserDB tests RESOLVED FIXED
1374251 -- Fennec Bookmark Management: Name of folder not saved when parent folder is changed as well VERIFIED FIXED
1374264 P5 Fennec Bookmark Management: Folder order incorrect if no sync/sync is performed NEW
1374273 -- Fennec Bookmark Management: Folders added before sync are not displayed RESOLVED INVALID
1378246 -- Modifications made during bookmark deletions are counted incorrectly RESOLVED FIXED
1378335 P5 Fennec Bookmark Management: Keyboard not displayed when adding a new folder NEW
1378336 P5 Fennec Bookmark Management: Reading List folder displayed between bookmark folders NEW
1380983 -- Fennec Bookmark Management: wrong name displayed when editing folders VERIFIED FIXED
1380987 -- Fennec Bookmark Management: "save" button enabled when no string is displayed in field RESOLVED INVALID
1380998 P3 Fennec Bookmark Management: sync after editing folders doesn't display the new name NEW
1381001 -- Fennec Bookmark Management: folders removed are still displayed after sync VERIFIED FIXED
1384696 P2 Crash while deleting a folder which has more than SQLITE_MAX_VARIABLE_NUMBER child folders on any of the tree levels NEW
1384870 -- Update snack-bar when editing folders VERIFIED FIXED
1405215 -- Keyword field missing in new Edit Bookmark dialog RESOLVED FIXED
1406410 -- Location input field in Full Page Edit Bookmark dialogue doesn't use URI inputtype RESOLVED FIXED
1409803 -- Whitespace handling for bookmark keywords in full-page edit dialogue RESOLVED FIXED
1412823 P1 Fennec Bookmark Management: wrong message displayed when removing folders VERIFIED FIXED
1417918 -- Folder Bookmark Management: Keyword not saved when parent folder is changed as well VERIFIED FIXED

35 Total; 12 Open (34.29%); 15 Resolved (42.86%); 8 Verified (22.86%);


Bug fixed

Signoff

Criteria

  • All test cases should be executed
  • All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed

Results

Nightly testing

  • feature is being tested
  • there are still issues opened but the user is able to make/move/delete folders and change locations for bookmarks

Beta testing

  • feature is being tested
  • there are still issues opened but the user is able to make/move/delete folders and change locations for bookmarks