QA/Fennec/Bookmark folder management: Difference between revisions

From MozillaWiki
< QA‎ | Fennec
Jump to navigation Jump to search
(adding results)
 
 
(One intermediate revision by the same user not shown)
Line 39: Line 39:


== Specifications ==
== Specifications ==
 
*Allow to add folders
*Creating bookmarks folders
*Allow to remove folders
*Allow to move folders
*Update bookmark dialog
*Choosing what folder in which to save a bookmark
*Choosing what folder in which to save a bookmark
*Moving bookmarks around
*Moving bookmarks around
*Even tagging bookmarks with keywords and making them searchable
*Tagging bookmarks with keywords and making them searchable
*Allow to add/remove and move folders
*Full-page edit bookmark dialog  
*Full-page edit bookmark dialog  
[[File:prev_bookmarks_bookmarkmgmt_L2_4.png|600px|thumb|center| Full-page edit bookmark dialog]]
[[File:prev_bookmarks_bookmarkmgmt_L2_4.png|600px|thumb|center| Full-page edit bookmark dialog]]
Line 54: Line 55:
*As a user, I want to rename, add and remove bookmark folders
*As a user, I want to rename, add and remove bookmark folders
*As a user, I want to separate Desktop and Mobile bookmarks, after importing my Desktop bookmarks (if signed in)
*As a user, I want to separate Desktop and Mobile bookmarks, after importing my Desktop bookmarks (if signed in)
*As a user, I want to edit the information stored for a bookmark item (Title, folder, keywords)
*As a user, I want to organize folders by moving them into different folders and sub-folders
*As a user, I want to quickly and conveniently access the management of bookmarks (currently only edible via snackbar that appears after page was bookmarked)
*As a user, I want to know if my bookmark is available offline (prep work for offline bookmarks)
*As a user, I want to know if my bookmark is available offline (prep work for offline bookmarks)
*As a user, I want to save an item that I can later retrieve on my other device (assumed both devices are signed into the same Firefox account)
*As a user, I want to save an item that I can later retrieve on my other device (assumed both devices are signed into the same Firefox account)
Line 59: Line 63:
== Acceptance Criteria==
== Acceptance Criteria==
*All edit/delete/add/rename operations on folder as well individual bookmark item work
*All edit/delete/add/rename operations on folder as well individual bookmark item work
*When hold on specific bookmark item, user should get the edit bookmark dialog
*Show icon (similar to tabs icon) what kind of bookmark item the bookmark was saved as and if it's offline available (reader view, page-shot, pdf etc.)


==Metrics/KPI==
==Metrics/KPI==
*measure what actions are being applied to folders, i.e. long-press on folder, delete, move, rename etc.
*# of users who use bookmarks increases (in comparison to RL): http://mzl.la/1Xe7UlL
*measure what actions are being applied to folders, i.e. delete, move, rename etc.
*measure if loading bookmarks in offline mode increases, confirms need for offline
*measure what types of bookmarks are saved the most (RV, page shot)
*measure (avg.) folder count to validate usefulness of folder management
*measure (avg.) folder count to validate usefulness of folder management
*measure how many people click "edit" / dialog once they long-pressed on folder
*measure how many % of users have more than default folders
*measure ratio between # of bookmarks vs. bookmark folders
*measure moving mobile to desktop and vice versa
*measure ratio between # of bookmarks vs. bookmark folders
*compare % of users without folders, loading URLs  vs. users with folders
*less requests vs. bookmarks or comments on added feature
*http://mzl.la/1Xe7UlL


= Testing details =
= Testing details =
Line 85: Line 86:
<bugzilla>
<bugzilla>
{
{
  "id": "1232439, bookmark-folders"
  "id": "972193, 1232438, 1232439, 1234967, 1241669, 1244708, 1245174, 1249170, 1250686, 1251314, 1270535, 1126441, 1232866, 1232868, 1244704, 1254239, 1255127"
}
}
</bugzilla>
</bugzilla>
Line 93: Line 94:
<font color="red">'''[NEW]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1232439 Bug 1232439] - Full-page edit bookmark dialog <br/>
<font color="red">'''[NEW]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1232439 Bug 1232439] - Full-page edit bookmark dialog <br/>
<font color="red">'''[NEW]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=972193 Bug 972193] - Allow user to put a bookmark in a folder from edit bookmark dialog  <br/>
<font color="red">'''[NEW]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=972193 Bug 972193] - Allow user to put a bookmark in a folder from edit bookmark dialog  <br/>
<font color="red">'''[NEW]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1232438 Bug 1232438] - Show edit bookmark dialog when user clicks on bookmark star for bookmarked page<br/>
<font color="red">'''[NEW]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1250686 Bug 1250686] - Add ability to create a bookmark folder <br/>
<font color="red">'''[NEW]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1270535 Bug 1270535] - Add "undo" action in snackbar when bookmark is removed<br/>
<font color="red">'''[NEW]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1251314 Bug 1251314] - Probes to measure activity and usage of bookmark folders<br/>
<font color="red">'''[NEW]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1241669 Bug 1241669] - add ability to edit a Bookmarks folder <br/>
<font color="red">'''[NEW]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1244708 Bug 1244708] - Add sorting capability to bookmarks<br/>
<font color="red">'''[NEW]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1249170 Bug 1249170] - Change "options" to "edit" in Bookmarked snackbar <br/>
<font color="red">'''[NEW]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1234967 Bug 1234967] - Open and delete bookmarks by ID instead of by URL when possible<br/>
<font color="red">'''[NEW]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1245174 Bug 1245174] - Create a "Recent bookmarks" smart folder <br/>


===Bug fixed ===
===Bug fixed ===
*NA
<font color="green">'''[RESOLVED FIXED]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1232866 Bug 1232866]- Establish clearer IA for panel list items<br/>
<font color="green">'''[RESOLVED FIXED]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1254239 Bug 1254239] - Align bookmark folders with other home panel items <br/>
<font color="green">'''[RESOLVED FIXED]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1255127 Bug 1255127] - Decrease height of bookmark folders to match remote client item height <br/>
<font color="green">'''[RESOLVED FIXED]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1244704 Bug 1244704]  - Add another more granular bucket for BOOKMARKS_COUNT probe<br/>
<font color="green">'''[RESOLVED FIXED]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1232868 Bug 1232868] - Clean up bookmark folder list item UI<br/>


=Signoff=
=Signoff=
== Criteria ==
== Criteria ==
* All test cases should be executed
* All test cases should be executed

Latest revision as of 13:48, 5 September 2016

Overview

Purpose

The purpose of this wiki is to serve as a general test plan for verifying that users can add/remove/edit bookmark folders

Ownership

Developer contact: Anthony Lam (:antlam)

QA: Teodora Vermesan (:TeoVermesan)

Overall Status

[NOT LANDED] Nightly: NA

[NOT LANDED] Aurora: NA

[NOT LANDED] Beta: NA

Testing Summary

Scope of testing

The testing will be focus on

  • verifying that bookmark folders can be moved
  • verifying that bookmark folders can be added
  • verifying that bookmark folders can be removed
  • verifying that Desktop and Mobile bookmarks are separated, after importing my Desktop bookmarks (if signed in)
  • verifying that bookmarks are available offline
  • verifying that an user can save an item that he can later retrieve on his other device

Environments

Testing will be performed on following devices:

  • Phones
    • 4.x
    • 5.x
    • 6.0
  • Tablet
    • 4.x
    • 5.x
    • 6.0

Specifications

  • Allow to add folders
  • Allow to remove folders
  • Allow to move folders
  • Update bookmark dialog
  • Choosing what folder in which to save a bookmark
  • Moving bookmarks around
  • Tagging bookmarks with keywords and making them searchable
  • Full-page edit bookmark dialog
Full-page edit bookmark dialog
Full-page edit bookmark dialog
  • Edit bookmark
Edit bookmark

User stories

  • As a user, I want to rename, add and remove bookmark folders
  • As a user, I want to separate Desktop and Mobile bookmarks, after importing my Desktop bookmarks (if signed in)
  • As a user, I want to edit the information stored for a bookmark item (Title, folder, keywords)
  • As a user, I want to organize folders by moving them into different folders and sub-folders
  • As a user, I want to quickly and conveniently access the management of bookmarks (currently only edible via snackbar that appears after page was bookmarked)
  • As a user, I want to know if my bookmark is available offline (prep work for offline bookmarks)
  • As a user, I want to save an item that I can later retrieve on my other device (assumed both devices are signed into the same Firefox account)

Acceptance Criteria

  • All edit/delete/add/rename operations on folder as well individual bookmark item work
  • When hold on specific bookmark item, user should get the edit bookmark dialog
  • Show icon (similar to tabs icon) what kind of bookmark item the bookmark was saved as and if it's offline available (reader view, page-shot, pdf etc.)

Metrics/KPI

    1. of users who use bookmarks increases (in comparison to RL): http://mzl.la/1Xe7UlL
  • measure what actions are being applied to folders, i.e. delete, move, rename etc.
  • measure if loading bookmarks in offline mode increases, confirms need for offline
  • measure what types of bookmarks are saved the most (RV, page shot)
  • measure (avg.) folder count to validate usefulness of folder management

Testing details

Testing days

Date:04-05-2016

  • Created Test Plan

Bug Work

Tracking bugs

  • bugs to track the feature

ex:

Full Query
ID Summary Priority Status
972193 Allow user to put a bookmark in a folder from edit bookmark dialog P3 RESOLVED
1126441 added bookmarks should be directly added to particular folder depending upon metadata/keywords of page if supplied -- RESOLVED
1232438 Show edit bookmark dialog when user clicks on bookmark star for bookmarked page -- RESOLVED
1232439 Full-page edit bookmark dialog P1 RESOLVED
1232866 Establish clearer IA for panel list items -- RESOLVED
1232868 Clean up bookmark folder list item UI -- RESOLVED
1234967 Open and delete bookmarks by ID instead of by URL when possible. P5 RESOLVED
1241669 add ability to edit a Bookmarks folder -- RESOLVED
1244704 Add another more granular bucket for BOOKMARKS_COUNT probe -- RESOLVED
1244708 Add sorting capability to bookmarks P5 RESOLVED
1245174 Create a "Recent bookmarks" smart folder P5 RESOLVED
1249170 Change "options" to "edit" in Bookmarked snackbar -- RESOLVED
1250686 Add ability to create a bookmark folder -- RESOLVED
1251314 Probes to measure activity and usage of bookmark folders -- RESOLVED
1254239 Align bookmark folders with other home panel items -- VERIFIED
1255127 Decrease height of bookmark folders to match remote client item height -- RESOLVED
1270535 Add "undo" action in snackbar when bookmark is edited or removed P5 VERIFIED

17 Total; 0 Open (0%); 15 Resolved (88.24%); 2 Verified (11.76%);


Still issues

[NEW] Bug 1232439 - Full-page edit bookmark dialog
[NEW] Bug 972193 - Allow user to put a bookmark in a folder from edit bookmark dialog
[NEW] Bug 1232438 - Show edit bookmark dialog when user clicks on bookmark star for bookmarked page
[NEW] Bug 1250686 - Add ability to create a bookmark folder
[NEW] Bug 1270535 - Add "undo" action in snackbar when bookmark is removed
[NEW] Bug 1251314 - Probes to measure activity and usage of bookmark folders
[NEW] Bug 1241669 - add ability to edit a Bookmarks folder
[NEW] Bug 1244708 - Add sorting capability to bookmarks
[NEW] Bug 1249170 - Change "options" to "edit" in Bookmarked snackbar
[NEW] Bug 1234967 - Open and delete bookmarks by ID instead of by URL when possible
[NEW] Bug 1245174 - Create a "Recent bookmarks" smart folder

Bug fixed

[RESOLVED FIXED] Bug 1232866- Establish clearer IA for panel list items
[RESOLVED FIXED] Bug 1254239 - Align bookmark folders with other home panel items
[RESOLVED FIXED] Bug 1255127 - Decrease height of bookmark folders to match remote client item height
[RESOLVED FIXED] Bug 1244704 - Add another more granular bucket for BOOKMARKS_COUNT probe
[RESOLVED FIXED] Bug 1232868 - Clean up bookmark folder list item UI

Signoff

Criteria

  • All test cases should be executed
  • All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed
  • Allow to add/remove and move folders

Results

Nightly testing

  • NA

Aurora testing

  • NA

Beta testing

  • NA