QA/Fennec/Suggest Add to home screen for frequently used websites

From MozillaWiki
< QA‎ | Fennec
Jump to: navigation, search

Overview

Purpose

The purpose of this wiki is to serve as a general test plan for providing information and option for users to add frequently used websites to home screen

Ownership

Developer contact: Sebastian Kaspari (:sebastian)

QA: Teodora Vermesan (:TeoVermesan)

Overall Status

[LANDED] Nightly 48 : landed on 2016-04-12

[LANDED] Aurora 48: landed on 2016-04-27

[LANDED] Beta: 48 Beta 1: landed on 2016-06-08

Testing Summary

Scope of testing

The testing will be focus on:

  • verifying that "Add to home screen" prompt is displayed for often websited sites

Environments

Testing will be performed on following devices:

  • Phones
    • 4.x
    • 5.x
    • 6.0
  • Tablet
    • 4.x
    • 5.x
    • 6.0

Specifications

  • Promote "Add to home screen" if user visits website often. Discuss heuristics on when to show it.
  • Confirm Bill Walker's team on remaining efforts on their end.

User stories

  • As a user, I want to be delighted with a suggestion to "shortcut" a website I visit frequently fur quicker access in the future.
  • As a user, I want decide to turn this feature on and off (on by default?)

KPI

Acceptance Criteria

  • Add to home screen message shows up based on defined heuristic formula
  • User can turn this feature on and off
  • Notification (snackbar or toast) once website was added successfully to the home screen

Testing details

Testing days

Nightly

Date:27-04-2016

  • "Add to home screen" prompt is displayed after visiting a site a few times.
  • "Add to home screen" prompt
  • "Add to home screen" prompt

Aurora

  • "Add to home screen" prompt is displayed after visiting a site a few times.

Beta: 48b1

  • "Add to home screen" prompt is displayed after visiting a site a few times.
  • "Add to home screen" prompt

Bug Work

Tracking bugs

  • bugs to track the feature

ex:

Full Query
ID Summary Priority Status
968427 Updating Firefox will change the icons for homescreen bookmarks and webapps P5 RESOLVED
1261836 Content notifications: Check if new content is already in history -- RESOLVED
1264243 Prevent "Add to home screen" button from overlaying icon -- RESOLVED
1265351 Add to home screen promotion: Save rejection and send telemetry only once -- RESOLVED
1266383 HomeScreenPrompt shown on top of tabs tray -- RESOLVED
1269908 Add pref to turn off "Add to Home Screen" -- NEW
1270034 Add additional parameters to "promote-add-to-homescreen" experiment -- NEW

7 Total; 2 Open (28.57%); 5 Resolved (71.43%); 0 Verified (0%);


Still issues

[NEW] Bug 968427 - Updating Firefox will change the icons for homescreen bookmarks and webapps
[NEW] Bug 1269908 - Add pref to turn off "Add to Home Screen"
[NEW] Bug 1270034 - Add additional parameters to "promote-add-to-homescreen" experiment (

Bug fixed

[RESOLVED FIXED] Bug 1264243 - Prevent "Add to home screen" button from overlaying icon
[RESOLVED FIXED] Bug 1265351 - Add to home screen promotion: Save rejection and send telemetry only once
[RESOLVED FIXED] Bug 1266383 - HomeScreenPrompt shown on top of tabs tray
[RESOLVED FIXED] Bug 1232706 - Promote "Add to home screen" if user visits website often


Signoff

Criteria

  • All test cases should be executed
  • All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed

Results

Nightly testing

  • "Add to home screen" prompt is displayed after visiting a site a few times.

Aurora testing

  • "Add to home screen" prompt is displayed after visiting a site a few times.

Beta testing

  • "Add to home screen" prompt is displayed after visiting a site a few times.