QA/Fennec/Set A Home Page

From MozillaWiki
< QA‎ | Fennec
Jump to: navigation, search

Overview

Purpose

The purpose of this wiki is to serve as a general test plan for verifying that users can set a home page

Ownership

Overal Status

[LANDED] Nightly 45: first landed on - 15-09-2015

[LANDED] Aurora 44: first landed on - 27-11-2015

[LANDED] Beta1 44: first landed on - 17-12-2015

Testing Summary

Scope

The testing will be focus on

  • verifying that the user can set a home page
  • ensuring the home page URL can be modified by the user at any time

Environments

Testing will be performed on following devices:

  • Phones
    • 4.x
    • 5.x
    • 6.0
  • Tablet
    • 4.x
    • 5.x
    • 6.0

Testing will be done using different websites

Specifications

  • Add "Set a Homepage" item in Settings -> Customize -> Home
  Title: Homepage
  Subtitle (disabled): Set a link as your Homepage
  Subtitle (enabled): *URL*
Prev set dialog1.png





  • Be able to set a home page akin to setting a home page on desktop
  • Ensure the home page URL can be set via a distribution file
  • Provide an 'unconnected' state if the user has lost Internet connectivity (and/or display an appropriate error page)
  • Ensure the home page URL can be modified by the user at any time, even if it's been pre-set via a distribution file
  • Easily trigger the home page without cluttering up the existing chrome / UX
  • Provide the ability to keep or delete the Top Sites home panel in addition to having a set home page
  • There is no link (no 'in sync' requirement) between Firefox desktop home page and Firefox for Android (or iOS) home page.

User Stories

  • As a user, I want to set a home page URL instead of (or in addition to) using Top Sites so I can start browsing using my preferred home page.
  • As a user, I want to be able to edit my home page URL at any time.
  • As a partner, I want to be able to set the home page URL.
  • As a user, I want my chosen home page to display upon browser start-up.
  • As a user, I want the ability to choose to go to my home page whenever I open a new tab.

Acceptance Criteria

  • Partner distributions can set the home page URL
  • The home page URL is editable by the user
  • Both the home page 'action' and the ability to interact with home panels live harmoniously

Additional Info

  • This has been an oft-requested feature from our users over the past 3 years
  • The idea here is to provide a more customized and personalized way of browsing that's totally within the user's choice: either continue to use and love the Top Sites algorithm, or be able to set and use a 'home page' concept

Testing details

Test Cases

Testing Days

Date:10.09.2015

 APK Test
"Set a Homepage" preference in Settings -> Customize -> Home
"Set a Homepage" preference in Settings -> Customize -> Home





Choosing a homepage URL
Choosing a homepage URL





Option1: choose any URL
Option1: choose any URL





Option2: choose the current tab
Option2: choose the current tab





Open a new tab, homepage URL is displayed
Open a new tab, homepage URL is displayed





Date:18.09.2015

Basic functionality

"Set a Homepage" preference in Settings -> Customize -> Home
"Set a Homepage" preference in Settings -> Customize -> Home





Choose a homepage URL
Choosing a homepage URL





Tap an URL
Option1: choose any URL





The user can choose the current tab to be the homepage
Option2: choose the current tab





After restaring Nightly, the homepage is displayed
Restart Nightly, homepage URL is displayed





Scenarios

1.

- Go to Menu -> Settings -> Customize -> Home -> Set a Homepage and write "https://facebook.com"
- Go back three times until you are at about:home
- Open a few new tabs: about:home is loaded every time. Is it expected?

2.

- Close Nightly and reopen it: one tab is displayed with facebook.com. Any other tab loads about:home.
Is it expected?

3.

-Set a homepage option is present in guest mode: Filled: Bug 1205657 - Remove "Set a Homepage" option from guest mode 

4.

- After setting the homepage in normal browsing, go to private browsing
- Tap the "+" button to open a new tab
- If I go to Menu -> Settings -> Customize -> Home -> Set a Homepage (https://facebook.com is present under the "Set a homepage" option). Should the pref be   in private browsing? The page set as a homepage is not applied> Every time a new tab is opened, about:private browsing is displayed.

5.

- Go to Menu -> Settings -> Customize -> Home -> Set a Homepage and write "abcdefgh"
- Close Nightly and reopen it
- One tab is displayed with the "abcdefgh" google search.
Is it expected?

6.

-Also if I set a homepage in normal browsing (google.com) and then go to private browsing and set a homepage (change from google.com to gmail.com) and restart  Nightly, the homepage set in private browsing (gmail.com) is applied to normal browsing: gmail.com
Is it expected?

Date:16.10.2015

  • Still issues

Add "Set as Homepage" to dialog for long-press on URL

Remove "Set a Homepage" option from guest mode

Trigger home page without cluttering up the existing chrome / UX of about:home

Update "Set a Homepage" settings options

Date:26.11.2015

Removed "Use current tab" checkbox from "Set a homepage" setting
Removed unused homepage current tab string
Screenshot 2015-11-26-15-28-24.png





Date:27.11.2015

Gingerbread devices
Device-2015-11-27-162748.png





Device-2015-11-27-162740.png





Date:08.12.2015

Aurora

 Set a homepage setting option
Screenshot 2015-12-08-15-06-43.png





 User can set a home page URL
Screenshot 2015-12-08-15-06-47.png





Nightly

 Set a homepage setting option
Screenshot 2015-12-08-15-07-04.png





 User can set Firefox home as a homepage
Screenshot 2015-12-08-15-07-07.png





 User can set a random URL as a homepage
Screenshot 2015-12-08-15-07-11.png





Date:21.12.2015

Nightly

  • Set a homepage setting option
Screenshot 2015-12-21-17-05-36.png





  • User can set Firefox home as a homepage
Screenshot 2015-12-21-17-06-01.png





  • User can set a random URL as a homepage
Screenshot 2015-12-21-17-06-04.png





Aurora

  • Set a homepage setting option
Screenshot 2015-12-21-17-05-36.png





  • User can set Firefox home as a homepage
Screenshot 2015-12-21-17-05-40.png





  • User can set a random URL as a homepage
Screenshot 2015-12-21-17-05-45.png





Beta

Screenshot 2015-12-21-17-06-19.png





Bug work

Bug tracking

  • bugs tracking setting a homepage to fennec

ex:

Full Query
ID Summary Priority Status
1195721 Set a home page -- RESOLVED
1201181 Add "Set a Homepage" item in Settings > Customize > Home -- VERIFIED
1201185 Add "Set as Homepage" to dialog for long-press on URL -- RESOLVED

3 Total; 0 Open (0%); 2 Resolved (66.67%); 1 Verified (33.33%);


Still Issues

[NEW] Bug 1210290 - Add option to open homepage on new tabs
[NEW] Bug 1224229 - Add ability to choose homepage from your history
[NEW] Bug 1227742 - Consider explaining how the homepage preference works
[NEW] Bug 1227982 - Create SUMO article for set homepage for Fennec
[NEW] Bug 1230218 - Inline autocomplete domains when setting homepage

Bug fixed

[RESOLVED FIXED] Bug 1201181 - Add "Set a Homepage" item in Settings > Customize > Home

2015-09-21: verified fixed on Nightly 43.0a1 (2015-09-21 );

[RESOLVED FIXED] Bug 1205335 - Allow homepage to be set by distributions Home
[RESOLVED FIXED] Bug 1209032 - Put "set a home page" pref behind a Nightly flag

2015-12-23: verified fixed on Firefox for Android 45.0a2 and 46.0a1 using Nexus 5 (Android 5.1);

[RESOLVED FIXED] Bug 1227351 - Remove unused homepage current tab string
[RESOLVED FIXED] Bug 1227322 - Remove nightly flag from set homepage pref

2015-12-07: verified fixed on Aurora 45.0a2 (2015-12-17) and Firefox 44 Beta 1

[RESOLVED FIXED] Bug 1224214 - Remove "Use current tab" checkbox from "Set a homepage" setting

2015-12-07: verified fixed on Firefox for Android 45.0a1 (2015-12-06) using Nexus 6 (Android 6.0)

[RESOLVED FIXED] Bug 1224010 - Add UI Telemetry for setting a homepage

2015-12-18: verified fixed on Aurora 45.0a2 (2015-12-17) and Firefox 44 Beta 1

[RESOLVED FIXED] Bug 1220315 - Set a homepage preference has the wrong theme on Lollipop+e
[RESOLVED FIXED] Bug 1227348 - Add "Use default homepage" to homepage preference

2015-12-07: verified fixed on Firefox for Android 45.0a1 (2015-12-06) using nexus 6 (Android 6.0)

Sign off

Criteria

  • All test cases should be executed
  • All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed

Results

Nightly testing

  • Currently users just go in Settings, choose "Set a homepage" option and gave two options:
    • set a custom URL as a homepage
    • set Nightly home as a homepage

Aurora testing

  • Currently users just go in Settings, choose "Set a homepage" option and gave two options:
    • set a custom URL as a homepage
    • set Aurora home as a homepage

Beta testing

  • Currently users just go in Settings, choose "Set a homepage" option and have only one option: type an URL
  • This can be unclear for them when their homepage will open or not. So:
    • an information explaining how this feature works will be implemented (in settings, or in the dialog).
    • along with the ability to choose the homepage from history
    • also two options will be displayed: "Use default homepage" and "Open homepage on new tabs"