QA/Fennec/CustomTab on Fennec

From MozillaWiki
Jump to navigation Jump to search

Overview

Purpose

The purpose of this wiki is to serve as a general test plan for verifying that Custom Tabs are supported in Fennec

Ownership

Developer contact: Julian Chu :walkingice, Nevin Chen:nechen

QA: Sorina Florean [:sorina]

Overall Status

[LANDED] Nightly 55:

[NOT LANDED] Aurora: NA

[NOT LANDED] Beta: NA

Testing Summary

Scope of testing

The testing will be focus on:

  • verifying that users can use Custom Tabs in Fennec
  • verifying that a toolbar color was set
  • verifying that the toolbar back button for custom tabs will close the tab and finish the activity, allowing to getting back to the app that launched the custom tab
  • verifying that my ad-blocker add-on from my Fennec has the same functionality for my custom tabs
  • verifying that the web-page is reload when users scrolled down the web-page
  • verifying that there is 3 different types of displaying site info in URL Bar
  • verifying that progress bar is displayed for loading page

Environments

Testing will be performed on following devices:

  • Phones
    • 5.x?
    • 6.x
    • 7.x
  • Tablet
    • 6.x
    • 7.x

Specifications

Screenshot:

Security level of Sites

User stories

  • As a user, I want to be able to use custom tabs on Fennec
  • As a user, I want if I set Firefox for Android as the default browser to also use Firefox when 3rd party apps use custom tabs
  • As a user, I expect links that I open from an app using custom tabs will share cookie jar and permissions from the full Firefox for Android browser so I don't have to log in to sites that I already connected to, or granted permissions to

Acceptance Criteria

  • 3-party app can edit background color of custom tab, and add functions onto custom tab, such as use red background and add a “Share” button
  • UI customization:Toolbar color, action button, custom menu items, custom in/out animations, bottom toolbar
  • Synchronized AutoComplete across devices for better form completion.

Testing details

Test Cases

Testing days

Date: 2017-03-02

  • Created Test Plan

Date: 2017-03-30

  • Created Test Cases
  • Exploratory testing on latest Nightly (2017-03-30) with Nexus 6 (Android 7.1.1)
  • New bugs:
    • bug 1352104 - Back arrow and three dots menu doesn't have the same color
    • bug 1352108 - Nightly custom tab display a blank page when device orientation is changed
  • For enabling this feature: Fennec Menu -> Settings -> Advanced -> Experimental features -> Custom Tabs (turn on)
Disabled
Enabled

Date: 2017-04-03

  • Commented on:
    • bug 1329149 - Custom tabs: allow sharing of AutoComplete from the full Firefox for Android browser for better form completion
    • bug 1351605 - Custom tabs: Title becomes blank after resume
  • Verified P1 bugs:
    • bug 1337238 - Custom Tabs: progress bar on the custom bar for loading page
    • bug 1332546 - [CustomTab] 3 different types of displaying site info in URL bar should be designed in custom tab while there is only one in chrome
    • bug 1325174 - Custom tabs toolbar back button should close the tab and finish the activity
    • bug 1348716 - Copy link in CustomTabsActivity by long-clicking in Title
    • bug 1346542 - Back button navigation and web content copy/paste broken in restored GeckoApp instance
    • bug 1329143 - Custom tabs: support custom toolbar color
  • New bugs during verifying/testing:
    • bug 1352993 - Custom Tab: Action bar is not displayed when selecting a word
    • bug 1352999 - Custom Tab: Same page/URL is opened in different tabs in Nightly
    • bug 1353019 - Custom tabs: reload/refresh button from menu doesn't change to "x"

Date: 2017-04-05

  • Exploratory testing with LG G4 (Android 5.1) and HTC Desire 820 (Android 6.0.1)
  • Verified bugs:
    • bug 1315937 - Custom tabs: Support custom menu items
    • bug 1329148 - Custom tabs: allow sharing of cookie jar and permissions from the full Firefox for Android browser so users don't have to log in to sites they are already connected to, or granted permissions to
  • New bug:
    • bug 1353732 - Custom Tab: Issues while switching between Nightly and apps that supports custom tabs

Date: 2017-04-14

Verified bugs:

    • bug 1352104 - Back arrow and three dots menu doesn't have the same color
    • bug 1352108 - Nightly custom tab display a blank page when device orientation is changed

Date: 2017-04-18

  • Exploratory Testing with Huawei Honor (Android 5.1.1)
  • New Bugs:
    • bug 1357778 - Custom Tab: Fennc launched with the same URL as CustomTab
    • bug 1357780 - Custom Tab: Different color for Share option from menu
    • bug 1357781 - Custom Tab: Edit Site Settings option not implemented

Bug Work

  • Meta bug
Full Query
ID Priority Summary Status Assigned to
1315937 P2 Custom tabs: Support custom menu items VERIFIED Julian Chu [:walkingice]
1325174 -- Custom tabs toolbar back button should close the tab and finish the activity VERIFIED Dylan Roeh (:droeh) (he/him)
1329143 -- Custom tabs: support custom toolbar color VERIFIED
1329144 -- Custom tabs: support custom action button VERIFIED Julian Chu [:walkingice]
1329145 -- Custom tabs: support custom enter and exit animation VERIFIED Julian Chu [:walkingice]
1329148 -- Custom tabs: allow sharing of cookie jar and permissions from the full Firefox for Android browser so users don't have to log in to sites they are already connected to, or granted permissions to VERIFIED
1329151 -- Custom tabs: allow pre-warming of the Browser in the background, RESOLVED
1329152 P1 Custom tabs: Enable custom tabs by default (when released) RESOLVED Julian Chu [:walkingice]
1329154 P2 Custom tabs: If user has ad blocker add-on installed, enable ad blocking in custom tabs RESOLVED Eugen Sawin [:esawin]
1329155 -- Custom tabs: Collect information on number of launches (Load_URL) using custom tabs RESOLVED Nevin Chen(Not active on Bugzilla)
1329156 -- Custom tabs: Collect information on custom tab customization features used by 3rd party apps RESOLVED Nevin Chen(Not active on Bugzilla)
1329157 -- Custom tabs: Collect the source names of 3rd party app that is using custom tabs RESOLVED Nevin Chen(Not active on Bugzilla)
1329159 -- Custom tabs: Collect information on Firefox for Android launches from custom tabs RESOLVED
1329160 -- Custom tabs: Collect information on pre-warming sessions used by 3rd party apps RESOLVED Nevin Chen(Not active on Bugzilla)
1332546 -- [CustomTab] 3 different types of displaying site info in URL bar should be designed in custom tab while there is only one in chrome VERIFIED Julian Chu [:walkingice]
1336373 -- Custom tabs: Action button icon supports tint RESOLVED Julian Chu [:walkingice]
1337238 -- Custom Tabs: progress bar on the custom bar for loading page VERIFIED Julian Chu [:walkingice]
1346542 P1 Back button navigation and web content copy/paste broken in restored GeckoApp instance VERIFIED Eugen Sawin [:esawin]
1348716 -- Copy link in CustomTabsActivity by long-clicking in Title VERIFIED Julian Chu [:walkingice]
1348718 -- Tweak images of ActionBar in CustomTabsActivity RESOLVED Julian Chu [:walkingice]
1350198 P1 Custom tabs: Cannot paste strings to input element VERIFIED
1351605 P1 Custom tabs: Title becomes blank after resume VERIFIED Julian Chu [:walkingice]
1351739 P1 System for switching between different kinds of GeckoApp RESOLVED Jan Henning [:JanH]
1352104 -- Back arrow and three dots menu doesn't have the same color VERIFIED Julian Chu [:walkingice]
1352108 -- Nightly custom tab display a blank page when device orientation is changed VERIFIED Jan Henning [:JanH]
1352352 P1 Custom tabs: open link in context menu does not work well VERIFIED
1352991 P1 Pages loaded in Nightly show in the web app RESOLVED
1352993 P1 Custom Tab: Action bar is not displayed when selecting a word VERIFIED Julian Chu [:walkingice]
1352999 P2 Custom Tab: Same page/URL is opened in different tabs in Nightly RESOLVED Julian Chu [:walkingice]
1353019 P2 Custom tabs: reload/refresh button from menu doesn't change to "x" VERIFIED Julian Chu [:walkingice]
1353732 P3 Custom Tab: Issues while switching between Nightly and apps that supports custom tabs RESOLVED
1354766 P5 Custom tabs: support customized close button RESOLVED Julian Chu [:walkingice]
1356182 P2 Custom tabs: cannot display long URL properly RESOLVED
1356549 P1 Custom Tab:: forms are not focused RESOLVED
1356560 P5 Custom Tab/PWA: doorhanger is not correctly displayed RESOLVED
1357778 P1 Custom Tab: Fennc launched with the same URL as CustomTab RESOLVED Jan Henning [:JanH]
1357780 P1 Custom Tab: Different color for Share option from menu RESOLVED Julian Chu [:walkingice]
1357781 P1 Custom Tab: Edit Site Settings option not implemented VERIFIED Julian Chu [:walkingice]
1359098 P1 Crash in java.lang.NoSuchMethodError: android.content.Context.getDrawable at org.mozilla.gecko.customtabs.ActionBarPresenter.initIndicator(ActionBarPresenter.java) RESOLVED Julian Chu [:walkingice]
1363043 P2 Custom Tab: ActionBar with different colors RESOLVED Julian Chu [:walkingice]
1366648 P1 Custom tabs: reload button has wrong color VERIFIED Julian Chu [:walkingice]
1366770 P2 Custom Tab: Toolbar still displayed if a video is fullscreen VERIFIED Dylan Roeh (:droeh) (he/him)
1366782 -- Custom Tab: about:home launched when CustomTab activity is closed RESOLVED
1369050 P5 Custom Tabs: The menu is not displayed in the right position when rotating the device RESOLVED
1369075 -- Custom Tab: issues with icons on ActionBar RESOLVED
1369098 -- Custom Tab: Issues while switching between apps RESOLVED
1369114 -- Browser toolbar visible in custom tab (while loading) RESOLVED
1369681 -- Custom tabs: seeing flash when launch Custom Tabs RESOLVED Julian Chu [:walkingice]
1371338 P5 Opening links from GMail no longer opens tab queues, but rather opens up Chrome RESOLVED
1482397 -- The user is not logged out when "Cookies" are disabled. RESOLVED Eugen Sawin [:esawin]

50 Total; 0 Open (0%); 30 Resolved (60%); 20 Verified (40%);


Still issues

Bug fixed

Signoff

Criteria

  • All test cases should be executed
  • All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed

Results

Nightly testing

  • in progress

Aurora testing

  • NA

Beta testing

  • NA