QA/Fennec/CustomTab on Fennec

From MozillaWiki
< QA‎ | Fennec
Jump to: navigation, search

Overview

Purpose

The purpose of this wiki is to serve as a general test plan for verifying that Custom Tabs are supported in Fennec

Ownership

Developer contact: Dylan Roeh [:droeh]

QA: Sorina Florean [:sorina]

Overall Status

[LANDED] Nightly 57:

[LANDED] Beta 57

Testing Summary

Scope of testing

The testing will be focus on:

  • verifying that users can use Custom Tabs in Fennec
  • verifying that a toolbar color was set
  • verifying that the toolbar back button for custom tabs will close the tab and finish the activity, allowing to getting back to the app that launched the custom tab
  • verifying that my ad-blocker add-on from my Fennec has the same functionality for my custom tabs
  • verifying that the web-page is reload when users scrolled down the web-page
  • verifying that there is 3 different types of displaying site info in URL Bar
  • verifying that progress bar is displayed for loading page

Environments

Testing will be performed on following devices:

  • Phones
    • 5.x?
    • 6.x
    • 7.x
  • Tablet
    • 6.x
    • 7.x

Specifications

Screenshot:

Security level of Sites

User stories

  • As a user, I want to be able to use custom tabs on Fennec
  • As a user, I want if I set Firefox for Android as the default browser to also use Firefox when 3rd party apps use custom tabs
  • As a user, I expect links that I open from an app using custom tabs will share cookie jar and permissions from the full Firefox for Android browser so I don't have to log in to sites that I already connected to, or granted permissions to

Acceptance Criteria

  • 3-party app can edit background color of custom tab, and add functions onto custom tab, such as use red background and add a “Share” button
  • UI customization:Toolbar color, action button, custom menu items, custom in/out animations, bottom toolbar
  • Synchronized AutoComplete across devices for better form completion.

Testing details

Test Cases

Testing days

Date: 2017-03-02

  • Created Test Plan

Date: 2017-03-30

  • Created Test Cases
  • Exploratory testing on latest Nightly (2017-03-30) with Nexus 6 (Android 7.1.1)
  • New bugs:
    • bug 1352104 - Back arrow and three dots menu doesn't have the same color
    • bug 1352108 - Nightly custom tab display a blank page when device orientation is changed
  • For enabling this feature: Fennec Menu -> Settings -> Advanced -> Experimental features -> Custom Tabs (turn on)
Disabled
Enabled

Date: 2017-04-03

  • Commented on:
    • bug 1329149 - Custom tabs: allow sharing of AutoComplete from the full Firefox for Android browser for better form completion
    • bug 1351605 - Custom tabs: Title becomes blank after resume
  • Verified P1 bugs:
    • bug 1337238 - Custom Tabs: progress bar on the custom bar for loading page
    • bug 1332546 - [CustomTab] 3 different types of displaying site info in URL bar should be designed in custom tab while there is only one in chrome
    • bug 1325174 - Custom tabs toolbar back button should close the tab and finish the activity
    • bug 1348716 - Copy link in CustomTabsActivity by long-clicking in Title
    • bug 1346542 - Back button navigation and web content copy/paste broken in restored GeckoApp instance
    • bug 1329143 - Custom tabs: support custom toolbar color
  • New bugs during verifying/testing:
    • bug 1352993 - Custom Tab: Action bar is not displayed when selecting a word
    • bug 1352999 - Custom Tab: Same page/URL is opened in different tabs in Nightly
    • bug 1353019 - Custom tabs: reload/refresh button from menu doesn't change to "x"

Date: 2017-04-05

  • Exploratory testing with LG G4 (Android 5.1) and HTC Desire 820 (Android 6.0.1)
  • Verified bugs:
    • bug 1315937 - Custom tabs: Support custom menu items
    • bug 1329148 - Custom tabs: allow sharing of cookie jar and permissions from the full Firefox for Android browser so users don't have to log in to sites they are already connected to, or granted permissions to
  • New bug:
    • bug 1353732 - Custom Tab: Issues while switching between Nightly and apps that supports custom tabs

Date: 2017-04-14

Verified bugs:

    • bug 1352104 - Back arrow and three dots menu doesn't have the same color
    • bug 1352108 - Nightly custom tab display a blank page when device orientation is changed

Date: 2017-04-19

  • Exploratory Testing with Huawei Honor (Android 5.1.1)
  • New Bugs:
    • bug 1357778 - Custom Tab: Fennc launched with the same URL as CustomTab
    • bug 1357780 - Custom Tab: Different color for Share option from menu
    • bug 1357781 - Custom Tab: Edit Site Settings option not implemented

Date: 2017-05-08

  • Exploratory Testing with Huawei Honor (Android 5.1.1), Honor 8 (Android 6.0), Asus ZenPad 8(Android 6.0.1)
  • New Bug:
    • bug 1363043 - Custom Tab: ActionBar with different colors
  • Verified bugs:
    • bug 1353019 - Custom tabs: reload/refresh button from menu doesn't change to "x"
    • bug 1351605 - Custom tabs: Title becomes blank after resume
    • bug 1352108 - Nightly custom tab display a blank page when device orientation is changed
    • bug 1352993 - Custom Tab: Action bar is not displayed when selecting a word

Date: 2017-05-17

  • Exploratory Testing with Nexus 9 (Android 7.1.1), HTC Desire 820(Android 6.0.1)
  • Verified bugs:
    • bug 1350198 - Custom tabs: Cannot paste strings to input element
    • bug 1329145 - Custom tabs: support custom enter and exit animation
    • bug 1337771 - Custom tabs: Action button not working for some apps
    • bug 1329144 - Custom tabs: support custom action button
    • bug 1352352 - Custom tabs: open link in context menu does not work well
  • Commented on:
    • bug 1329149 - Custom tabs: allow sharing of AutoComplete from the full Firefox for Android browser for better form completion
    • bug 1355735 - Custom tabs: Menu says "Open in Android-System" if no default browser is set
    • bug 1357778 - Custom Tab: Fennc launched with the same URL as CustomTab

Date: 2017-05-22

  • Exploratory Testing with Huawei Honor (Android 5.1.1)
  • Finished Test Cases
  • New Bugs:
    • bug 1366770 - Custom Tab: Toolbar still displayed if a video is fullscreen
    • bug 1366782 - Custom Tab: about:home launched when CustomTab activity is closed

Date: 2017-05-29

Date: 2017-08-07

  • Reviewing TCs for Custom Tab - GeckoView - feature in Nightly 57
  • Exploratory testing with Nexus 5 (Android 6.0.1) on latest Nightly (08-07)
    • New bug 1388058 - CustomTab: Security level of the site not displayed

Date: 2017-08-09

  • Exploratory testing with HTC 10 (Android 7.0) on latest Nightly

Date: 2017-08-28

  • Exploratory testing with Asus ZenPad 8 (Android 6.0.1) on latest Nightly
  • Verified bugs:
    • bug 1366770 - Custom Tab: Toolbar still displayed if a video is fullscreen
    • bug 1388058 - CustomTab: Security level of the site not displayed

Date: 2017-08-31

Date: 2017-10-09

Date: 2017-10-23

  • Verified bugs:
    • bug 1300574 - Back button doesn't navigate back a page in custom tabs
    • bug 1365868 - Support minimal context menu functionality in GeckoView-based custom tabs
    • bug 1388724 - CustomTab: doorhanger not displayed
    • bug 1315348 - Rotating the device while viewing a custom tab loses toolbar color

Date: 2017-10-26

Date: 2018-02-28

Bug Work

  • Meta bug
    • bug 1208655 - (customtabs) [meta] Make Fennec be an Android "custom tab" ecosystem participant
Full Query
ID Priority Summary Status Assigned to
1210580 -- Customize UI using values from custom tab VIEW intent RESOLVED
1225980 -- Implement CustomTabsService RESOLVED Dylan Roeh (:droeh)
1276696 -- Custom Tabs Prototype RESOLVED Sebastian Kaspari (:sebastian)
1279278 P2 Implement urlbar features for chrome custom tabs RESOLVED Dylan Roeh (:droeh)
1280148 -- Enable chrome custom tabs in Nightly RESOLVED Sebastian Kaspari (:sebastian)
1285926 -- Add preference for enabling/disabling custom tabs support RESOLVED Sebastian Kaspari (:sebastian)
1293299 P2 Opening a custom tab in Fennec displays a white screen RESOLVED Dylan Roeh (:droeh)
1299925 P2 Handle back button correctly in custom tabs RESOLVED Dylan Roeh (:droeh)
1300570 -- [meta] Separate normal / custom / web app tabs RESOLVED
1300574 -- Back button doesn't navigate back a page in custom tabs VERIFIED Dylan Roeh (:droeh)
1303362 -- Handle links that open new tabs in Custom Tabs RESOLVED Dylan Roeh (:droeh)
1303776 -- Close the active tab when ending a custom tabs activity RESOLVED
1305086 -- Don't kill the process when a CustomTabsActivity finishes RESOLVED Dylan Roeh (:droeh)
1305439 -- Switching to Fennec when a custom tab is open results in a white screen RESOLVED Dylan Roeh (:droeh)
1315937 P2 Custom tabs: Support custom menu items VERIFIED Julian Chu [:walkingice]
1316869 -- Custom tabs: Adapt text color based on toolbar color RESOLVED Dylan Roeh (:droeh)
1317933 -- Custom Tab: Switch theme based on background color? RESOLVED friedger
1318038 -- Implement CustomTabsService.mayLaunchUrl() RESOLVED Dylan Roeh (:droeh)
1319069 P3 Open Fennec Custom Tabs in Fennec Proper RESOLVED
1323756 -- Sometimes links don't load if you've been using custom tabs RESOLVED Dylan Roeh (:droeh)
1325021 P1 Crash in java.lang.IllegalArgumentException: Doorhanger:Add was not registered at org.mozilla.gecko.EventDispatcher.unregisterListener(EventDispatcher.java) VERIFIED Dylan Roeh (:droeh)
1325174 -- Custom tabs toolbar back button should close the tab and finish the activity VERIFIED Dylan Roeh (:droeh)
1329143 -- Custom tabs: support custom toolbar color VERIFIED
1329144 -- Custom tabs: support custom action button VERIFIED Julian Chu [:walkingice]
1329145 -- Custom tabs: support custom enter and exit animation VERIFIED Julian Chu [:walkingice]
1329146 P5 Custom tabs: support custom bottom toolbar NEW
1329148 -- Custom tabs: allow sharing of cookie jar and permissions from the full Firefox for Android browser so users don't have to log in to sites they are already connected to, or granted permissions to VERIFIED
1329149 -- Custom tabs: allow sharing of AutoComplete from the full Firefox for Android browser for better form completion RESOLVED
1329151 -- Custom tabs: allow pre-warming of the Browser in the background, RESOLVED
1329152 P1 Custom tabs: Enable custom tabs by default (when released) RESOLVED Julian Chu [:walkingice]
1329154 P2 Custom tabs: If user has ad blocker add-on installed, enable ad blocking in custom tabs RESOLVED Eugen Sawin [:esawin] on leave
1329155 -- Custom tabs: Collect information on number of launches (Load_URL) using custom tabs RESOLVED Nevin Chen(Not active on Bugzilla)
1329156 -- Custom tabs: Collect information on custom tab customization features used by 3rd party apps RESOLVED Nevin Chen(Not active on Bugzilla)
1329157 -- Custom tabs: Collect the source names of 3rd party app that is using custom tabs RESOLVED Nevin Chen(Not active on Bugzilla)
1329159 -- Custom tabs: Collect information on Firefox for Android launches from custom tabs RESOLVED
1329160 -- Custom tabs: Collect information on pre-warming sessions used by 3rd party apps RESOLVED Nevin Chen(Not active on Bugzilla)
1329664 -- Don't attempt to restore a CustomTabsActivity if the corresponding tab has been closed RESOLVED Dylan Roeh (:droeh)
1336373 -- Custom tabs: Action button icon supports tint RESOLVED Julian Chu [:walkingice]
1337771 -- Custom tabs: Action button not working for some apps VERIFIED Julian Chu [:walkingice]
1338055 -- Crash in java.lang.IllegalArgumentException: Prompt:Show was not registered at org.mozilla.gecko.EventDispatcher.unregisterListener(EventDispatcher.java) RESOLVED Dylan Roeh (:droeh)
1346413 -- Going back from a CustomTabsActivity doesn't trigger application-background notification RESOLVED Jan Henning [:JanH]
1346542 P1 Back button navigation and web content copy/paste broken in restored GeckoApp instance VERIFIED Eugen Sawin [:esawin] on leave
1346589 -- Custom tabs: Handle "Open link in new tab" context menu and friends RESOLVED
1346694 -- Custom tabs: handling of requesting new permissions when I open from an app using custom tabs RESOLVED
1347165 P2 Change context menu "open in new tab" to "open in Firefox tab" when not in browser RESOLVED
1348716 -- Copy link in CustomTabsActivity by long-clicking in Title VERIFIED Julian Chu [:walkingice]
1348718 -- Tweak images of ActionBar in CustomTabsActivity RESOLVED Julian Chu [:walkingice]
1350198 P1 Custom tabs: Cannot paste strings to input element VERIFIED
1351169 P1 Crash in java.lang.NullPointerException: Null native pointer at org.mozilla.gecko.mozglue.GeckoLoader.nativeRun(Native Method) VERIFIED Eugen Sawin [:esawin] on leave
1351605 P1 Custom tabs: Title becomes blank after resume VERIFIED Julian Chu [:walkingice]
1352352 P1 Custom tabs: open link in context menu does not work well VERIFIED
1352993 P1 Custom Tab: Action bar is not displayed when selecting a word VERIFIED Julian Chu [:walkingice]
1354766 P5 Custom tabs: support customized close button NEW Julian Chu [:walkingice]
1355735 P1 Custom tabs: Menu says "Open in Android-System" if no default browser is set VERIFIED Julian Chu [:walkingice]
1356182 P2 Custom tabs: cannot display long URL properly NEW
1356545 P5 CustomTab toolbar stay displayed when scroll down NEW
1359098 P1 Crash in java.lang.NoSuchMethodError: android.content.Context.getDrawable at org.mozilla.gecko.customtabs.ActionBarPresenter.initIndicator(ActionBarPresenter.java) RESOLVED Julian Chu [:walkingice]
1365695 -- Make form fill (including logins) work with GeckoView-based custom tabs RESOLVED
1365868 P1 Support minimal context menu functionality in GeckoView-based custom tabs VERIFIED Nevin Chen(Not active on Bugzilla)
1366648 P1 Custom tabs: reload button has wrong color VERIFIED Julian Chu [:walkingice]
1367077 P1 Ensure form fill (passwords, etc) working in GeckoView-based custom tabs and web apps RESOLVED Jim Chen [:jchen] [:darchons]
1367079 P1 [geckoview] Figure out text selection actions RESOLVED Jim Chen [:jchen] [:darchons]
1369114 -- Browser toolbar visible in custom tab (while loading) RESOLVED
1369117 -- When opening or closing a custom tab, there is often a flash of Fennec content RESOLVED
1369681 -- Custom tabs: seeing flash when launch Custom Tabs RESOLVED Julian Chu [:walkingice]
1386712 -- [geckoview] Media continues playing in Custom Tab after closed RESOLVED Dylan Roeh (:droeh)
1388724 -- CustomTab: doorhanger not displayed VERIFIED Jim Chen [:jchen] [:darchons]
1393128 -- Custom tabs: make downloads work VERIFIED Jim Chen [:jchen] [:darchons]
1393504 P1 Truncate/ellipsize custom tabs action bar title to avoid misleading titles RESOLVED Dylan Roeh (:droeh)
1394404 P2 (photon) Custom tabs - the loading indicator doesn't fully load and it has different colors VERIFIED
1395557 P1 Customtab: security level of site not displayed same as Fennec RESOLVED James Willcox (:snorp) (jwillcox@mozilla.com)
1395570 P3 CustomTab: media notification not displayed NEW Eugen Sawin [:esawin] on leave
1395573 P5 CustomTab: "Edit site settings" not displayed NEW
1398065 P5 Ability to move a custom tab/web app into the full UI wholesale and without state loss NEW
1398067 P2 Fully support context menu and "tab" related functionality in GeckoView-based custom tabs/web apps NEW
1398197 -- Porting Context Menu from browser.js to Java RESOLVED Nevin Chen(Not active on Bugzilla)
1398409 P1 Make FormAssistPopup work for custom tabs RESOLVED Jim Chen [:jchen] [:darchons]
1400243 P1 CustomTab: no doorhanger displayed when log in to a page VERIFIED Jim Chen [:jchen] [:darchons]
1406024 P2 GeckoView - Date-time/ color pickers don't open in Custom Tab/PWA if Fennec is already running VERIFIED Eugen Sawin [:esawin] on leave
1411968 P2 Can't cancel/pause a download VERIFIED Jim Chen [:jchen] [:darchons]
1412284 P3 On Samsung Galaxy Tab 3 Custom Tab option not displayed NEW
1415534 -- Custom Tab not enabled on 57 RC VERIFIED
1432180 P3 CustomTab: different size and resolution on share button NEW

83 Total; 10 Open (12.05%); 47 Resolved (56.63%); 26 Verified (31.33%);


    • bug 1356346 - (customtabs_geckoview) Overhaul CustomTabsActivity to use GeckoView rather than extending GeckoApp
Full Query
ID Priority Summary Status Assigned to
1355735 P1 Custom tabs: Menu says "Open in Android-System" if no default browser is set VERIFIED Julian Chu [:walkingice]
1361831 -- [geckoview] Eliminate dependency on GeckoInterface RESOLVED
1365868 P1 Support minimal context menu functionality in GeckoView-based custom tabs VERIFIED Nevin Chen(Not active on Bugzilla)
1366770 P2 Custom Tab: Toolbar still displayed if a video is fullscreen VERIFIED Dylan Roeh (:droeh)
1367077 P1 Ensure form fill (passwords, etc) working in GeckoView-based custom tabs and web apps RESOLVED Jim Chen [:jchen] [:darchons]
1367081 -- Hook up GeckoView prompt delegate to Fennec UI bits RESOLVED Jim Chen [:jchen] [:darchons]
1369050 P5 Custom Tabs: The menu is not displayed in the right position when rotating the device NEW
1375141 -- Crash in java.lang.NullPointerException: uriString at android.net.Uri$StringUri.<init>(Uri.java) RESOLVED Eugen Sawin [:esawin] on leave
1388058 -- CustomTab: Security level of the site not displayed RESOLVED
1388734 -- CustomTab: download is not working RESOLVED
1394404 P2 (photon) Custom tabs - the loading indicator doesn't fully load and it has different colors VERIFIED
1395577 -- CustomTab: Autocomplete not working RESOLVED
1395582 -- CustomTab: context menu not working RESOLVED
1397798 P1 Custom Tab not working RESOLVED James Willcox (:snorp) (jwillcox@mozilla.com)
1398067 P2 Fully support context menu and "tab" related functionality in GeckoView-based custom tabs/web apps NEW
1398508 P3 Tab Queue and Custom Tabs don't play well together NEW
1414084 P3 Add-on menu items/browser actions aren't shown if Gecko is started through Custom Tabs/PWA VERIFIED Jan Henning [:JanH]

17 Total; 3 Open (17.65%); 9 Resolved (52.94%); 5 Verified (29.41%);


Still issues

Bug fixed

Signoff

Criteria

  • All test cases should be executed
  • All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed

Results

Nightly testing

  • feature stable

Beta testing

  • feature stable