QA/Fennec/CustomTab on Fennec

From MozillaWiki
Jump to navigation Jump to search

Overview

Purpose

The purpose of this wiki is to serve as a general test plan for verifying that Custom Tabs are supported in Fennec

Ownership

Developer contact: Dylan Roeh [:droeh]

QA: Sorina Florean [:sorina]

Overall Status

[LANDED] Nightly 57:

[NOT LANDED] Beta: NA

Testing Summary

Scope of testing

The testing will be focus on:

  • verifying that users can use Custom Tabs in Fennec
  • verifying that a toolbar color was set
  • verifying that the toolbar back button for custom tabs will close the tab and finish the activity, allowing to getting back to the app that launched the custom tab
  • verifying that my ad-blocker add-on from my Fennec has the same functionality for my custom tabs
  • verifying that the web-page is reload when users scrolled down the web-page
  • verifying that there is 3 different types of displaying site info in URL Bar
  • verifying that progress bar is displayed for loading page

Environments

Testing will be performed on following devices:

  • Phones
    • 5.x?
    • 6.x
    • 7.x
  • Tablet
    • 6.x
    • 7.x

Specifications

Screenshot:

Security level of Sites

User stories

  • As a user, I want to be able to use custom tabs on Fennec
  • As a user, I want if I set Firefox for Android as the default browser to also use Firefox when 3rd party apps use custom tabs
  • As a user, I expect links that I open from an app using custom tabs will share cookie jar and permissions from the full Firefox for Android browser so I don't have to log in to sites that I already connected to, or granted permissions to

Acceptance Criteria

  • 3-party app can edit background color of custom tab, and add functions onto custom tab, such as use red background and add a “Share” button
  • UI customization:Toolbar color, action button, custom menu items, custom in/out animations, bottom toolbar
  • Synchronized AutoComplete across devices for better form completion.

Testing details

Test Cases

Testing days

Date: 2017-03-02

  • Created Test Plan

Date: 2017-03-30

  • Created Test Cases
  • Exploratory testing on latest Nightly (2017-03-30) with Nexus 6 (Android 7.1.1)
  • New bugs:
    • bug 1352104 - Back arrow and three dots menu doesn't have the same color
    • bug 1352108 - Nightly custom tab display a blank page when device orientation is changed
  • For enabling this feature: Fennec Menu -> Settings -> Advanced -> Experimental features -> Custom Tabs (turn on)
Disabled
Enabled

Date: 2017-04-03

  • Commented on:
    • bug 1329149 - Custom tabs: allow sharing of AutoComplete from the full Firefox for Android browser for better form completion
    • bug 1351605 - Custom tabs: Title becomes blank after resume
  • Verified P1 bugs:
    • bug 1337238 - Custom Tabs: progress bar on the custom bar for loading page
    • bug 1332546 - [CustomTab] 3 different types of displaying site info in URL bar should be designed in custom tab while there is only one in chrome
    • bug 1325174 - Custom tabs toolbar back button should close the tab and finish the activity
    • bug 1348716 - Copy link in CustomTabsActivity by long-clicking in Title
    • bug 1346542 - Back button navigation and web content copy/paste broken in restored GeckoApp instance
    • bug 1329143 - Custom tabs: support custom toolbar color
  • New bugs during verifying/testing:
    • bug 1352993 - Custom Tab: Action bar is not displayed when selecting a word
    • bug 1352999 - Custom Tab: Same page/URL is opened in different tabs in Nightly
    • bug 1353019 - Custom tabs: reload/refresh button from menu doesn't change to "x"

Date: 2017-04-05

  • Exploratory testing with LG G4 (Android 5.1) and HTC Desire 820 (Android 6.0.1)
  • Verified bugs:
    • bug 1315937 - Custom tabs: Support custom menu items
    • bug 1329148 - Custom tabs: allow sharing of cookie jar and permissions from the full Firefox for Android browser so users don't have to log in to sites they are already connected to, or granted permissions to
  • New bug:
    • bug 1353732 - Custom Tab: Issues while switching between Nightly and apps that supports custom tabs

Date: 2017-04-14

Verified bugs:

    • bug 1352104 - Back arrow and three dots menu doesn't have the same color
    • bug 1352108 - Nightly custom tab display a blank page when device orientation is changed

Date: 2017-04-19

  • Exploratory Testing with Huawei Honor (Android 5.1.1)
  • New Bugs:
    • bug 1357778 - Custom Tab: Fennc launched with the same URL as CustomTab
    • bug 1357780 - Custom Tab: Different color for Share option from menu
    • bug 1357781 - Custom Tab: Edit Site Settings option not implemented

Date: 2017-05-08

  • Exploratory Testing with Huawei Honor (Android 5.1.1), Honor 8 (Android 6.0), Asus ZenPad 8(Android 6.0.1)
  • New Bug:
    • bug 1363043 - Custom Tab: ActionBar with different colors
  • Verified bugs:
    • bug 1353019 - Custom tabs: reload/refresh button from menu doesn't change to "x"
    • bug 1351605 - Custom tabs: Title becomes blank after resume
    • bug 1352108 - Nightly custom tab display a blank page when device orientation is changed
    • bug 1352993 - Custom Tab: Action bar is not displayed when selecting a word

Date: 2017-05-17

  • Exploratory Testing with Nexus 9 (Android 7.1.1), HTC Desire 820(Android 6.0.1)
  • Verified bugs:
    • bug 1350198 - Custom tabs: Cannot paste strings to input element
    • bug 1329145 - Custom tabs: support custom enter and exit animation
    • bug 1337771 - Custom tabs: Action button not working for some apps
    • bug 1329144 - Custom tabs: support custom action button
    • bug 1352352 - Custom tabs: open link in context menu does not work well
  • Commented on:
    • bug 1329149 - Custom tabs: allow sharing of AutoComplete from the full Firefox for Android browser for better form completion
    • bug 1355735 - Custom tabs: Menu says "Open in Android-System" if no default browser is set
    • bug 1357778 - Custom Tab: Fennc launched with the same URL as CustomTab

Date: 2017-05-22

  • Exploratory Testing with Huawei Honor (Android 5.1.1)
  • Finished Test Cases
  • New Bugs:
    • bug 1366770 - Custom Tab: Toolbar still displayed if a video is fullscreen
    • bug 1366782 - Custom Tab: about:home launched when CustomTab activity is closed

Date: 2017-05-29

Date: 2017-08-07

  • Reviewing TCs for Custom Tab - GeckoView - feature in Nightly 57
  • Exploratory testing with Nexus 5 (Android 6.0.1) on latest Nightly (08-07)
    • New bug 1388058 - CustomTab: Security level of the site not displayed

Date: 2017-08-09

  • Exploratory testing with HTC 10 (Android 7.0) on latest Nightly

Date: 2017-08-28

  • Exploratory testing with Asus ZenPad 8 (Android 6.0.1) on latest Nightly
  • Verified bugs:
    • bug 1366770 - Custom Tab: Toolbar still displayed if a video is fullscreen
    • bug 1388058 - CustomTab: Security level of the site not displayed

Bug Work

  • Meta bug
    • bug 1356346 - (customtabs_geckoview) Overhaul CustomTabsActivity to use GeckoView rather than extending GeckoApp
Full Query
ID Priority Summary Status Assigned to
1355735 P1 Custom tabs: Menu says "Open in Android-System" if no default browser is set VERIFIED Julian Chu [:walkingice]
1361831 -- [geckoview] Eliminate dependency on GeckoInterface RESOLVED
1365868 P1 Support minimal context menu functionality in GeckoView-based custom tabs VERIFIED Nevin Chen(Not active on Bugzilla)
1366770 P2 Custom Tab: Toolbar still displayed if a video is fullscreen VERIFIED Dylan Roeh (:droeh) (he/him)
1367077 P1 Ensure form fill (passwords, etc) working in GeckoView-based custom tabs and web apps RESOLVED (inactive) Jim Chen [:jchen] [:darchons]
1367081 -- Hook up GeckoView prompt delegate to Fennec UI bits RESOLVED (inactive) Jim Chen [:jchen] [:darchons]
1369050 P5 Custom Tabs: The menu is not displayed in the right position when rotating the device RESOLVED
1375141 -- Crash in java.lang.NullPointerException: uriString at android.net.Uri$StringUri.<init>(Uri.java) RESOLVED Eugen Sawin [:esawin]
1388058 -- CustomTab: Security level of the site not displayed RESOLVED
1388734 -- CustomTab: download is not working RESOLVED
1394404 P2 (photon) Custom tabs - the loading indicator doesn't fully load and it has different colors VERIFIED Jing-wei Wu [:jwu]
1395577 -- CustomTab: Autocomplete not working RESOLVED
1395582 -- CustomTab: context menu not working RESOLVED
1397798 P1 Custom Tab not working RESOLVED James Willcox (:snorp) (jwillcox@mozilla.com) (he/him)
1398067 P2 Fully support context menu and "tab" related functionality in GeckoView-based custom tabs/web apps RESOLVED
1398508 P3 Tab Queue and Custom Tabs don't play well together RESOLVED
1414084 P3 Add-on menu items/browser actions aren't shown if Gecko is started through Custom Tabs/PWA VERIFIED Jan Henning [:JanH]

17 Total; 0 Open (0%); 12 Resolved (70.59%); 5 Verified (29.41%);


Still issues

Bug fixed

Signoff

Criteria

  • All test cases should be executed
  • All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed

Results

Nightly testing

  • in progress

Beta testing

  • NA