QA/Fennec/CustomTab on Fennec: Difference between revisions

Jump to navigation Jump to search
 
(37 intermediate revisions by the same user not shown)
Line 4: Line 4:


== Ownership ==
== Ownership ==
Developer contact: [mailto:x@mozilla.com  Julian Chu :walkingice], [mailto:x@mozilla.com Nevin Chen:nechen]  
Developer contact: [mailto:droeh@mozilla.com  Dylan Roeh [:droeh]]


QA: [mailto:sorina.florean@softvision.ro Sorina Florean [:sorina]]
QA: [mailto:sorina.florean@softvision.ro Sorina Florean [:sorina]]
Line 10: Line 10:
== Overall Status ==
== Overall Status ==


<small>'''<font color="green">[LANDED]</font>'''</small> Nightly 55:  
<small>'''<font color="green">[LANDED]</font>'''</small> Nightly 57:  


<small>'''<font color="red">[NOT LANDED]</font>'''</small> Aurora: NA
<small>'''<font color="green">[LANDED]</font>'''</small> Beta 57
 
<small>'''<font color="red">[NOT LANDED]</font>'''</small> Beta: NA


= Testing Summary =  
= Testing Summary =  
Line 57: Line 55:
= Testing details =
= Testing details =
== Test Cases==
== Test Cases==
*[https://moztrap.mozilla.org/manage/case/xxxxx/ Test Case title]
*[https://testrail.stage.mozaws.net/index.php?/suites/view/254&group_by=cases:section_id&group_id=2563&group_order=asc Test Case Custom Tab Testrail]
*in progress draft - https://docs.google.com/document/d/1yI557RvOB1Usgs_drqlyLmxeBJfcSiN2zt2VKV8lcXg/edit
* https://docs.google.com/spreadsheets/d/1Op8Yqctmh4p7UwkN0I7q8uf1GoyXXnQ90E-oq4o5mCE/edit#gid=0


== Testing days==
== Testing days==
Line 64: Line 62:
*Created Test Plan
*Created Test Plan
===Date: 2017-03-30===
===Date: 2017-03-30===
* Created Test Cases
* Exploratory testing on latest Nightly (2017-03-30) with Nexus 6 (Android 7.1.1)
* New bugs:
**{{Bug|1352104}} - Back arrow and three dots menu doesn't have the same color
**{{Bug|1352108}} - Nightly custom tab display a blank page when device orientation is changed
* For enabling this feature: Fennec Menu -> Settings -> Advanced -> Experimental features -> Custom Tabs (turn on)
* For enabling this feature: Fennec Menu -> Settings -> Advanced -> Experimental features -> Custom Tabs (turn on)
[[File:Screenshot 20170330-150951.png|400px|thumb|center|Disabled]]
[[File:Screenshot 20170330-150951.png|400px|thumb|center|Disabled]]
[[File:Screenshot 20170330-142637.png|400px|thumb|center|Enabled]]
[[File:Screenshot 20170330-142637.png|400px|thumb|center|Enabled]]
===Date: 2017-04-03===
* Commented on:
**{{Bug|1329149}} - Custom tabs: allow sharing of AutoComplete from the full Firefox for Android browser for better form completion
**{{Bug|1351605}} - Custom tabs: Title becomes blank after resume
* Verified P1 bugs:
**{{Bug|1337238}} - Custom Tabs: progress bar on the custom bar for loading page
**{{Bug|1332546}} - [CustomTab] 3 different types of displaying site info in URL bar should be designed in custom tab while there is only one in chrome
**{{Bug|1325174}} - Custom tabs toolbar back button should close the tab and finish the activity
**{{Bug|1348716}} - Copy link in CustomTabsActivity by long-clicking in Title
**{{Bug|1346542}} - Back button navigation and web content copy/paste broken in restored GeckoApp instance
**{{Bug|1329143}} - Custom tabs: support custom toolbar color
* New bugs during verifying/testing:
**{{Bug|1352993}} - Custom Tab: Action bar is not displayed when selecting a word
**{{Bug|1352999}} - Custom Tab: Same page/URL is opened in different tabs in Nightly
**{{Bug|1353019}} - Custom tabs: reload/refresh button from menu doesn't change to "x"
===Date: 2017-04-05===
*Exploratory testing with LG G4 (Android 5.1) and HTC Desire 820 (Android 6.0.1)
*Verified bugs:
**{{Bug|1315937}} - Custom tabs: Support custom menu items
**{{Bug|1329148}} - Custom tabs: allow sharing of cookie jar and permissions from the full Firefox for Android browser so users don't have to log in to sites they are already connected to, or granted permissions to
*New bug:
**{{Bug|1353732}} - Custom Tab: Issues while switching between Nightly and apps that supports custom tabs
===Date: 2017-04-14===
*SignOff report for 55:
*Exploratory and Test Cases with HTC 10 (Android 7.0) and Huawei MediaPad M2 (Android 5.1.1).
*TestRail: https://testrail.stage.mozaws.net/index.php?/runs/view/3757&group_by=cases:section_id&group_id=2563&group_order=asc
*New bugs:
**{{Bug|1356545}} - CustomTab toolbar stay displayed when scroll down
**{{Bug|1356549}} - Custom Tab:: forms are not focused
**{{Bug|1356560}} - Custom Tab: doorhanger is not correctly displayed
Verified bugs:
**{{Bug|1352104}} - Back arrow and three dots menu doesn't have the same color
**{{Bug|1352108}} - Nightly custom tab display a blank page when device orientation is changed
===Date: 2017-04-19===
* Exploratory Testing with Huawei Honor (Android 5.1.1)
*New Bugs:
**{{Bug|1357778}} - Custom Tab: Fennc launched with the same URL as CustomTab
**{{Bug|1357780}} - Custom Tab: Different color for Share option from menu
**{{Bug|1357781}} - Custom Tab: Edit Site Settings option not implemented
===Date: 2017-05-08===
* Exploratory Testing with Huawei Honor (Android 5.1.1), Honor 8 (Android 6.0), Asus ZenPad 8(Android 6.0.1)
*New Bug:
**{{Bug|1363043}} - Custom Tab: ActionBar with different colors
*Verified bugs:
**{{Bug|1353019}} - Custom tabs: reload/refresh button from menu doesn't change to "x"
**{{Bug|1351605}} - Custom tabs: Title becomes blank after resume
**{{Bug|1352108}} - Nightly custom tab display a blank page when device orientation is changed
**{{Bug|1352993}} - Custom Tab: Action bar is not displayed when selecting a word
===Date: 2017-05-17===
* Exploratory Testing with Nexus 9 (Android 7.1.1), HTC Desire 820(Android 6.0.1)
*Verified bugs:
**{{Bug|1350198}} - Custom tabs: Cannot paste strings to input element
**{{Bug|1329145}} - Custom tabs: support custom enter and exit animation
**{{Bug|1337771}} - Custom tabs: Action button not working for some apps
**{{Bug|1329144}} - Custom tabs: support custom action button
**{{Bug|1352352}} - Custom tabs: open link in context menu does not work well
*Commented on:
**{{Bug|1329149}} - Custom tabs: allow sharing of AutoComplete from the full Firefox for Android browser for better form completion
**{{Bug|1355735}} - Custom tabs: Menu says "Open in Android-System" if no default browser is set
**{{Bug|1357778}} - Custom Tab: Fennc launched with the same URL as CustomTab
===Date: 2017-05-22===
* Exploratory Testing with Huawei Honor (Android 5.1.1)
* Finished Test Cases
* New Bugs:
**{{Bug|1366770}} - Custom Tab: Toolbar still displayed if a video is fullscreen
**{{Bug|1366782}} - Custom Tab: about:home launched when CustomTab activity is closed
===Date: 2017-05-29===
* Exploratory Testing and TCs with Asus ZenPad 8 (Android 6.0.1) - Gmail, Yahnac, News&Weather, Chromer apps
**https://testrail.stage.mozaws.net/index.php?/runs/view/4389&group_by=cases:section_id&group_id=2563&group_order=asc
* Verified bugs:
**{{Bug|1366648}} - Custom tabs: reload button has wrong color
**{{Bug|1357781}} - Custom Tab: Edit Site Settings option not implemented
===Date: 2017-08-07===
* Reviewing TCs for Custom Tab - GeckoView - feature in Nightly 57
* Exploratory testing with Nexus 5 (Android 6.0.1) on latest Nightly (08-07)
** New {{bug|1388058}} - CustomTab: Security level of the site not displayed
===Date: 2017-08-09===
* Exploratory testing with HTC 10 (Android 7.0) on latest Nightly
** New {{bug|1388734}} - CustomTab: download is not working
** New {{bug|1388724}} - CustomTab: doorhanger not displayed
===Date: 2017-08-28===
* Exploratory testing with Asus ZenPad 8 (Android 6.0.1) on latest Nightly
* Verified bugs:
**{{bug|1366770}} - Custom Tab: Toolbar still displayed if a video is fullscreen
**{{bug|1388058}} - CustomTab: Security level of the site not displayed
===Date: 2017-08-31===
* Mid-Nightly signOff report, status: YELLOW for 57
** https://testrail.stage.mozaws.net/index.php?/reports/view/526
* New bugs found:
**{{bug|1395570}} - CustomTab: media notification not displayed
**{{bug|1395573}} - CustomTab: "Edit site settings" not displayed
**{{bug|1395577}} - CustomTab: Autocomplete not working
**{{bug|1395582}} - CustomTab: context menu not working
**{{bug|1395557}} - Customtab: security level of site not displayed same as Fennec
===Date: 2017-10-09===
* Test cases and exploratory testing on 57 Beta 5
** Huawei MediaPad M2 (Android 5.1.1) - https://testrail.stage.mozaws.net/index.php?/runs/view/6575&group_by=cases:section_id&group_order=asc&group_id=2563
** Google Pixel (Android 8.0) - https://testrail.stage.mozaws.net/index.php?/runs/view/6574&group_by=cases:section_id&group_order=asc&group_id=2563
** Samsung Galaxy Tab 3 (Android 7.0) - https://testrail.stage.mozaws.net/index.php?/runs/view/6567&group_by=cases:section_id&group_order=asc&group_id=2563
* Reopened {{Bug|1356560}} - Custom Tab: doorhanger is not correctly displayed
* Verified {{Bug|1400243}} - CustomTab: no doorhanger displayed when log in to a page
===Date: 2017-10-23===
* Verified bugs:
**{{Bug|1300574}} - Back button doesn't navigate back a page in custom tabs
**{{Bug|1365868}} - Support minimal context menu functionality in GeckoView-based custom tabs
**{{Bug|1388724}} - CustomTab: doorhanger not displayed
**{{Bug|1315348}} - Rotating the device while viewing a custom tab loses toolbar color
===Date: 2017-10-26===
*Pre-Release Firefox 57 Sign off report, Status: GREEN
**https://testrail.stage.mozaws.net/index.php?/reports/view/660
===Date: 2018-02-28===
*Ran test cases on Nightly 60.0a1 with Samsung Galaxy S8(Android 7.0): https://testrail.stage.mozaws.net/index.php?/runs/view/8591&group_by=cases:section_id&group_order=asc&group_id=2563
*Commented/verified bugs:
**{{Bug|1393128}} - Custom tabs: make downloads work
**{{Bug|1353732}} - Custom Tab: Issues while switching between Nightly and apps that supports custom tabs
**{{Bug|1360699}} - Fennec Custom Tab doesn't close after pressing back or close buttons.
**{{Bug|1440592}} - Crash in java.lang.IllegalStateException: Unexpected new session at org.mozilla.gecko.customtabs.CustomTabsActivity.onNewSession(CustomTabsActivity.java)


=Bug Work=
=Bug Work=
* Meta bug
* Meta bug
**{{Bug|1337236}} - [Meta] Support CustomTab on Fennec
**{{Bug|1208655}} - (customtabs) [meta] Make Fennec be an Android "custom tab" ecosystem participant
<onlyinclude>
<bugzilla>
{
    "blocks": "1208655",
    "include_fields": "id, priority, summary, status, assigned_to",
    "order": "Status"
}
</bugzilla>
</onlyinclude>
 
**{{Bug|1356346}} - (customtabs_geckoview) Overhaul CustomTabsActivity to use GeckoView rather than extending GeckoApp
<onlyinclude>
<onlyinclude>
<bugzilla>
<bugzilla>
{
{
     "blocks": "1337236",
     "blocks": "1356346",
     "include_fields": "id, priority, summary, status, assigned_to",
     "include_fields": "id, priority, summary, status, assigned_to",
     "order": "Status"
     "order": "Status"
Line 92: Line 223:
== Results ==
== Results ==
'''Nightly testing'''
'''Nightly testing'''
*in progress
*feature stable
'''Aurora testing'''
*NA
'''Beta testing'''
'''Beta testing'''
*NA
*feature stable
3,360

edits

Navigation menu