QA/Fennec/Support manifest display-standalone display mode: Difference between revisions

 
(30 intermediate revisions by the same user not shown)
Line 25: Line 25:
Testing will be performed on the following Android devices:  
Testing will be performed on the following Android devices:  
* Phones
* Phones
** 4.x
** 5.x
** 5.x
** 6.x
** 6.x
Line 32: Line 33:
** 6.x
** 6.x
** 7.x
** 7.x
* Android 4 devices, or anything under API 21 level, will not be supported.


== Specifications ==
== Specifications ==
Line 47: Line 47:
= Testing details =
= Testing details =
== Test Cases==
== Test Cases==
*[https://testrail.stage.mozaws.net/index.php?/suites/view/ TestRail test cases]
*[https://testrail.stage.mozaws.net/index.php?/suites/view/254&group_by=cases:section_id&group_id=3341&group_order=asc TestRail test cases]
*[https://docs.google.com/spreadsheets/d/18saqrrSfUohdlxg2vlRsb42ulAX8JI8-o2tgK03SB4g/edit#gid=0 Google sheet - test cases]
*[https://docs.google.com/spreadsheets/d/18saqrrSfUohdlxg2vlRsb42ulAX8JI8-o2tgK03SB4g/edit#gid=0 Google sheet - test cases]


Line 55: Line 55:
* Started creating the Test Plan
* Started creating the Test Plan
* Started writing Test Cases
* Started writing Test Cases
===Date: 03-21-2017===
===Date: 03-21-2017===
*Documentation research and writing test cases
*Documentation research and writing test cases
===Date: 03-24-2017===
===Date: 03-24-2017===
*Documentation research and writing test cases
*Documentation research and writing test cases
===Date: 03-21-2017===
===Date: 03-21-2017===
* Completed the Test Plan
* Completed the Test Plan
* Writing Test Cases
* Writing Test Cases
===Date: 03-30-2017===
===Date: 03-30-2017===
* Writing Test Cases
* Writing Test Cases
* Tested on Nightly 55 with LG G4 (Android 5.1)
* Tested on Nightly 55 with LG G4 (Android 5.1)
* Logged bug: {{Bug|1352099}} - [PWA] Web Apps don't always have a title and icon in the task switcher entry
* Logged bug: {{Bug|1352099}} - [PWA] Web Apps don't always have a title and icon in the task switcher entry
===Date: 03-31-2017===
===Date: 03-31-2017===
*Verified bugs:
*Verified bugs:
Line 86: Line 91:
*Logged bug:
*Logged bug:
**{{Bug|1353714}} - Crash @ java.lang.NoClassDefFoundError: android.app.ActivityManager$TaskDescription at org.mozilla.gecko.webapps.WebAppActivity.loadManifest(WebAppActivity.java)
**{{Bug|1353714}} - Crash @ java.lang.NoClassDefFoundError: android.app.ActivityManager$TaskDescription at org.mozilla.gecko.webapps.WebAppActivity.loadManifest(WebAppActivity.java)
===Date: 04-10-2017===
*Added test cases and verified on Nightly 55 with LG G4 (Android 5.1).
*Verified bug:
**Bug 1353714 - Crash @ java.lang.NoClassDefFoundError: android.app.ActivityManager$TaskDescription at org.mozilla.gecko.webapps.WebAppActivity.loadManifest(WebAppActivity.java)
*Logged bugs:
**Bug 1355094 - WebApps - Remove context menu items that are not needed
**Bug 1355098 - WebApps - 'Add to homescreen' from the bookmarks/history panels doesn't install the shortcut as a standalone app
===Date: 04-11-2017===
*Exploratory Testing on latest Nightly 55.0a1
*Logged bugs:
**Bug 1355513 - Allow access to microphone permissions not displayed in web apps
===Date: 04-12-2017===
*Exploratory testing on Nightly 55
*Verified bugs:
**Bug 1352433 - First run tour in browser and some settings reset after opening a web app
*Investigated:
**Bug 1336355 - Launched manifest bookmarks should have their own taskswitcher entry
**Bug 1355513 - Allow access to microphone and camera permissions not displayed in web apps
*Added a comment on: Bug 1352099 - [PWA] Web Apps don't always have a title and icon in the task switcher entry
*Logged bugs:
**Bug 1355824 - Browser opens a new tab for web apps already running - tabs tray shows wrong info
**Bug 1355847 - Web apps - Share selected text doesn't work on Android 6+
**Bug 1355852 - Web Apps - Android 4 & 5 Text selection toolbar not displayed in web apps
===Date: 04-13-2017===
*Exploratory testing on latest Nightly 55.0a1
*Research for relevant add-ons for web apps
===Date: 04-18-2017===
*Exploratory testing on latest Nightly 55.0a1
*Research for relevant add-ons for web apps. The two add-ons finally selected are:
**https://addons.mozilla.org/en-US/android/addon/pure-url
**https://addons.mozilla.org/en-US/android/addon/open-with-google-chrome
*Logged bugs:
**Bug 1357443 - Web Apps - Can't download files from web apps using Nightly
**Bug 1357438 - Web apps - Login autocomplete isn't working
===Date: 04-19-2017===
*Exploratory testing on latest Nightly 55.0a1
*Logged bug:
**Bug 1357779 - Web Apps - Some webapps: the external url remains displayed
===Date: 04-24-2017===
*Exploratory testing on latest Nightly 55.0a1
===Date: 04-26-2017===
Functional and exploratory testing on latest Nightly 55.0a1, with Prestigio Grace X5 (Android 4.4.2)
===Date: 04-27-2017===
Exploratory testing on latest Nightly 55.0a1
Verified bugs:
*Bug 1355676 - Crash in java.lang.NullPointerException: Attempt to invoke virtual method ''android.graphics.Bitmap org.mozilla.gecko.icons.decoders.LoadFaviconResult.getBestBitmap(int)'' on a null object reference at org.mozilla.gecko.BrowserApp.handleMessage(Browser...
===Date: 05-04-2017===
Verified bugs:
*Bug 1355824 - Browser opens a new tab for web apps already running - tabs tray shows wrong info
*Bug 1352991 - Pages loaded in Nightly show in the web app
*Bug 1353857 - Fix handling of entering/leaving Web App
*Bug 1355852 - Web Apps - Android 4 & 5 Text selection toolbar not displayed in web apps
*Bug 1357443 - Web Apps - Can't download files from web apps using Nightly
===Date: 05-08-2017===
Full testing on Nightly, with:
*Motorola Motorola Nexus 6 (Android 7.0)
*Prestigio Grace X5 (Android 4.4.2)
Logged bugs:
*Bug 1363049 - Web Apps - Web apps are reopened when closing a tab opened from them
*Bug 1363052 - Web Apps - Re-launching a web app with an external page opened, resets is to the homepage
===Date: 05-10-2017===
Full testing on Nightly, with:
*Lenovo A536 (Android 4.4.2)
*Huawei Honor 5X (Android 5.1.1)
Verified bugs:
*Bug 1234558 - Use icon/title from app manifest for "Add to home screen"
*Bug 1360658 - Snack bars not showing up in WebAppActivity
===Date: 05-11-2017===
Full testing on Nightly, with:
*Lenovo Yoga Tablet 2 (Android 4.4.2)
Investigated:
*Bug 1360455 - Web Apps - snapdrop.net cannot be installed as pwa on Huawei/Xiaomi devices
Logged:
*Bug 1364044 - Web Apps - (Tablets) Tabs appear in the browser when there are multiple webapps opened
*Bug 1364052 - Web Apps - Some webapps show the internal page url
===Date: 05-12-2017===
Full testing on Nightly, with:
*Lenovo Yoga Tablet 2 (Android 4.4.2)
===Date: 05-15-2017===
Full testing on Nightly, with
*HTC Nexus 9 (Android 7.1.1)
*Huawei Honor 5X (Android 5.1.1)
===Date: 05-17-2017===
Full testing on Nightly, with LG G4 (Android 6)
*Verified:
**Bug 1357438 - Web apps - Login autocomplete isn't working
*Updated:
**Bug 1364044 - Web Apps - Tabs appear in the browser when there are multiple webapps opened
===Date: 05-18-2017===
Smoke testing on Nightly, with LG G4 (Android 6.0)
Verified Bug 1363359 - standalone manifest install replaces Nightly in Touchwiz
Sent the mid-Nightly feature sign-off email.
===Date: 05-19-2017===
Added PWA feature test cases in TestRail: https://testrail.stage.mozaws.net/index.php?/suites/view/254&group_by=cases:section_id&group_id=3341&group_order=asc
===Date: 05-25-2017===
Verified: Bug 1363049 - Web Apps - Web apps are reopened when closing a tab opened from them
===Date: 05-26-2017===
*Full testing on Asus ZenPad 8.0 Z380KL (Android 6.0.1)
*Logged bug: Bug 1368024 - Web Apps - Some web apps have an URL instead of title


=Bug Work=
=Bug Work=
==Tracking bugs==
==Tracking bugs==
* bugs to track the feature
* Bugs to track the feature
**Meta bug: {{Bug|1285858}} - Support manifest display: standalone display mode
<onlyinclude>
<onlyinclude>
<bugzilla>
<bugzilla>
{
{
"id": "1162150, 1300570, 1325021, 1347165, 1347585, 1347611, 1348686, 1351169, 1351554, 1351556, 1351739, 1351808, 1352004, 1352394, 1352991, 1353857, 1353868, 1234558, 1321320, 1336355, 1337341, 1346542, 1347154, 1347605, 1347616, 1348794, 1350236, 1351555, 1351834, 1352099, 1352378, 1352433, 1352726, 1353714 1352726"
    "blocks": "1285858",
    "include_fields": "id, priority, summary, status, resolution, assigned_to, depends_on",
    "order": "Status"
}
}
</bugzilla>
</bugzilla>
Line 101: Line 230:


== Criteria ==
== Criteria ==
* All [Test cases] have passed and all major bugs are fixed.  
* All [Test cases] have passed and all major bugs are fixed.
* All P1s are fixed.


== Results ==
== Results ==
1,411

edits