QA/Fenix/5/2.0/Beta.2: Difference between revisions
< QA
Jump to navigation
Jump to search
No edit summary |
|||
| (26 intermediate revisions by 7 users not shown) | |||
| Line 1: | Line 1: | ||
<small>« [[QA/Fenix/5/2.0/Beta.1/ | Fenix 5.2.0-beta.1]] | [[QA/Fenix/5/2.0/Beta.2 | Fenix 5.2.0-beta.2]] | [[QA/Fenix/ | <small>« [[QA/Fenix/5/2.0/Beta.1/ | Fenix 5.2.0-beta.1]] | [[QA/Fenix/5/2.0/Beta.2 | Fenix 5.2.0-beta.2]] | [[QA/Fenix/6.0/Beta.1 | Fenix 6.0-beta.1]] »</small> | ||
= Firefox Preview 5.2.0-beta.2 Test Plan = | = Firefox Preview 5.2.0-beta.2 Test Plan = | ||
| Line 31: | Line 31: | ||
| OnePlus A3 (Android 6.0.1) | | OnePlus A3 (Android 6.0.1) | ||
| June 17th, 2020 | | June 17th, 2020 | ||
| ''' | | '''Pass''' | ||
|- | |- | ||
| Andrei Bodea | | Andrei Bodea | ||
| Line 37: | Line 37: | ||
| Google Pixel 4XL (Android 10) | | Google Pixel 4XL (Android 10) | ||
| June 17th, 2020 | | June 17th, 2020 | ||
| ''' | | '''Pass''' | ||
|- | |- | ||
| Sorina Florean | | Sorina Florean | ||
| Line 43: | Line 43: | ||
| Xiaomi Mi Pad 2 (Android 5.1) | | Xiaomi Mi Pad 2 (Android 5.1) | ||
| June 17th, 2020 | | June 17th, 2020 | ||
| ''' | | '''Pass''' | ||
|- | |- | ||
| Mirabela Lobontiu | | Mirabela Lobontiu | ||
| Line 49: | Line 49: | ||
| Samsung Galaxy Tab S6 (Android 9) | | Samsung Galaxy Tab S6 (Android 9) | ||
| June 17th, 2020 | | June 17th, 2020 | ||
| ''' | | '''Pass''' | ||
|- | |- | ||
| Oana Horvath | | Oana Horvath | ||
| Line 55: | Line 55: | ||
| Nexus 9 (Android 7.1.1) | | Nexus 9 (Android 7.1.1) | ||
| June 17th, 2020 | | June 17th, 2020 | ||
| ''' | | '''Pass''' | ||
|- | |- | ||
| Diana Rus | | Diana Rus | ||
| Line 61: | Line 61: | ||
| Samsung Galaxy S9 (Android 8) | | Samsung Galaxy S9 (Android 8) | ||
| June 17th, 2020 | | June 17th, 2020 | ||
| ''' | | '''Pass''' | ||
|- | |- | ||
| Laurentiu Apahidean | | Laurentiu Apahidean | ||
| Line 67: | Line 67: | ||
| OnePlus 6T (Android 9) | | OnePlus 6T (Android 9) | ||
| June 17th, 2020 | | June 17th, 2020 | ||
| ''' | | '''Pass''' | ||
|- | |- | ||
|} | |} | ||
| Line 77: | Line 77: | ||
* https://testrail.stage.mozaws.net/index.php?/runs/view/30598 | * https://testrail.stage.mozaws.net/index.php?/runs/view/30598 | ||
=== | === Smoke tests === | ||
* | * https://testrail.stage.mozaws.net/index.php?/plans/view/30936 | ||
=== Bug verification === | === Bug verification === | ||
| Line 88: | Line 85: | ||
| Everyone | | Everyone | ||
| June 17th, 2020 | | June 17th, 2020 | ||
| ''' | | '''Done''' | ||
|} | |} | ||
</onlyinclude> | </onlyinclude> | ||
Issues that need QA: | Issues that need QA: | ||
* https://github.com/mozilla-mobile/fenix/issues/10896 | * https://github.com/mozilla-mobile/fenix/issues/10896 - '''✅ Verified as fixed on both Nightly and Beta ''' | ||
* https://github.com/mozilla-mobile/fenix/issues/11335 | * https://github.com/mozilla-mobile/fenix/issues/11335 - '''✅ Verified as fixed on both Nightly and Beta ''' | ||
* https://github.com/mozilla-mobile/fenix/issues/9640 | * https://github.com/mozilla-mobile/fenix/issues/9640 - '''✅ Verified as fixed on both Nightly and Beta ''' | ||
* https://github.com/mozilla-mobile/fenix/issues/11428 | * https://github.com/mozilla-mobile/fenix/issues/11428 - '''✅ Verified as fixed on both Nightly and Beta ''' | ||
* https://github.com/mozilla-mobile/fenix/issues/11360 - '''✅ Verified as fixed on both Nightly and Beta ''' | |||
* https://github.com/mozilla-mobile/fenix/issues/11420 - '''✅ Verified as fixed on both Nightly and Beta ''' | |||
== Issues == | == Issues == | ||
=== New issues === | === New issues === | ||
Major: | Major: | ||
* | * none | ||
Other: | Other: | ||
* [https://github.com/mozilla-mobile/fenix/issues/11727 11727] - [Bug]Tabs Tray: Tabs counter "∞" symbol padding issue | |||
* [https://github.com/mozilla-mobile/fenix/issues/11675 11675] - [Bug] Clear a URL from the nav bar and then press back, goes to the homescreen | |||
* [https://github.com/mozilla-mobile/fenix/issues/11676 11676] - [Bug] General blocked site permissions are shown on websites that don't need them | |||
* [https://github.com/mozilla-mobile/fenix/issues/11672 11672] - [Bug]Tabs tray: Tapping the New Tab FAB displays ":)" instead of the tabs number | * [https://github.com/mozilla-mobile/fenix/issues/11672 11672] - [Bug]Tabs tray: Tapping the New Tab FAB displays ":)" instead of the tabs number | ||
* [https://github.com/mozilla-mobile/fenix/issues/11683 11683] - [Bug]Tabs Tray: Improperly page link while in reader mode after Delete + Undo | * [https://github.com/mozilla-mobile/fenix/issues/11683 11683] - [Bug]Tabs Tray: Improperly page link while in reader mode after Delete + Undo | ||
* [https://github.com/mozilla-mobile/fenix/issues/11690 11690] - [Bug]Collections flicker after tapping the New Tab FAB | * [https://github.com/mozilla-mobile/fenix/issues/11690 11690] - [Bug]Collections flicker after tapping the New Tab FAB | ||
* [https://github.com/mozilla-mobile/fenix/issues/11688 11688] - [Bug] App crashes when cancelling the "Downloading and verifying add-on..." | * [https://github.com/mozilla-mobile/fenix/issues/11688 11688] - [Bug] App crashes when cancelling the "Downloading and verifying add-on..." | ||
* [https://github.com/mozilla-mobile/fenix/issues/11679 11679] - [Bug] Add-ons menu not reversed when toolbar is set to top | |||
* [https://github.com/mozilla-mobile/fenix/issues/11696 11696] - [Bug] Crash when enabling reader mode while the page is being scrolled | |||
* [https://github.com/mozilla-mobile/fenix/issues/11699 11699] - [Bug] Can't access shortcut sites from device's home screen when saved in reader mode | |||
* [https://github.com/mozilla-mobile/fenix/issues/11732 11732] - [Bug] In private mode when interchanging languages white layout is present | |||
* [https://github.com/mozilla-mobile/fenix/issues/11731 11731] - [Bug] [L10n]The translation in other languages for Collection's description is not present | |||
* [https://github.com/mozilla-mobile/fenix/issues/11729 11729] - [Bug] [L10n]Add-on submenu is not translated | |||
=== Known issues === | === Known issues === | ||
* [https://github.com/mozilla-mobile/fenix/issues/10843 10843] - [Bug] Dynamic navigation toolbar is not working for all sites | |||
* | * [https://github.com/mozilla-mobile/fenix/issues/11501 11501] - [Bug] Sometimes the pages cannot be loaded/reloaded no matter how many times I click the reload button | ||
* [https://github.com/mozilla-mobile/fenix/issues/11573 11573] - [Bug] tabs tray: Fenix loses thumbnail of GitHub | |||
* [https://github.com/mozilla-mobile/fenix/issues/10764 10764] - [Bug] When "Protect Yourself" toggle is deactivated the background color is white, maybe the boarder should be as for radio buttons | * [https://github.com/mozilla-mobile/fenix/issues/10764 10764] - [Bug] When "Protect Yourself" toggle is deactivated the background color is white, maybe the boarder should be as for radio buttons | ||
* [https://github.com/mozilla-mobile/fenix/issues/9453 9453] - [Bug]Flicker displayed when deleting the URL | * [https://github.com/mozilla-mobile/fenix/issues/9453 9453] - [Bug]Flicker displayed when deleting the URL | ||
| Line 150: | Line 157: | ||
* [https://github.com/mozilla-mobile/fenix/issues/8726 8726] - [Bug]Collections-Empty collection can be created | * [https://github.com/mozilla-mobile/fenix/issues/8726 8726] - [Bug]Collections-Empty collection can be created | ||
* [https://github.com/mozilla-mobile/fenix/issues/2783 2783] - Add snackbar to collection deletion | * [https://github.com/mozilla-mobile/fenix/issues/2783 2783] - Add snackbar to collection deletion | ||
* [https://github.com/mozilla-mobile/fenix/issues/4178 4178] - [Bug] Sharing multiple tabs to another browser, only opens 1 tab | |||
* [https://github.com/mozilla-mobile/fenix/issues/11042 11042] - [Bug] Tabs tray can be dismissed way too easily when dragging it | |||
* [https://github.com/mozilla-mobile/fenix/issues/10986 10986] - [Bug] [Tabs Tray] Undo close tab puts tab at the bottom of the list, rather than in-place | |||
* [https://github.com/mozilla-mobile/fenix/issues/11465 11465] - [Bug] Searching through voice assistant from the search widget is done through a different search engine than the one set as default | |||
* [https://github.com/mozilla-mobile/fenix/issues/11111 11111] - [Bug] Tabs Tray New Tab + Button Back Navigation Feels Off | |||
* [https://github.com/mozilla-mobile/fenix/issues/11180 11180] - [Bug]Tab Tray: Spot displayed on the "New tab" button | |||
* [https://github.com/mozilla-mobile/fenix/issues/8215 8215] - [Bug] Make crash content page match new error style | |||
* [https://github.com/mozilla-mobile/fenix/issues/11515 11515] - [Bug] Open new tab via contextual menu after close - undo action deletes the re-opened tab | |||
* [https://github.com/mozilla-mobile/fenix/issues/11468 11468] - [Bug] When you open links from bookmarks/history, show the tabs tray | |||
* [https://github.com/mozilla-mobile/fenix/issues/10365 10365] - [UX] [Bug] Open in New Tab should insert tab below current tab rather than above | |||
* [https://github.com/mozilla-mobile/fenix/issues/10874 10874] - [Bug] Tab tray "default" icon looks like a placeholder | |||
* [https://github.com/mozilla-mobile/fenix/issues/11625 11625] - [Bug] Tabs tray stays open when clicking links from other apps | |||
* [https://github.com/mozilla-mobile/fenix/issues/11562 11562] - [Bug] alignment issue in tabs tray | |||
* [https://github.com/mozilla-mobile/fenix/issues/11406 11406] - [Bug] Scroll position of tabs tray is lost when switching between normal & private tabs | |||
* [https://github.com/mozilla-mobile/fenix/issues/11560 11560] - [Bug] tabs in tabs tray flicker when switching between regular and private tabs | |||
* [https://github.com/mozilla-mobile/fenix/issues/11431 11431] - [Bug] Undo close tab in tabs tray unexpectedly restores tab to top, offscreen | |||
* [https://github.com/mozilla-mobile/fenix/issues/11024 11024] - [Bug]Tab Tray - Closing all open tabs in Private Browsing shouldn't re-direct the user to normal browsing | |||
* [https://github.com/mozilla-mobile/fenix/issues/11044 11044] - [Bug] Odd animation on plus sign icon in tab tray when closing tabs | |||
* [https://github.com/mozilla-mobile/fenix/issues/10740 10740] - [Bug]Tab Tray: Open Tabs media controls aren't displayed | |||
* [https://github.com/mozilla-mobile/fenix/issues/11261 11261] - [Bug]Tabs Tray: Improperly displayed ⋮ overlay after rotation | |||
* [https://github.com/mozilla-mobile/fenix/issues/8716 8716] - [Bug] Private custom tab opened when signing in to sync records history | |||
* [https://github.com/mozilla-mobile/fenix/issues/10087 10087] - [Bug] [x86 device] Allowing screenshot in private browsing only after reopening the browser | |||
* [https://github.com/mozilla-mobile/fenix/issues/11421 11421] - [Bug] Tabs Tray: Missing thumbnail content after adding a page to homescreen | |||
* [https://github.com/mozilla-mobile/fenix/issues/9662 9662] - [Bug] The account name is bold in the settings section | |||
* [https://github.com/mozilla-mobile/fenix/issues/6713 6713] - [Bug] History/Bookmarks sometimes do not sync | |||
* [https://github.com/mozilla-mobile/fenix/issues/10555 10555] - [Bug][PiP] The video cannot be seen as the URL and website elements are displayed when a new video starts | |||
* [https://github.com/mozilla-mobile/fenix/issues/8853 8853] - [Bug] "All third-party and all cookies" options from ETP(cookies) menu are not fully displayed in other languages than English | |||
Latest revision as of 08:45, 29 June 2020
« Fenix 5.2.0-beta.1 | Fenix 5.2.0-beta.2 | Fenix 6.0-beta.1 »
Firefox Preview 5.2.0-beta.2 Test Plan
- Release date: June 17th, 2020
- QA Contact: Oana Horvath; SV QA team
- Slack: Oana;
- Build: Firefox Preview 5.2.0-beta.2
- TestRail test plan: Testrail
Full functional & UI tests
| QA Task | Person/Group |
| Softvision | Alternating |
QA Assignment
| Assigned | Build type | Device | Completed | Results |
|---|---|---|---|---|
| Andrei Joltan | ARM | OnePlus A3 (Android 6.0.1) | June 17th, 2020 | Pass |
| Andrei Bodea | ARM | Google Pixel 4XL (Android 10) | June 17th, 2020 | Pass |
| Sorina Florean | x86 | Xiaomi Mi Pad 2 (Android 5.1) | June 17th, 2020 | Pass |
| Mirabela Lobontiu | ARM | Samsung Galaxy Tab S6 (Android 9) | June 17th, 2020 | Pass |
| Oana Horvath | ARM | Nexus 9 (Android 7.1.1) | June 17th, 2020 | Pass |
| Diana Rus | ARM | Samsung Galaxy S9 (Android 8) | June 17th, 2020 | Pass |
| Laurentiu Apahidean | ARM | OnePlus 6T (Android 9) | June 17th, 2020 | Pass |
Results
Telemetry
Smoke tests
Bug verification
| Everyone | June 17th, 2020 | Done |
Issues that need QA:
- https://github.com/mozilla-mobile/fenix/issues/10896 - ✅ Verified as fixed on both Nightly and Beta
- https://github.com/mozilla-mobile/fenix/issues/11335 - ✅ Verified as fixed on both Nightly and Beta
- https://github.com/mozilla-mobile/fenix/issues/9640 - ✅ Verified as fixed on both Nightly and Beta
- https://github.com/mozilla-mobile/fenix/issues/11428 - ✅ Verified as fixed on both Nightly and Beta
- https://github.com/mozilla-mobile/fenix/issues/11360 - ✅ Verified as fixed on both Nightly and Beta
- https://github.com/mozilla-mobile/fenix/issues/11420 - ✅ Verified as fixed on both Nightly and Beta
Issues
New issues
Major:
- none
Other:
- 11727 - [Bug]Tabs Tray: Tabs counter "∞" symbol padding issue
- 11675 - [Bug] Clear a URL from the nav bar and then press back, goes to the homescreen
- 11676 - [Bug] General blocked site permissions are shown on websites that don't need them
- 11672 - [Bug]Tabs tray: Tapping the New Tab FAB displays ":)" instead of the tabs number
- 11683 - [Bug]Tabs Tray: Improperly page link while in reader mode after Delete + Undo
- 11690 - [Bug]Collections flicker after tapping the New Tab FAB
- 11688 - [Bug] App crashes when cancelling the "Downloading and verifying add-on..."
- 11679 - [Bug] Add-ons menu not reversed when toolbar is set to top
- 11696 - [Bug] Crash when enabling reader mode while the page is being scrolled
- 11699 - [Bug] Can't access shortcut sites from device's home screen when saved in reader mode
- 11732 - [Bug] In private mode when interchanging languages white layout is present
- 11731 - [Bug] [L10n]The translation in other languages for Collection's description is not present
- 11729 - [Bug] [L10n]Add-on submenu is not translated
Known issues
- 10843 - [Bug] Dynamic navigation toolbar is not working for all sites
- 11501 - [Bug] Sometimes the pages cannot be loaded/reloaded no matter how many times I click the reload button
- 11573 - [Bug] tabs tray: Fenix loses thumbnail of GitHub
- 10764 - [Bug] When "Protect Yourself" toggle is deactivated the background color is white, maybe the boarder should be as for radio buttons
- 9453 - [Bug]Flicker displayed when deleting the URL
- 11471 - [Bug] Discrepancy in behavior between top and bottom toolbar on feedbin.com
- 10200 - [Bug] Dynamic toolbar not displayed while the page is loading
- 7953 - [Bug] Error 0/0 displayed when double tapping on Find in page toolbar
- 9713 - [Bug] Find in page finds something even after erasing query
- 11474 - [Bug] Weird transition is displayed in settings when opening certain menus
- 11153 - [Private Browsing] Opened apps view should always hide contents of private screen
- 9196 - [Bug]uBlock install/uninstall confirmation snackbar covers the nav bar
- 11589 - [Bug] Force closing Fenix after disabling an Add-on uninstalls it
- 8850 - [Bug]Improperly displayed "Shortcuts" magnifying glass icon while using Light theme
- 9354 - [Bug]Failed download after resuming an .apk download
- 6977 - [Bug]Deleted Bookmarks folder reappears after deleting it
- 7866 - [Bug] Custom search engines do not provide search suggestions
- 7491 - [Bug] adding startpage.com as a search engine does not show startpage favicon
- 9425 - [Bug]Undoing a deleted search engine makes "Edit" option unavailable
- 9143 - [Bug] Added search engine no longer displayed if it was previously undo and the browser was restarted
- 9323 - [Bug]The microphone icon for widget is not displayed on 2x1 size
- 4147 - [Bug]Vimeo Cookie policy banner can't be dismissed
- 4375 - [Bug]Mute/Unmute a video displays a white/grey rectangle over the volume bar
- 7369 - [Bug]Soundcloud doesn't play in the background anymore
- 5133 - [Bug] Phone goes to sleep while audio is playing
- 11422 - [Bug] Tabs Tray remains open when access through widget
- 9916 - [Bug] PWA - The pwa icon's are displayed as white on device homescreen
- 10560 - [Bug] [PWA] "Add to Home screen" confirmation dialog isn't displayed on certain devices
- 10319 - [Bug] Tapping a media notification from a PWA should open the PWA
- 11547 - [Bug] Twitter PWA/custom tabs have white empty space on the top and it carries that to the whatever website that has been opened from it
- 8761 - [Bug] Open in Fenix from a PWA custom tab, replaces the PWA with Fenix
- 4000 - [Bug] QR code scan issues on OnePlus A3
- 9460 - [Bug] "Firefox Nightly Search" not working in custom tabs
- 9463 - [Bug]Back and Forward buttons not updated in custom tabs
- 8388 - [Bug]Improperly displayed ⋮ Main menu (3dot menu) overlay in landscape mode
- 8964 - [Bug] Floating custom tabs ⋮ Main menu (3dot menu) overlay after rotation
- 7996 - [Bug] Private mode doesn't play nicely with sites added to home screen
- 9100 - [Bug] Clearing private tabs from notification closes the app
- 8726 - [Bug]Collections-Empty collection can be created
- 2783 - Add snackbar to collection deletion
- 4178 - [Bug] Sharing multiple tabs to another browser, only opens 1 tab
- 11042 - [Bug] Tabs tray can be dismissed way too easily when dragging it
- 10986 - [Bug] [Tabs Tray] Undo close tab puts tab at the bottom of the list, rather than in-place
- 11465 - [Bug] Searching through voice assistant from the search widget is done through a different search engine than the one set as default
- 11111 - [Bug] Tabs Tray New Tab + Button Back Navigation Feels Off
- 11180 - [Bug]Tab Tray: Spot displayed on the "New tab" button
- 8215 - [Bug] Make crash content page match new error style
- 11515 - [Bug] Open new tab via contextual menu after close - undo action deletes the re-opened tab
- 11468 - [Bug] When you open links from bookmarks/history, show the tabs tray
- 10365 - [UX] [Bug] Open in New Tab should insert tab below current tab rather than above
- 10874 - [Bug] Tab tray "default" icon looks like a placeholder
- 11625 - [Bug] Tabs tray stays open when clicking links from other apps
- 11562 - [Bug] alignment issue in tabs tray
- 11406 - [Bug] Scroll position of tabs tray is lost when switching between normal & private tabs
- 11560 - [Bug] tabs in tabs tray flicker when switching between regular and private tabs
- 11431 - [Bug] Undo close tab in tabs tray unexpectedly restores tab to top, offscreen
- 11024 - [Bug]Tab Tray - Closing all open tabs in Private Browsing shouldn't re-direct the user to normal browsing
- 11044 - [Bug] Odd animation on plus sign icon in tab tray when closing tabs
- 10740 - [Bug]Tab Tray: Open Tabs media controls aren't displayed
- 11261 - [Bug]Tabs Tray: Improperly displayed ⋮ overlay after rotation
- 8716 - [Bug] Private custom tab opened when signing in to sync records history
- 10087 - [Bug] [x86 device] Allowing screenshot in private browsing only after reopening the browser
- 11421 - [Bug] Tabs Tray: Missing thumbnail content after adding a page to homescreen
- 9662 - [Bug] The account name is bold in the settings section
- 6713 - [Bug] History/Bookmarks sometimes do not sync
- 10555 - [Bug][PiP] The video cannot be seen as the URL and website elements are displayed when a new video starts
- 8853 - [Bug] "All third-party and all cookies" options from ETP(cookies) menu are not fully displayed in other languages than English