QA/Fenix/5/1.0/Beta.2/: Difference between revisions
< QA
Jump to navigation
Jump to search
Eliza.balazs (talk | contribs) No edit summary |
|||
| (13 intermediate revisions by 4 users not shown) | |||
| Line 32: | Line 32: | ||
| OnePlus A3 (Android 6.0.1) | | OnePlus A3 (Android 6.0.1) | ||
| May 28th, 2020 | | May 28th, 2020 | ||
| ''' | | '''Pass''' | ||
|- | |- | ||
| Andrei Bodea | | Andrei Bodea | ||
| Line 38: | Line 38: | ||
| Google Pixel 4XL (Android 10) | | Google Pixel 4XL (Android 10) | ||
| May 28th, 2020 | | May 28th, 2020 | ||
| ''' | | '''Pass''' | ||
|- | |- | ||
| Oana Horvath | | Oana Horvath | ||
| Line 44: | Line 44: | ||
| Nexus 6P (Android 8.1) | | Nexus 6P (Android 8.1) | ||
| May 28th, 2020 | | May 28th, 2020 | ||
| ''' | | '''Pass''' | ||
|- | |- | ||
| Mirabela Lobontiu | | Mirabela Lobontiu | ||
| Line 50: | Line 50: | ||
| Samsung Galaxy Tab A6 (Android 5.1.1) | | Samsung Galaxy Tab A6 (Android 5.1.1) | ||
| May 28th, 2020 | | May 28th, 2020 | ||
| ''' | | '''Pass''' | ||
|- | |- | ||
| Laurentiu Apahidean | | Laurentiu Apahidean | ||
| Line 56: | Line 56: | ||
| Huawei MediaPad M3 Lite 10 (Android 7.0) | | Huawei MediaPad M3 Lite 10 (Android 7.0) | ||
| May 28th, 2020 | | May 28th, 2020 | ||
| ''' | | '''Pass''' | ||
|- | |- | ||
| Eliza Balazs | | Eliza Balazs | ||
| Line 62: | Line 62: | ||
| Samsung Galaxy Tab S3 (Android 8) | | Samsung Galaxy Tab S3 (Android 8) | ||
| May 28th, 2020 | | May 28th, 2020 | ||
| ''' | | '''Pass''' | ||
|- | |- | ||
|} | |} | ||
| Line 83: | Line 83: | ||
| Everyone | | Everyone | ||
| May 28th, 2020 | | May 28th, 2020 | ||
| ''' | | '''Done''' | ||
|} | |} | ||
</onlyinclude> | </onlyinclude> | ||
Issues that need QA: | Issues that need QA: | ||
* [https://github.com/mozilla-mobile/fenix/issues/9948 9948] - [Bug]Disabling TP in Strict mode doesn't work properly on Beta 4.3.1 '''verified as fixed''' ✅ | |||
* [https://github.com/mozilla-mobile/fenix/issues/10796 10796] - [Bug]Reader mode not working on Beta 5.1.0-beta.1 - '''verified as fixed''' ✅ | * [https://github.com/mozilla-mobile/fenix/issues/10796 10796] - [Bug]Reader mode not working on Beta 5.1.0-beta.1 - '''verified as fixed''' ✅ | ||
* [https://github.com/mozilla-mobile/fenix/issues/10766 10766] - [Bug]Native code crash on Beta 5.1.0-beta.1 after quickly opening one by one the featured Top Sites - '''verified as fixed''' ✅ | * [https://github.com/mozilla-mobile/fenix/issues/10766 10766] - [Bug]Native code crash on Beta 5.1.0-beta.1 after quickly opening one by one the featured Top Sites - '''verified as fixed''' ✅ | ||
| Line 94: | Line 95: | ||
* [https://github.com/mozilla-mobile/fenix/issues/10770 10770] - [Bug]Native code crash on Beta 5.1.0-beta.1 after accepting the cookie policy on Theverge.com - '''verified as fixed''' ✅ | * [https://github.com/mozilla-mobile/fenix/issues/10770 10770] - [Bug]Native code crash on Beta 5.1.0-beta.1 after accepting the cookie policy on Theverge.com - '''verified as fixed''' ✅ | ||
* [https://bugzilla.mozilla.org/show_bug.cgi?id=1638773 1638773] - [Bug] Device-width conflict values in between initial-scale and width - '''verified as fixed''' ✅ | * [https://bugzilla.mozilla.org/show_bug.cgi?id=1638773 1638773] - [Bug] Device-width conflict values in between initial-scale and width - '''verified as fixed''' ✅ | ||
* [https://bugzilla.mozilla.org/show_bug.cgi?id=1630229 1630229] - Crash in [@ java.lang.AssertionError: at org.mozilla.gecko.process.GeckoProcessManager$ChildConnection.bind(GeckoProcessManager.java)] - '''verified as fixed''' ✅ | |||
=== L10N === | === L10N === | ||
| Line 109: | Line 111: | ||
== Issues == | == Issues == | ||
=== New issues === | === New issues === | ||
Major: | Major: | ||
* none | |||
Other: | Other: | ||
* [https://github.com/mozilla-mobile/fenix/issues/10951 10951] - [Bug] Private mode's homescreen is not translated in Spanish on Android 5&6 | * [https://github.com/mozilla-mobile/fenix/issues/10951 10951] - [Bug] Private mode's homescreen is not translated in Spanish on Android 5&6 | ||
* [https://github.com/mozilla-mobile/fenix/issues/10955 10955] - [Bug] A bookmark is not moved immediately to its new folder | |||
=== Known issues === | === Known issues === | ||
Major: | Major: | ||
- | * [https://github.com/mozilla-mobile/fenix/issues/10689 10689] - [Bug] Select Web apps show blank screen | ||
Other: | Other: | ||
* [https://github.com/mozilla-mobile/fenix/issues/3525 3525] - [Bug] Overwriting bookmark folders when syncing 2 devices | |||
* [https://github.com/mozilla-mobile/fenix/issues/8582 8582] - [Bug] Sending tabs to multiple devices is not working without a forced sync | |||
* [https://github.com/mozilla-mobile/fenix/issues/9037 9037] - [Bug] Custom tab styling doesn't respect the "Open links in a private tab" setting | |||
* [https://github.com/mozilla/application-services/issues/2161 2161] - SyncManager: report engines on/off status as soon as possible | * [https://github.com/mozilla/application-services/issues/2161 2161] - SyncManager: report engines on/off status as soon as possible | ||
* [https://github.com/mozilla-mobile/android-components/issues/6444 6444] - [Bug] Search by Image "Options" button should re-direct to Settings. | * [https://github.com/mozilla-mobile/android-components/issues/6444 6444] - [Bug] Search by Image "Options" button should re-direct to Settings. | ||
| Line 156: | Line 163: | ||
* [https://github.com/mozilla-mobile/fenix/issues/7996 7996] - [Bug] Private mode doesn't play nicely with sites added to home screen | * [https://github.com/mozilla-mobile/fenix/issues/7996 7996] - [Bug] Private mode doesn't play nicely with sites added to home screen | ||
* [https://github.com/mozilla-mobile/fenix/issues/4793 4793] - [Bug] soundscloud: Audio plays without media notification showing | * [https://github.com/mozilla-mobile/fenix/issues/4793 4793] - [Bug] soundscloud: Audio plays without media notification showing | ||
* [https://github.com/mozilla-mobile/fenix/issues/9917 9917] - [Bug]Automatic transition to the open tabs view if you Expand/Shrink or Delete tabs from a collection | |||
* [https://github.com/mozilla-mobile/fenix/issues/8726 8726] - [Bug]Collections-Empty collection can be created | |||
* [https://github.com/mozilla-mobile/fenix/issues/4721 4721] - [Bug] Flicker when deleting tabs by swipe from a collection | |||
* [https://github.com/mozilla-mobile/fenix/issues/2725 2725] - [Bug] Undo snackbar is not displayed when removing a tab from a collection | |||
* [https://github.com/mozilla-mobile/fenix/issues/8848 8848] - [Bug]Fenix doesn't properly suggest the collections numbering order | |||
* [https://github.com/mozilla-mobile/fenix/issues/2783 2783] - Add snackbar to collection deletion | |||
* [https://github.com/mozilla/fxa/issues/1657 1657] - [fxa-content-server] Canceled pairing from the mobile device should update automatically on the desktop side | |||
* [https://github.com/mozilla-mobile/fenix/issues/6521 6521] - [Bug] Auto-sign in doesn't work on Beta | |||
* [https://github.com/mozilla-mobile/fenix/issues/7723 7723] - [Bug] The account sync doesn't start automatically when the app is brought to the foreground | |||
* [https://github.com/mozilla-mobile/fenix/issues/9457 9457] - [Bug] Switch to tab-The option is not available for the last opened tab | |||
* [https://github.com/mozilla-mobile/fenix/issues/4147 4147] - [Bug]Vimeo Cookie policy banner can't be dismissed | |||
* [https://github.com/mozilla-mobile/fenix/issues/4375 4375] - [Bug]Mute/Unmute a video displays a white/grey rectangle over the volume bar | |||
* [https://github.com/mozilla-mobile/fenix/issues/7369 7369] - [Bug]Soundcloud doesn't play in the background anymore | |||
* [https://github.com/mozilla-mobile/fenix/issues/5133 5133] - [Bug] Phone goes to sleep while audio is playing | |||
* [https://github.com/mozilla-mobile/fenix/issues/6211 6211] - [Bug]Instagram notification issue | |||
* [https://github.com/mozilla-mobile/fenix/issues/8970 8970] - [Bug]Distorted and zoomed in transition from Instagram to the home screen | |||
* [https://github.com/mozilla-mobile/fenix/issues/10116 10116] - [Bug] The Login capture panel is incorrectly displayed when opening the keyboard | |||
* [https://github.com/mozilla-mobile/fenix/issues/10555 10555] - [Bug][PiP] The video cannot be seen as the URL and website elements are displayed when a new video starts | |||
* [https://github.com/mozilla-mobile/fenix/issues/9910 9910] - Display video in full-screen when returning from PiP mode | |||
* [https://github.com/mozilla-mobile/fenix/issues/5636 5636] - [Bug]Blocked media autoplay doesn't work properly | |||
Latest revision as of 12:53, 28 May 2020
« Fenix 5.1.0-beta.1 | Fenix RC 5.1.0-beta.2 | Fenix 5.1.0-beta.3 »
Firefox Preview 5.1.0-beta.2 Test Plan
- Release date: May 27th, 2020
- QA Contact: Oana Horvath; SV QA team
- Slack: Oana;
- Build: Firefox Preview 5.1.0-beta.2
- TestRail test plan: Testrail
Full functional & UI tests
| QA Task | Person/Group |
| Softvision | Alternating |
QA Assignment
| Assigned | Build type | Device | Completed | Results |
|---|---|---|---|---|
| Andrei Joltan | ARM | OnePlus A3 (Android 6.0.1) | May 28th, 2020 | Pass |
| Andrei Bodea | ARM | Google Pixel 4XL (Android 10) | May 28th, 2020 | Pass |
| Oana Horvath | x86 | Nexus 6P (Android 8.1) | May 28th, 2020 | Pass |
| Mirabela Lobontiu | ARM | Samsung Galaxy Tab A6 (Android 5.1.1) | May 28th, 2020 | Pass |
| Laurentiu Apahidean | ARM | Huawei MediaPad M3 Lite 10 (Android 7.0) | May 28th, 2020 | Pass |
| Eliza Balazs | ARM | Samsung Galaxy Tab S3 (Android 8) | May 28th, 2020 | Pass |
Results
Telemetry
Tablets
Phones
Bug verification
| Everyone | May 28th, 2020 | Done |
Issues that need QA:
- 9948 - [Bug]Disabling TP in Strict mode doesn't work properly on Beta 4.3.1 verified as fixed ✅
- 10796 - [Bug]Reader mode not working on Beta 5.1.0-beta.1 - verified as fixed ✅
- 10766 - [Bug]Native code crash on Beta 5.1.0-beta.1 after quickly opening one by one the featured Top Sites - verified as fixed ✅
- 10795 - [Bug]Native code crash after adding and opening a PWA - verified as fixed ✅
- 10794 - [Bug]Native code crash when trying to sign in on Twitter - verified as fixed ✅
- 10770 - [Bug]Native code crash on Beta 5.1.0-beta.1 after accepting the cookie policy on Theverge.com - verified as fixed ✅
- 1638773 - [Bug] Device-width conflict values in between initial-scale and width - verified as fixed ✅
- 1630229 - Crash in [@ java.lang.AssertionError: at org.mozilla.gecko.process.GeckoProcessManager$ChildConnection.bind(GeckoProcessManager.java)] - verified as fixed ✅
L10N
Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.
| Lobontiu Mirabela | May 27th, 2020 | Done |
Issues
New issues
Major:
- none
Other:
- 10951 - [Bug] Private mode's homescreen is not translated in Spanish on Android 5&6
- 10955 - [Bug] A bookmark is not moved immediately to its new folder
Known issues
Major:
- 10689 - [Bug] Select Web apps show blank screen
Other:
- 3525 - [Bug] Overwriting bookmark folders when syncing 2 devices
- 8582 - [Bug] Sending tabs to multiple devices is not working without a forced sync
- 9037 - [Bug] Custom tab styling doesn't respect the "Open links in a private tab" setting
- 2161 - SyncManager: report engines on/off status as soon as possible
- 6444 - [Bug] Search by Image "Options" button should re-direct to Settings.
- 6424 - [Bug] Add-on settings opened in a new tab everytime
- 10057 - [Bug] Weird graphic glitches when using Dark Reader extension
- 10290 - [Bug] Add-on 'Run in private browsing' option resets when app is restarted
- 8729 - [Bug] Add-ons - Both main and detailed descriptions don't follow the selected language
- 10475 - [Bug] Delay in hiding the "Run in private browsing" for the HTTS Everywhere Add-on
- 9354 - [Bug]Failed download after resuming an .apk download
- 8108 - [Bug] The same site can be added multiple times to home screen
- 7953 - [Bug] Error 0/0 displayed when double tapping on Find in page toolbar
- 10291 - [Bug] Dynamic nav-bar isn't working when toolbar is set to the bottom
- 10737 - [Bug] Searching a language/saved password displays a misplaced "x"
- 10764 - [Bug] When "Protect Yourself" toggle is deactivated the background color is white, maybe the boarder should be as for radio buttons
- 10283 - [Bug]Flicker while navigating through the Desktop Bookmark folders
- 3900 - Bug] After sharing a page from Fenix to Firefox Nightly the popup menu remains in the recent apps menu
- 9619 - [Bug][regression] Overflow menu is hidden just for the selected history item
- 8567 - [Bug]Can't create new bookmarks folder due to #6974
- 6975 - [Bug]Bookmarks folder can't be renamed (following #6974)
- 6974 - [Bug]Current Bookmark folder shouldn't be displayed as a root folder option while editing
- 6977 - [Bug]Deleted Bookmarks folder reappears after deleting it
- 5010 - [Bug]Add undo option when deleting a bookmark from edit mode
- 5298 - [Bug] The same page appears in the History section multiple times
- 4484 - [Bug]Flicker when deleting History items
- 8571 - [Bug]History isn't sorted chronologically
- 6079 - [Bug]Open tabs section flickers when opening multiple history items in new tabs
- 4178 - [Bug] Sharing multiple tabs to another browser, only opens 1 tab
- 3869 - [Bug] Fenix not setting default search engine properly
- 7491 - [Bug] adding startpage.com as a search engine does not show startpage favicon
- 9425 - [Bug]Undoing a deleted search engine makes "Edit" option unavailable
- 9143 - [Bug] Added search engine no longer displayed if it was previously undo and the browser was restarted
- 10079 - [Bug]Improperly displayed and moving overlays after opening Fenix from the widget
- 9323 - [Bug]The microphone icon for widget is not displayed on 2x1 size
- 9453 - [Bug]Flicker displayed when deleting the URL
- 8716 - [Bug] Private custom tab opened when signing in to sync records history
- 9100 - [Bug] Clearing private tabs from notification closes the app
- 7996 - [Bug] Private mode doesn't play nicely with sites added to home screen
- 4793 - [Bug] soundscloud: Audio plays without media notification showing
- 9917 - [Bug]Automatic transition to the open tabs view if you Expand/Shrink or Delete tabs from a collection
- 8726 - [Bug]Collections-Empty collection can be created
- 4721 - [Bug] Flicker when deleting tabs by swipe from a collection
- 2725 - [Bug] Undo snackbar is not displayed when removing a tab from a collection
- 8848 - [Bug]Fenix doesn't properly suggest the collections numbering order
- 2783 - Add snackbar to collection deletion
- 1657 - [fxa-content-server] Canceled pairing from the mobile device should update automatically on the desktop side
- 6521 - [Bug] Auto-sign in doesn't work on Beta
- 7723 - [Bug] The account sync doesn't start automatically when the app is brought to the foreground
- 9457 - [Bug] Switch to tab-The option is not available for the last opened tab
- 4147 - [Bug]Vimeo Cookie policy banner can't be dismissed
- 4375 - [Bug]Mute/Unmute a video displays a white/grey rectangle over the volume bar
- 7369 - [Bug]Soundcloud doesn't play in the background anymore
- 5133 - [Bug] Phone goes to sleep while audio is playing
- 6211 - [Bug]Instagram notification issue
- 8970 - [Bug]Distorted and zoomed in transition from Instagram to the home screen
- 10116 - [Bug] The Login capture panel is incorrectly displayed when opening the keyboard
- 10555 - [Bug][PiP] The video cannot be seen as the URL and website elements are displayed when a new video starts
- 9910 - Display video in full-screen when returning from PiP mode
- 5636 - [Bug]Blocked media autoplay doesn't work properly