«  Fenix RC 4.3.0-beta.1 | Fenix RC 5.1.0-beta.1 | Fenix RC 5.1.0-beta.2 »

Firefox Preview 5.1.0-beta.1 Test Plan

• Release date: May 19th, 2020
• QA Contact: Oana Horvath; SV QA team
• Slack: Oana;
• Build: Firefox Preview 5.1.0-beta.1
• TestRail test plan: https://testrail.stage.mozaws.net/index.php?/plans/view/29771

Features

Full functional & UI tests

Full functional and UI tests - Test Plan

QA Assignment

Results

Telemetry

• https://testrail.stage.mozaws.net/index.php?/runs/view/29772

Phones

• https://testrail.stage.mozaws.net/index.php?/runs/view/29775

Tablets

• https://testrail.stage.mozaws.net/index.php?/runs/view/29774

Bug verification

List of issues that needed QA:

• 10393 - [Bug] Collections not listed when adding from directly opened tab - verified as fixed ✅
• 9505 - Sort logins - Reopened ❌
• 10343 - Remove "Library" and move items - verified as fixed ✅
• 7854 - [Bug] Bookmark's edited name is not saved after selecting in which folder to save - verified as fixed ✅

L10N

Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.

• https://testrail.stage.mozaws.net/index.php?/runs/view/29773

Issues

New issues

Major:

• 10794 - [Bug]Native code crash when trying to sign in on Twitter
• 10795 - [Bug]Native code crash after adding and opening a PWA
• 10796 - [Bug]Reader mode not working on Beta 5.1.0-beta.1
• 10766 - [Bug]Native code crash on Beta 5.1.0-beta.1 after quickly opening one by one the featured Top Sites
• 10770 - [Bug]Native code crash on Beta 5.1.0-beta.1 after accepting the cookie policy on Theverge.com
• 10797 - [Crash] Crash in java.lang.RuntimeException: at android.app.ActivityThread.handleServiceArgs(ActivityThread.java)
• 10801 - [Crash] [@ java.lang.RuntimeException: at android.app.ActivityThread.handleStopService(ActivityThread.java) ]

Other:

• 10765 - [Bug] YouTube is not working properly on Beta 5.1.0-beta 1 on Samsung devices
• 10764 - [Bug] When "Protect Yourself" toggle is deactivated the background color is white, maybe the boarder should be as for radio buttons
• 10777 - [Bug]Saved logins view scrolling issue after sorting
• 10779 - [L10n]Menus and submenus are not translated in Arabic

Known issues

Major:

• 10727 - [Bug] The details for one saved login are displayed after interrupting and then resuming Fenix
• 1630229 - Crash in [@ java.lang.AssertionError: at org.mozilla.gecko.process.GeckoProcessManager$ChildConnection.bind(GeckoProcessManager.java)]

Other:

• 8716 - [Bug] Private custom tab opened when signing in to sync records history
• 5010 - [Bug]Add undo option when deleting a bookmark from edit mode
• 9453 - [Bug]Flicker displayed when deleting the URL
• 7953 - [Bug] Error 0/0 displayed when double tapping on Find in page toolbar
• 9713 - [Bug] Find in page finds something even after erasing query
• 9354 - [Bug]Failed download after resuming an .apk download
• 10283 - [Bug]Flicker while navigating through the Desktop Bookmark folders
• 3900 - Bug] After sharing a page from Fenix to Firefox Nightly the popup menu remains in the recent apps menu
• 9619 - [Bug][regression] Overflow menu is hidden just for the selected history item
• 8567 - [Bug]Can't create new bookmarks folder due to #6974
• 6975 - [Bug]Bookmarks folder can't be renamed (following #6974)
• 6974 - [Bug]Current Bookmark folder shouldn't be displayed as a root folder option while editing
• 6977 - [Bug]Deleted Bookmarks folder reappears after deleting it
• 6422 - [Bug] Dark Reader “Donate” does not redirect to donation page
• 6419 - [Bug] Dark Reader “Help” (Read the manual) does not redirect to manual page
• 6444 - [Bug] Search by Image "Options" button should re-direct to Settings.
• 6424 - [Bug] Add-on settings opened in a new tab everytime
• 10057 - [Bug] Weird graphic glitches when using Dark Reader extension
• 10290 - [Bug] Add-on 'Run in private browsing' option resets when app is restarted
• 8578 - [Bug] Different size icons for "Not supported yet" addons
• 6855 - Fennec migration: List of unavailable add-ons is not refreshed
• 8729 - [Bug] Add-ons - Both main and detailed descriptions don't follow the selected language
• 4793 - [Bug] soundscloud: Audio plays without media notification showing
• 10116 - [Bug] The Login capture panel is incorrectly displayed when opening the keyboard
• 10087 - [Bug][x86 device] Allowing screenshot in private browsing only after reopening the browser
• 9396 - [Bug]"Search logins" field displayed only half on tablets or in landscape mode for phones
• 10200 - [Bug] Dynamic toolbar not displayed while the page is loading
• 10116 - [Bug] The Login capture panel is incorrectly displayed when opening the keyboard
• 9505 - Sort logins
• 9916 - [Bug] PWA - The pwa icon's are displayed as white on device homescreen
• 10560 - [Bug] [PWA] "Add to Home screen" confirmation dialog isn't displayed on certain devices
• 10483 - [Bug]Can't install certain websites as PWAs
• 10315 - [Bug] The toolbar appears on PWAs if backgrounded
• 8761 - [Bug] Open in Fenix from a PWA custom tab, replaces the PWA with Fenix
• 10319 - [Bug] Tapping a media notification from a PWA should open the PWA
• 9056 - [Bug] Firefox Preview Search in custom tab doesn't open the tab immediately
• 9662 - [Bug] The account name is bold in the settings section
• 10725 - [Bug] Long usernames are truncated in account details
• 9948 - [Bug]Disabling TP in Strict mode doesn't work properly on Beta 4.3.1
• 10521 - [Bug] Confusing behavior in site permissions exceptions
• 8718 - [Bug]Wikipedia Top Sites icon is missing for a second on fresh install
• 10737 - [Bug] Searching a language displays a misplaced "x"
• 8582 - [Bug] Sending tabs to multiple devices is not working without a forced sync
• 5478 - [Bug] Tabs turn into about:blank pages
• 10001 - [Bug] WebPush messages are not properly delivered
• 4178 - [Bug] Sharing multiple tabs to another browser, only opens 1 tab
• 8108 - [Bug] The same site can be added multiple times to home screen
• 3108 - Add new safe browsing policies for Malware in iframe and Billing warning