«  Fenix RC 4.0.0-beta.1 | Fenix RC 4.0.0-beta.2 | Fenix RC 4.0.0-beta.3 »

Firefox Preview 4.0.0-beta.2 Test Plan

• Release date: February 28th, 2020
• QA Contact: Oana Horvath; SV QA team
• Slack: Oana;
• Build: Firefox Preview 4.0.0-beta.2
• TestRail test plan: Testrail

Features

Full functional Testing

Full Functional Tests are a more comprehensive set of manually covered tests that cover functional testing of features that have landed.

QA Assignment

Results

Telemetry

• https://testrail.stage.mozaws.net/index.php?/runs/view/26229

Phone

• https://testrail.stage.mozaws.net/index.php?/runs/view/26227

Tablet

• https://testrail.stage.mozaws.net/index.php?/runs/view/26226

Bug verification

List of issues that needed QA:

• https://github.com/mozilla-mobile/fenix/issues/8505 - Verified
• https://github.com/mozilla-mobile/fenix/issues/8540 - Verified
• https://github.com/mozilla-mobile/fenix/issues/8792 - Verified
• https://github.com/mozilla-mobile/fenix/issues/8627 - Verified
• https://github.com/mozilla-mobile/fenix/issues/8699 - Verified
• https://github.com/mozilla-mobile/fenix/issues/8411 - No STR

L10N

Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.

• https://testrail.stage.mozaws.net/index.php?/runs/view/26228

Issues

New isues

Major:

• 8854 - [Bug]Crash when attempting to perform a search on Vimeo or when accessing a video lin

Other:

• 8809 - [Bug] Notification permissions can't be disabled/re-enabled unless you restart the browser
• 8857 - [Bug] Video full screen issues when rotating the device from portrait to landscape
• 8853 - [Bug] "All third-party and all cookies" options from ETP(cookies) menu are not fully displayed in other languages than English
• 8849 - [Bug][L10N] The "Cookies" word is not translated in Traditional and Simplified Chinese
• 8816 - [Bug]Improperly displayed "Username" text box on the Logins prompt while using Dark theme and in Private Browsing
• 8850 - [Bug]Improperly displayed "Shortcuts" magnifying glass icon while using Light theme
• 8848 - [Bug]Fenix doesn't properly suggest the collections numbering order
• 8846 - [Bug]The desired Collection name isn't kept after rotation
• 8808 - [Bug]Navigation issues in Ublock Settings
• 8822 - [Bug]Accesibility-Extra element displayed on the page when font size for website is increased

Known issues

Major:

• 7344 - [Bug]Crash when trying to access Saved Logins for the second time while performing a Sync
• 8699 - [Bug] Crash on rapid selection in addons menu

Other:

• 8524 - [Bug] Red buttons on Android 5 devices
• 7094 - Don't prompt user to login if they select "Never Save" in password prompt
• 8577 - [Bug]Logins prompt icons aren't properly displayed while using the Light theme
• 7507 - [Bug] Autoplay is not working for a muted video
• 5636 - [Bug]Blocked media autoplay doesn't work properly
• 3900 - [Bug] After sharing a page from Fenix to Firefox Nightly the popup menu remains in the recent apps menu
• 8567 - [Bug]Can't create new bookmarks folder due to #6974
• 6975 - [Bug]Bookmarks folder can't be renamed (following #6974)
• 8571 - [Bug]History isn't sorted chronologically
• 4000 - [Bug] QR code scan issues on OnePlus A3
• 7866 - [Bug] Custom search engines do not provide search suggestions
• 4726 - [Bug]Flicker when navigating to a website from the open tabs
• 6589 - Empty bookmarks library view looks buggy
• 6076 - [Bug]Improperly displayed folder icon in edit mode using the dark theme
• 6970 - [Bug]History and Bookmark icons flicker when using multi-select feature
• 6974 - [Bug]Current Bookmark folder shouldn't be displayed as a root folder option while editing
• 6977 - [Bug]Deleted Bookmarks folder reappears after deleting it
• 5298 - [Bug] The same page appears in the History section multiple times
• 4484 - [Bug]Flicker when deleting History items
• 4432 - [Bug]Delete all history or individual history items snackbar missing
• 6970 - [Bug]History and Bookmark icons flicker when using multi-select feature
• 6079 - [Bug]Open tabs section flickers when opening multiple history items in new tabs
• 4178 - [Bug] Sharing multiple tabs to another browser, only opens 1 tab
• 8531 - [Bug] Deleted history still show up as search suggestions
• 3869 - [Bug] [Bug] Fenix not setting default search engine properly
• 8465 - [Bug]Improperly displayed Enhanced Tracking Protection CFR after rotation
• 4726 - [Bug]Flicker when navigating to a website from the open tabs
• 4375 - [Bug]Mute/Unmute a video displays a white/grey rectangle over the volume bar
• 7369 - [Bug]Soundcloud doesn't play in the background anymore
• 5133 - [Bug] Phone goes to sleep while audio is playing
• 7331 - [Bug] Google images, maps and deezer fail with unknown protocol
• 8726 - [Bug]Collections-Empty collection can be created
• 7242 - [Bug] Collection size change after expand/compress them
• 4490 - [Bug] Tab icons in a collection are not aligned with the titles
• 4721 - [Bug]Flicker when deleting tabs by swipe from a collection
• 2725 - [Bug] Undo snackbar is not displayed when removing a tab from a collection
• 2783 - Add snackbar to collection deletion
• 8195 - [Bug]Open tabs contour inconsistency using the Dark theme
• 8716 - [Bug] Private custom tab opened when signing in to sync records history
• 8590 - [Bug] From PB shortcut, clearing tabs from notification returns to Normal mode
• 4793 - [Bug] soundscloud: Audio plays without media notification showing
• 6213 - [Bug]Facebook Stories playback issue
• 6211 - [Bug]Instagram notification issue
• 7230 - [Bug] Option to open external links with private Firefox missing in the new version
• 8116 - [Bug]uBlock confirmation snackbar isn't displayed is you exit the Add-ons Manager view
• 8139 - [Bug]Improperly displayed uBlock icons using the Light theme
• 8520 - [Bug] Add-ons Manager and add-on sub-pages have inconsistent style compared to the rest of Settings
• 8593 - [Bug] Ublock origin "Add" button has wrong background color
• 8578 - [Bug] Different size icons for "Not supported yet" addons
• 8574 - [Bug] Add-on manager UI elements are misaligned in RTL languages
• 8582 - [Bug] Sending tabs to multiple devices is not working
• 3525 - [Bug] Overwriting bookmark folders when syncing 2 devices
• 3108 - Add new safe browsing policies for Malware in iframe and Billing warning
• 7676 - [Bug] Selecting the entire text in a page, displays an extra button overlapping some elements
• 7953 - [Bug] Error 0/0 displayed when double tapping on Find in page toolbar
• 1657 - [fxa-content-server] Canceled pairing from the mobile device should update automatically on the desktop side
• 6521 - [Bug] Auto-sign in doesn't work on Beta
• 8583 - [Bug] Crash when accessing about:crashcontent
• 5478 - [Bug] Tabs turn into about:blank pages
• 7344 - [Bug]Crash when trying to access Saved Logins for the second time while performing a Sync
• 8480 - [Bug]Pocket Top Articles top site is present for locales different than EN
• 8108 - [Bug] The same site can be added multiple times to home screen
• 8707 - [ETP] Custom ETP drop-down menu faded out is too long
• 3418 - [Bug] [a11y] On Onboarding the focus jumps on the header of the screen instead of Theme card after a theme is selected
• 8581 - [Bug] [a11y] Onboarding UI - The selected enabled options are not recognized as activated
• 8625 - [Bug] [a11y] Default search engine list - The selected enabled options are not recognized as activated
• 8636 - [Bug] [a11y] Downloads - Elements not recognized through TalkBack