QA/Fenix/5/0.0/Beta.1/

«  Fenix RC 4.3.0-beta.2 | Fenix RC 5.0.0-beta.1 | Fenix RC 5.0.0-beta.2 »

Firefox Preview 5.0.0-beta.1 Test Plan

• Release date: April 30th, 2020
• QA Contact: Oana Horvath; SV QA team
• Slack: Oana;
• Build: Firefox Preview 5.0.0-beta.1
• TestRail test plan: Testrail

Full functional & UI tests

QA Task	Person/Group
Softvision	Alternating

QA Assignment

Assigned	Build type	Device	Completed	Results
Sorina Florean	x86	Xiaomi MiPad 2 (Android 5.1)	April 29th, 2020	Pass
Andrei Joltan	ARM	OnePlus A3 (Android 6.0.1)	April 29th, 2020	Pass
Andrei Bodea	ARM	Google Pixel 4XL (Android 10)	April 29th, 2020	Pass
Oana Horvath	ARM	Nexus 9 (Android 7.1.1)	April 29th, 2020	Pass
Mirabela Lobontiu	ARM	Samsung Galaxy Tab A6 (Android 5.1.1)	April 29th, 2020	Pass
Stefan Deiac	ARM	Samsung Galaxy Tab S6 (Android 9)	April 29th, 2020	Pass
Laurentiu Apahidean	ARM	Huawei MediaPad M3 Lite 10 (Android 7.0)	April 29th, 2020	Pass
Diana Rus	ARM	Google Pixel 3 XL (Android 9)	April 29th, 2020	Pass
Eliza Balazs	ARM	Motorola Moto G6 (Android 8)	April 29th, 2020	Pass

Results

Telemetry

• https://testrail.stage.mozaws.net/index.php?/runs/view/29006

Tablets

• https://testrail.stage.mozaws.net/index.php?/runs/view/29007

Phones

• https://testrail.stage.mozaws.net/index.php?/runs/view/29008

Bug verification

Everyone

April 29th, 2020

done

Issues that need QA:

• https://github.com/mozilla-mobile/fenix/issues/4149 - Verified as fixed ✔️
• https://github.com/mozilla-mobile/fenix/issues/6557 - Verified, as fixed ✔️
• https://github.com/mozilla-mobile/fenix/issues/9409 - Verified as fixed on ✔️ Fenix Nightly, ✔️ Firefox Nightly, ❌ Fenix Beta - No push token got generated
• https://github.com/mozilla-mobile/fenix/issues/9880 - Verified as fixed ✔️
• https://github.com/mozilla-mobile/fenix/issues/7157 - The actual dynamic width menu is still in review in a-c ❌
• https://github.com/mozilla-mobile/fenix/issues/6558 - Verified, as fixed ✔️

L10N

Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.

• https://testrail.stage.mozaws.net/index.php?/runs/view/28494

Andrei Bodea

April 29th, 2020

Pass

Issues

New issues

Major:

• 10277 - [Bug] Crash when opening the Bookmarks & History section
• 10279 - [Bug] Cannot sign in on Android 5&6 devices - continuous loop
• 10280 - [Bug] Crash when signing in through pairing on Android 5&6 devices

Other:

• 10315 - [Bug] The toolbar appears on PWAs if backgrounded
• 10319 - [Bug] Taping a media notification from a PWA should open the PWA
• 10283 - [Bug] Flicker while navigating through the Desktop Bookmark folders
• 10289 - [Bug] Tapping on the URL bar from a loaded page doesn't display the "Close/x" button
• 10291 - [Bug] Dynamic nav-bar isn't working when toolbar is set to the bottom
• 10290 - [Bug] Add-on 'Run in private browsing' option resets when app is restarted

Known issues

Major: -

Other:

• 10142 - [Bug] Changing site permissions from the site info panel doesn't work
• 1657 - [fxa-content-server] Canceled pairing from the mobile device should update automatically on the desktop side
• 9354 - [Bug]Failed download after resuming an .apk download
• 3900 - Bug] After sharing a page from Fenix to Firefox Nightly the popup menu remains in the recent apps menu
• 9619 - [Bug][regression] Overflow menu is hidden just for the selected history item
• 8567 - [Bug]Can't create new bookmarks folder due to #6974
• 6975 - [Bug]Bookmarks folder can't be renamed (following #6974)
• 6974 - [Bug]Current Bookmark folder shouldn't be displayed as a root folder option while editing
• 6977 - [Bug]Deleted Bookmarks folder reappears after deleting it
• 9356 - [Bug]Trembling navigation through Bookmarks folders
• 5298 - [Bug] The same page appears in the History section multiple times
• 4484 - [Bug]Flicker when deleting History items
• 8571 - [Bug]History isn't sorted chronologically
• 4432 - [Bug]Delete all history or individual history items snackbar missing
• 4178 - [Bug] Sharing multiple tabs to another browser, only opens 1 tab
• 8729 - [Bug] Add-ons - Both main and detailed descriptions don't follow the selected language
• 10195 - [Bug] Private browsing setting can re-enable add-on
• 10196 - [Bug]"Run in private browsing" should remain enabled even if the user disables the Add-on
• 10194 - [Bug]Dark Reader is missing from the main menu after re-enabling it
• 10057 - [Bug] Weird graphic glitches when using Dark Reader extension
• 6430 - [Bug]Dark reader doesn't work on Linkedin
• 6422 - [Bug] Dark Reader “Donate” does not redirect to donation page
• 6419 - [Bug] Dark Reader “Help” (Read the manual) does not redirect to manual page
• 6444 - [Bug] Search by Image "Options" button should re-direct to Settings.
• 6424 - [Bug] Add-on settings opened in a new tab everytime
• 6464 - [Bug] The enable/disable globally Privacy Badger turns green
• 7953 - [Bug] Error 0/0 displayed when double tapping on Find in page toolbar
• 8428 - [Bug] [l10n] About Firefox Nightly page is not completely translated in some languages
• 8982 - [Bug] Red items in custom tab on Android 5 devices
• 9662 - [Bug] The account name is bold in the settings section #9662
• 10116 - [Bug] The Login capture panel is incorrectly displayed when opening the keyboard #10116
• 8636 - [Bug] [a11y] Downloads - Elements not recognized through TalkBack
• 8625 - [Bug] [a11y] Default search engine list - The selected enabled options are not recognized as activated
• 8581 - [Bug] [a11y] Onboarding UI - The selected enabled options are not recognized as activated
• 5478 - [Bug] Tabs turn into about:blank pages
• 9457 - Switch to tab-The option is not available for the last opened tab
• 9890 - Sharing multiple tabs to another browser, only opens 1 tab
• 7369 - Soundcloud doesn't play in the background anymore
• 4793 - [Bug] soundscloud: Audio plays without media notification showing
• 8726 - [Bug] Collections-Empty collection can be created
• 7953 - [Bug] Error 0/0 displayed when double tapping on Find in page toolbar
• 7157 - [Menu] App Menu - Left and Right margins should be 16dp (need dynamic width)
• 9100 - [Bug] Clearing private tabs from notification closes the app
• 7996 - [Bug] Private mode doesn't play nicely with sites added to home screen
• 8480 - [Bug] Pocket Top Articles top site is present for locales different than EN
• 8108 - [Bug] The same site can be added multiple times to home screen
• 10142 - [Bug] Changing site permissions from the site info panel doesn't work
• 6146 - [Bug] Fenix hijack the audio output of other apps on the device
• 8503 - [Bug] Video Playback Errors and GIF playback errors in Firefox for Android
• 5636 - [Bug]Blocked media autoplay doesn't work properly
• 9143 - [Bug] Added search engine no longer displayed if it was previously undo and the browser was restarted
• 3869 - [Bug] Fenix not setting default search engine properly
• 8857 - [Bug] Video full screen issues when rotating the device from portrait to landscape
• 9463 - [Bug]Back and Forward buttons not updated in custom tabs
• 3869 - [Bug] Fenix not setting default search engine properly
• 9425 - [Bug]Undoing a deleted search engine makes "Edit" option unavailable
• 9323 - [Bug]The microphone icon for widget is not displayed on 2x1 size
• 2725 - [Bug] Undo snackbar is not displayed when removing a tab from a collection
• 4721 - [Bug]Flicker when deleting tabs by swipe from a collection
• 2783 - Add snackbar to collection deletion
• 8195 - [Bug]Open tabs contour inconsistency using the Dark theme
• 8716 - [Bug] Private custom tab opened when signing in to sync records history
• 7203 - [Bug] Option to open external links with private Firefox missing in the new version
• 7723 - [Bug] The account sync doesn't start automatically when the app is brought to the foreground
• 6521 - [Bug] Auto-sign in doesn't work on Beta
• 10233 - [Bug] Permissions not always saved on first run