«  Fenix 5.1.1-beta.1 | Fenix 5.2.0-beta.1 | Fenix 5.2.0-beta.2 »

Firefox Preview 5.2.0-beta.1 Test Plan

• Release date: June 11th, 2020
• QA Contact: Oana Horvath; SV QA team
• Slack: Oana;
• Build: Firefox Preview 5.2.0-beta.1
• TestRail test plan: Testrail

Full functional & UI tests

QA Assignment

Results

Telemetry

• https://testrail.stage.mozaws.net/index.php?/runs/view/30598

Tablets

• https://testrail.stage.mozaws.net/index.php?/runs/view/30599

Phones

• https://testrail.stage.mozaws.net/index.php?/runs/view/30600

Bug verification

Issues that need QA:

• 8775 - [Meta Toolbar] Remove feature flag for dynamic bottom toolbar
  • 10073 - [Bug] Pages with embedded content sometimes scroll toolbar, sometimes doesn't (like Github) - ❌ not fixed in Beta with GV 78.0
  • 8768 - [Bug] Dynamic Nav Bar leaves white space on certain websites - verified as fixed on Beta ✅
  • 10477 - [Bug] Can't scroll when the page is taking almost the entire screen - ❌ waiting for GV bug https://bugzilla.mozilla.org/show_bug.cgi?id=1633322
  • 11389 - [Bug] Dynamic top toolbar does not respect embedded content scroll events - ❌ in progress
• 11229 - Highlight ETP value to user - verified as fixed on Beta ✅
• 10494 - [Bug] Fenix is stuck after a few second - verified as fixed on Beta ✅
• 10502 - [TabTray] Provide snackbar to go home when tabs added to collection verified as fixed ✅
• 11260 - [Bug]Tabs Tray: Crash: java.util.ConcurrentModificationException: at java.util.LinkedHashMap$LinkedHashIterator.nextNode(LinkedHashMap.java) - • Native code crash on Nightly 💥 • Can't check on Beta because #11361 is still reproducible ❌
• 7911 - [Bug] Shield size changes while loading, looks jarring - verified as fixed ✅
• 11118 - [Telemetry] Include state of preferenceToggled events in metrics ping - Not fixed on the latest Nightly, missing preferences in the metrics ping ❌

L10N

Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.

• https://testrail.stage.mozaws.net/index.php?/runs/view/30597

Issues

New issues

Major:

• 11420 - [Bug]Tabs Tray: Beta 5.2.0-beta.1 Crash : java.lang.IllegalArgumentException: Session with same ID already exists

Other:

• 11422 - [Bug] Tabs Tray remains open when access through widget
• 11421 - [Bug] Tabs Tray: Missing thumbnail content after adding a page to homescreen
• 11425 - [Bug] When you enter bookmark edit mode, keyboard should be visible, text cursor should be after the text
• 11465 - [Bug] Searching through voice assistant from the search widget is done through a different search engine than the one set as default
• 11467 - [Bug] User not visible logged out if "Quit - Cookies" is performed
• 11468 - [Bug] When you open links from bookmarks/history, show the tabs tray

Known issues

Major:

• 11360 - [Bug]Tabs Tray: Crash kotlin.KotlinNullPointerException

Other:

• 6713 - [Bug] History/Bookmarks sometimes do not sync
• 10764 - [Bug] When "Protect Yourself" toggle is deactivated the background color is white, maybe the boarder should be as for radio buttons
• 1657 - [fxa-content-server] Canceled pairing from the mobile device should update automatically on the desktop side
• 9354 - [Bug]Failed download after resuming an .apk download
• 10283 - [Bug]Flicker while navigating through the Desktop Bookmark folders
• 3900 - Bug] After sharing a page from Fenix to Firefox Nightly the popup menu remains in the recent apps menu
• 5010 - [Bug]Add undo option when deleting a bookmark from edit mode
• 9619 - [Bug][regression] Overflow menu is hidden just for the selected history item
• 8567 - [Bug]Can't create new bookmarks folder due to #6974
• 6975 - [Bug]Bookmarks folder can't be renamed (following #6974)
• 6974 - [Bug]Current Bookmark folder shouldn't be displayed as a root folder option while editing
• 6977 - [Bug]Deleted Bookmarks folder reappears after deleting it
• 5298 - [Bug] The same page appears in the History section multiple times
• 8571 - [Bug]History isn't sorted chronologically
• 4484 - [Bug]Flicker when deleting History items
• 4178 - [Bug] Sharing multiple tabs to another browser, only opens 1 tab
• 7953 - [Bug] Error 0/0 displayed when double tapping on Find in page toolbar
• 9713 - [Bug] Find in page finds something even after erasing query
• 9916 - [Bug] PWA - The pwa icon's are displayed as white on device homescreen
• 11341 - [Bug] Swipe to delete tab is not responsive enough
• 10740 - [Bug]Tab Tray: Open Tabs media controls aren't displayed
• 11042 - [Bug] Tabs tray can be dismissed way too easily when dragging it
• 11044 - [Bug] Odd animation on plus sign icon in tab tray when closing tabs
• 11111 - [Bug] Tabs Tray New Tab + Button Back Navigation Feels Off
• 11361 - [Bug]Tabs Tray: Can't open the Open tabs on first attempt after resume, while having the Tabs Tray open
• 11180 - [Bug]Tab Tray: Spot displayed on the "New tab" button
• 10986 - [Bug] [Tabs Tray] Undo close tab puts tab at the bottom of the list, rather than in-place
• 11185 - [Bug]Tab Tray: Lag in displaying the Open tabs and odd behaviour when deleting tabs
• 4793 - [Bug] soundscloud: Audio plays without media notification showing
• 8716 - [Bug] Private custom tab opened when signing in to sync records histor
• 8848 - [Feature request] Suggested names for collections should be based on creation order
• 7996 - [Bug] Private mode doesn't play nicely with sites added to home screen
• 2725 - [Bug] Undo snackbar is not displayed when removing a tab from a collection
• 2783 - Add snackbar to collection deletion
• 11261 - [Bug]Tabs Tray: Improperly displayed ⋮ overlay after rotation
• 11192 - [Bug]Tab Tray: Screenshots are broken after delete+undo
• 7996 - [Bug] Private mode doesn't play nicely with sites added to home screen
• 11024 - [Bug]Tab Tray - Closing all open tabs in Private Browsing shouldn't re-direct the user to normal browsing
• 6444 - [Bug] Search by Image "Options" button should re-direct to Settings.
• 6424 - [Bug] Add-on settings opened in a new tab everytime
• 10057 - [Bug] Weird graphic glitches when using Dark Reader extension
• 10290 - [Bug] Add-on 'Run in private browsing' option resets when app is restarted
• 8729 - [Bug] Add-ons - Both main and detailed descriptions don't follow the selected language
• 10475 - [Bug] Delay in hiding the "Run in private browsing" for the HTTS Everywhere Add-on
• 8581 - [Bug] [a11y] Onboarding UI - The selected enabled options are not recognized as activated
• 11291 - [Bug] Tab Tray A11y: FAB isn't focusable by TalkBack when Tab Tray is Extended
• 11271 - [Bug] Tab Tray A11y: Tapping tab tray icon says number of tabs open, nothing more
• 7230 - [Bug] Option to open external links with private Firefox missing in the new version
• 10555 - [Bug][PiP] The video cannot be seen as the URL and website elements are displayed when a new video starts
• 9910 - Display video in full-screen when returning from PiP mode
• 10896 - [Bug] Watching videos with WR enabled is broken, jittery video, frozen image, sometimes whole tab turns black
• 10727 - The details for one saved login are displayed after interrupting and then resuming Fenix
• 10116 - [Bug] The Login capture panel is incorrectly displayed when opening the keyboard
• 10737 - [Bug] Searching a language/saved password displays a misplaced "x"
• 10521 - [Bug] Confusing behavior in site permissions exceptions
• 10186 - [Bug] Location pop-up is dismissed only after double tapping it