« Fenix 79.1.0 beta.1 | Fenix 80.0.0 beta.1 | Fenix 80.0.0 beta.3»

Firefox Beta 80.0.0-beta.1 Test Plan

• Release date: July 30th 2020
• QA Contact: Oana Horvath;Sorina Florean;SV QA team
• Slack: Oana; SV Mobile QA Team
• Build: Firefox Beta 80.0.0-beta.1
• TestRail test plan: Testrail

Full functional & UI tests

QA Assignment

Results

Telemetry

• https://testrail.stage.mozaws.net/index.php?/runs/view/32886

Tablets

• https://testrail.stage.mozaws.net/index.php?/runs/view/32887

Phones

• https://testrail.stage.mozaws.net/index.php?/runs/view/32888

Bug verification

Issues that need QA:

• 10163 - Update tab tray multiselect mode - ✅verified as fixed on both Nightly Build 200730 and Fenix Beta 80.0.0-beta-1
• 12992 - [Bug] Weird behaviour after deleting tab in tab tray multi select - ✅verified as fixed on both Nightly Build 200730 and Fenix Beta 80.0.0-beta-1
• 12990 - [Bug] keyboard stays up on tab switching using swipe - ✅verified as fixed on the latest Nightly Build 200730 ❓ The Swipe to switch Tabs isn't available on Fenix Beta 80.0.0-beta-1
• 11531 - Add new Leanplum E_Search_Widget_Added Event - ✅verified as fixed on both Nightly Build 200730 and Fenix Beta 80.0.0-beta-1
• 12103 - Add new Leanplum E_Changed_Default_To_Fenix Event - ✅verified as fixed on both Nightly Build 200730 and Fenix Beta 80.0.0-beta-1
• 11654 - Add new Leanplum E_Changed_ETP Event - - ✅verified as fixed on both Nightly Build 200730 and Fenix Beta 80.0.0-beta-1
• 10173 - Edit logins - duplicates and save criteria - ❌ Not fixed yet. Verified on 7/30 Nightly build, and on Beta 80.0.0-beta.1
• 12692 - [Bug] "www." not trimmed from url in tab tray - ✅verified as fixed
• 12570 - [Bug] Remove search suggestions after erasing - ✅verified as fixed
• 13066 - [Bug] translate release locales to android locale codes
• 12856 - Save a collection button in tabs tray - Partially fixed
• 9730 - [Telemetry] Save Logins Prompt - ✅verified as fixed Fenix Beta 80.0.0-beta-1 ❓ One inconsistency on Nightly
• 11579 - [Telemetry] Autoplay - ✅Verified as fixed on Nightly ❌Not available on neither Fenix Beta 80.0.0-beta-1 & Fenix Beta 80.0.0-beta-2
• 11664 - LeanPlum MissingResourceException No 3-letter language code for locale: cak, lij - 🕒 Waiting for feedback, no crashes encountered

L10N

Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.

• https://testrail.stage.mozaws.net/index.php?/runs/view/32903

Issues

New issues

Major:

• 13117 - [Bug][Tabs Tray] "Save to collection" displayed for private tabs
• 13118 - [Bug] Tab not restored when you cancel swipe to delete the last tab from a collection

Other:

• 13115 - [Bug] ETP off and shield not visible on webcompat.com
• 13110 - [Bug] Creating a collection from tabs tray doesn't display the first letter with a capital letter
• 13119 - Crash java.lang.ClassCastException: at org.mozilla.fenix.components.toolbar.BrowserToolbarView.expand(BrowserToolbarView.kt:3
• 13123 - Missing Fenix Notification for Myntra TWA in android taskbar
• 13108 - [Bug]Mozilla Nightly gets displayed instead of Mozilla Beta while using Remote debugging via USB
• 13156 - [Bug]Bookmark selection checks not displayed after deleting an item VIA edit mode
• 13160 - [Bug]Opening a new Private Tab VIA contextual menu after close - undo action deletes the tab on Beta 80.0.0-beta.2
• 13117 - [Bug][Tabs Tray] "Save to collection" displayed for private tabs
• 13162 - [Bug] Account not displayed in Settings after turning on sync
• 13169 - [Bug] Synced tabs displayed, when pull to refresh, if the page wasn't closed & open tabs disabled in account settings
• 13171 [Bug][Android 5] Keyboard displayed on when tapping back from Edit logins

Known issues

Major:

Other:

• 9885 - PiP mode available also with the video in pause
• 10319 - [Bug] Tapping a media notification from a PWA should open the PWA
• 8987 - [Bug] Blocking of autoplay videos does not work as expected
• 4002 - [Bug]Auto play video doesn't work after revisiting the website the second time
• 8215 - [Bug] Make crash content page match new error style
• 10555 - [Bug][PiP] The video cannot be seen as the URL and website elements are displayed when a new video starts
• 8215 - [Bug] Make crash content page match new error style
• 11467 - [Bug] User not visible logged out if "Quit - Cookies" is performed
• 11589 - [Bug] Force closing Fenix after disabling an Add-on uninstalls it
• 12661 - [Bug]Add-ons sub-menu overlay disappears after rotation
• 11367 - [Bug] "Report Site Issue" icon is black in dark theme
• 6424 - [Bug] Add-on settings opened in a new tab everytime
• 10057 - [Bug] Weird graphic glitches when using Dark Reader extension
• 12897 - [Bug] YouTube High Definition add-on: Video can't be muted on some devices
• 12305 - [Bug]YouTube High definition doesn't work properly
• 12079 - [Bug]Run in Private browsing toggle state lost after force closing Fenix
• 10475 - [Bug] Delay in hiding the "Run in private browsing" for the HTTS Everywhere Add-on
• 9196 - [Bug]uBlock install/uninstall confirmation snackbar covers the nav bar
• 8729 - [Bug] Add-ons - Both main and detailed descriptions don't follow the selected language
• 7531 - [Bug] downloads that require a user to be logged in to a website fail
• 11903 - [Bug] White almost invisible "close" and "share" icons in custom tabs when Fenix is always set to open tabs in a Private Browsing mode
• 9713 - [Bug] Find in page finds something even after erasing query
• 9463 - [Bug]Back and Forward buttons not updated in custom tabs
• 4178 - [Bug] Sharing multiple tabs to another browser, only opens 1 tab
• 8982 - [Bug] Red items on Android 5 devices
• 1657 - [fxa-content-server] Canceled pairing from the mobile device should update automatically on the desktop side
• 6521 - [Bug] Auto-sign in doesn't work on Beta
• 7953 - [Bug] Error 0/0 displayed when double tapping on Find in page toolbar
• 12083 - [Bug]Missing History and Bookmarks action bar after opening multiple items in new tabs
• 5010 - [Bug]Add undo option when deleting a bookmark from edit mode
• 9619 - [Bug][regression] Overflow menu is hidden just for the selected history item
• 8567 - [Bug]Can't create new bookmarks folder due to #6974
• 6975 - [Bug]Bookmarks folder can't be renamed (following #6974)
• 6974 - [Bug]Current Bookmark folder shouldn't be displayed as a root folder option while editing
• 6977 - [Bug]Deleted Bookmarks folder reappears after deleting it
• 5298 - [Bug] The same page appears in the History section multiple times
• 8571 - [Bug]History isn't sorted chronologically
• 4178 - [Bug] Sharing multiple tabs to another browser, only opens 1 tab
• 11819 - [Bug] Mic displayed on widget when Show voice search option is disabled
• 9323 - [Bug]The microphone icon for widget is not displayed on 2x1 size
• 7866 - [Bug] Custom search engines do not provide search suggestions
• 7491 - [Bug] adding startpage.com as a search engine does not show startpage favicon
• 11180 - [Bug]Tab Tray: Spot displayed on the "New tab" button
• 11111 - [Bug] Tabs Tray New Tab + Button Back Navigation Feels Off
• 11746 - [Bug] Inconsistent FAB entry/exit animation on tabs tray
• 10986 - [Bug] [Tabs Tray] Undo close tab puts tab at the bottom of the list, rather than in-place
• 10740 - [Bug]Tab Tray: Open Tabs media controls aren't displayed
• 12585 - [Bug]Floating tabs tray overlay after rotation
• 11860 - [Bug] Hide save tabs to collection when there is no tab
• 12193 - [Bug]Close all tabs doesn't work properly
• 13117 - [Bug][Tabs Tray] "Save to collection" displayed for private tabs
• 12976 - [Bug]Drop 3 digit numbers from the Tabs Tray's open tabs counter
• 8716 - [Bug] Private custom tab opened when signing in to sync records history
• 12668 - [Bug] Close private tabs from lock-screen while media is playing leaves an empty notification
• 12383 - [Bug]Deletion confirmation snackbar missing when closing all PB Open Tabs
• 7479 - Only remove thumbnails after session undo is dismissed
• 13064 - [Bug] Crash when using QR Code at Synced tabs level: @kotlin.KotlinNullPointerException: at mozilla.components.service.fxa.manager.FxaAccountManager.postAuthenticated(FxaAccountManager.kt:36)
• 8582 - [Bug] Sending tabs to multiple devices is not working without a forced sync
• 12627 - [Bug] Tabs sent from another Firefox open in app even with "Open links in app" set to "No"
• 12850 - [Bug] "source": "UNKNOWN" for "name": "app_opened" and "name": "app_received_intent" event type pings
• 2783 - Add snackbar to collection deletion
• 7723 - [Bug] The account sync doesn't start automatically when the app is brought to the foreground
• 7230 - [Bug] Option to open external links with private Firefox missing in the new version
• 8480 - [Bug] Pocket Top Articles top site is present for locales different than EN