QA/Fenix/99.0.0/beta.1: Difference between revisions

< QA
No edit summary
 
(7 intermediate revisions by 3 users not shown)
Line 1: Line 1:
<small>[[QA/Fenix/98.1.1/RC| Fenix 98.1.1 RC]] | [[QA/Fenix/99.0.0/beta.1| Fenix 99.0.0 Beta 1]]</small>
<small>[[QA/Fenix/98.3.0/RC| Fenix 98.3.0 RC]] | [[QA/Fenix/99.0.0/beta.1| Fenix 99.0.0 Beta 1]] | [[QA/Fenix/99.0.0/beta.2| Fenix 99.0.0 Beta 2]]</small>




Line 32: Line 32:
  | Motorola Moto G30 (Android 11)
  | Motorola Moto G30 (Android 11)
  | March 10th, 2022
  | March 10th, 2022
  |'''In Progress'''
  |'''Pass'''
  |-
  |-
  | Andrei Jolțan
  | Andrei Jolțan
Line 44: Line 44:
  | Huawei Media Pad M3 (Android 7)
  | Huawei Media Pad M3 (Android 7)
  | March 10th, 2022
  | March 10th, 2022
  |'''In Progress'''
  |'''Pass'''
  |-  
  |-  
  | Laurentiu Apahidean
  | Laurentiu Apahidean
Line 50: Line 50:
  | Samsung S10E (Android 10)
  | Samsung S10E (Android 10)
  | March 10th, 2022
  | March 10th, 2022
  |'''In Progress'''
  |'''Pass'''
  |-  
  |-  
  | Sorina Florean
  | Sorina Florean
Line 78: Line 78:
  | '''All'''
  | '''All'''
  | March 10th, 2022
  | March 10th, 2022
  | '''In Progress'''
  | '''Done'''
|}  
|}  
</onlyinclude>
</onlyinclude>
Line 84: Line 84:
* [https://github.com/mozilla-mobile/fenix/issues/23662 23662] - Wallpaper settings screen should be scrollable - '''✅ Verified as fixed on Nightly and Beta 99.0.0-beta.1'''
* [https://github.com/mozilla-mobile/fenix/issues/23662 23662] - Wallpaper settings screen should be scrollable - '''✅ Verified as fixed on Nightly and Beta 99.0.0-beta.1'''
* [https://github.com/mozilla-mobile/fenix/issues/23894 23894] [Bug]: History is truncated if FeatureFlag.historyImprovementFeatures is turned on - '''✅ Verified as fixed on Nightly and Beta 99.0.0-beta.1'''
* [https://github.com/mozilla-mobile/fenix/issues/23894 23894] [Bug]: History is truncated if FeatureFlag.historyImprovementFeatures is turned on - '''✅ Verified as fixed on Nightly and Beta 99.0.0-beta.1'''
 
* [https://github.com/mozilla-mobile/fenix/issues/23399 23399] - [Telemetry] Multi-select on tabs tray - '''✅ Verified as fixed on Nightly and Beta 99.0.0-beta.1'''
== Issues ==
== Issues ==
=== New issues ===
=== New issues ===
Line 95: Line 95:
* [https://github.com/mozilla-mobile/fenix/issues/24187 24187] - [Bug]: Multiple Inactive Tabs CFRs are displayed after background foreground
* [https://github.com/mozilla-mobile/fenix/issues/24187 24187] - [Bug]: Multiple Inactive Tabs CFRs are displayed after background foreground
* [https://github.com/mozilla-mobile/fenix/issues/24188 24188] - [Bug]: Placeholder displayed instead of product name in Inactive Tabs auto-close prompt
* [https://github.com/mozilla-mobile/fenix/issues/24188 24188] - [Bug]: Placeholder displayed instead of product name in Inactive Tabs auto-close prompt
* [https://github.com/mozilla-mobile/fenix/issues/24186 24186] - [Bug]: Default top sites can be re-added to the top sites list


=== Known issues ===
=== Known issues ===
Line 151: Line 152:
* [https://github.com/mozilla-mobile/fenix/issues/21351 21351] -[Bug]: "Always start on home" is not applicable when Fenix is set as device assistant.  
* [https://github.com/mozilla-mobile/fenix/issues/21351 21351] -[Bug]: "Always start on home" is not applicable when Fenix is set as device assistant.  
* [https://github.com/mozilla-mobile/fenix/issues/18983 18983] -[Bug] Unable to choose a different login after picking a wrong one
* [https://github.com/mozilla-mobile/fenix/issues/18983 18983] -[Bug] Unable to choose a different login after picking a wrong one
* [https://github.com/mozilla-mobile/fenix/issues/24131 24131] - [Bug]: "Disconnect" button is not working on Sony Xperia after a period of time
* [https://github.com/mozilla-mobile/fenix/issues/22315 22315] - [Bug] Inconsistent behaviour when opening multiple items in a new tab from history compared to bookmarks
* [https://github.com/mozilla-mobile/fenix/issues/18900 18900] - [Bug] When reopening a closed page
* [https://github.com/mozilla-mobile/fenix/issues/17523 17523] - [Bug] The Recently closed tabs counter is not updated before opening the list
* [https://github.com/mozilla-mobile/fenix/issues/19308 19308] - [Bug] Page thumbnail is no longer loaded after restoring the tab using "Undo" button
* [https://github.com/mozilla-mobile/fenix/issues/20811 20811] - [Bug] Tabs tray synced tabs "Sign in to sync" button size inconsistency
* [https://github.com/mozilla-mobile/fenix/issues/20812 20812] - [Bug] Tabs tray "Sync" button shouldn't be displayed if the user isn't signed in to sync or needs to reconnect to sync
* [https://github.com/mozilla-mobile/fenix/issues/16820 16820] - [Bug] Unable to play certain videos on the page due to unsupported video format
* [https://github.com/mozilla-mobile/fenix/issues/20434 20434] - [Bug] Media notifications are blank when the user starts/pauses the media from it
* [https://github.com/mozilla-mobile/fenix/issues/22310 22310] - [Bug] Collections - Tapping on "Deselect all" doesn't change the state for tabs previously selected
* [https://github.com/mozilla-mobile/fenix/issues/18702 18702] - [Bug] No snackbar is displayed when adding new tab to a collection
* [https://github.com/mozilla-mobile/fenix/issues/2725 2725] - [Bug] Undo snackbar is not displayed when removing a tab from a collection
* [https://github.com/mozilla-mobile/fenix/issues/13177 13177] - [Bug] Strange Tab in Collections Items Behavior When Deleting Multiple Tabs
* [https://github.com/mozilla-mobile/fenix/issues/23670 23670] - [Bug] The previously deleted tabs are restored when the collection is restored
* [https://github.com/mozilla-mobile/fenix/issues/20391 20391] - [Bug] Empty collection can be created
* [https://github.com/mozilla-mobile/fenix/issues/16685 16685] - [Bug] Tab selection checkmark disappears after background/resume
* [https://github.com/mozilla-mobile/fenix/issues/7230 7230] - [Bug] Option to open external links with private Firefox missing in the new version
* [https://github.com/mozilla-mobile/fenix/issues/7996 7996] - [Bug] Private mode doesn't play nicely with sites added to home screen
* [https://github.com/mozilla-mobile/fenix/issues/8480 8480] - [Bug] Pocket Top Articles top site is present for locales different than EN
* [https://bugzilla.mozilla.org/show_bug.cgi?id=1646515 1646515] - Copying a styled `<table>` to the clipboard drops style
* [https://bugzilla.mozilla.org/show_bug.cgi?id=1640893 1640893] - Colors and fonts aren't kept when selection was made in browser and pasted in Google Sheets app
* [https://github.com/mozilla-mobile/fenix/issues/9713 9713] - [Bug] Find in page finds something even after erasing query
* [https://github.com/mozilla-mobile/fenix/issues/23535 23535] - [Bug]: Reader view icon flickers on scroll
* [https://github.com/mozilla-mobile/fenix/issues/16602 16602] - [Bug] Fenix thinks that its reader mode is insecure

Latest revision as of 04:55, 23 March 2022

Fenix 98.3.0 RC | Fenix 99.0.0 Beta 1 | Fenix 99.0.0 Beta 2


Firefox 99.0.0 Beta 1 Test Plan

Full Functional & UI tests

QA Task Person/Group
Softvision Alternating

QA Assignment

Assigned Build type Device Completed Results
Delia Pop ARM Motorola Moto G30 (Android 11) March 10th, 2022 Pass
Andrei Jolțan ARM OnePlus A3 (Android 6.0.1) March 10th, 2022 Pass
Laurentiu Apahidean ARM Huawei Media Pad M3 (Android 7) March 10th, 2022 Pass
Laurentiu Apahidean ARM Samsung S10E (Android 10) March 10th, 2022 Pass
Sorina Florean ARM Sony Xperia (Android 6.0.1) March 10th, 2022 Pass


Full Functional and UI Tests

https://testrail.stage.mozaws.net/index.php?/plans/view/54619

Tablets

Phones

Telemetry

Bug verification

All March 10th, 2022 Done
  • 23644 - Wallpapers do not switch their version based on orientation when changed - ✅ Verified as fixed on Nightly and Beta 99.0.0-beta.1
  • 23662 - Wallpaper settings screen should be scrollable - ✅ Verified as fixed on Nightly and Beta 99.0.0-beta.1
  • 23894 [Bug]: History is truncated if FeatureFlag.historyImprovementFeatures is turned on - ✅ Verified as fixed on Nightly and Beta 99.0.0-beta.1
  • 23399 - [Telemetry] Multi-select on tabs tray - ✅ Verified as fixed on Nightly and Beta 99.0.0-beta.1

Issues

New issues

Major:

Other:

  • 24162 -[Bug]: Pages are not displayed in desktop mode if the toggle was previously enabled
  • 24165 -[Bug]: Search groups not displayed under Jump Back in section on Sony Xperia
  • 24163 - [Bug]: Improper transition for "Through provoking stories" when changing the orientation
  • 24187 - [Bug]: Multiple Inactive Tabs CFRs are displayed after background foreground
  • 24188 - [Bug]: Placeholder displayed instead of product name in Inactive Tabs auto-close prompt
  • 24186 - [Bug]: Default top sites can be re-added to the top sites list

Known issues

Major:

  • 22486 - History UI deletion of items is very buggy

Other:

  • 23672 - [Bug]: Screen is flickering when switching the ETP toggle from on to off
  • 7907 - ETP doesn't work on a quick first load on first run
  • 18445 - [Bug] Clicking "use precise location" in google search results doesn't work
  • 11589 - [Bug] Force closing Fenix after disabling an Add-on uninstalls it
  • 14939 - [Bug]White "Run in private browsing" icon
  • 12661 - [Feature request] Add-ons sub-menu overlay should not disappear after rotation
  • 12897 - [Bug] YouTube High Definition add-on: Video can't be muted on some devices
  • 15627 - [Bug] Tomato Clock "Stats" are opened in the background
  • 12079 - [Bug]Run in Private browsing toggle state lost after force closing Fenix
  • 9196 - [Bug]Add-ons uninstall confirmation snackbar covers the nav bar
  • 22062 - [Bug]: Download dialog does not decode multibyte file name
  • 15069 - [Bug][downloads] "Try again" doesn't work after the connection is reestablished
  • 17716 - [Bug] can not downloads images from Pixiv anymore
  • 20848 - Downloaded items can be deleted individually in multiselect mode
  • 20280 - [Bug] Youtube autoplay leads to non-fullscreen picture in picture (PiP) mode
  • 9910 - Display video in full-screen when returning from PiP mode
  • 10319 - [Bug] Tapping a media notification from a PWA should open the PWA
  • 13123 - [Bug] Missing Fenix Notification for Myntra TWA in android taskbar
  • 8761 - [Bug] Open in Fenix from a PWA custom tab, replaces the PWA with Fenix
  • 8966 - [Bug] Share icon in custom PWA toolbar has wrong color
  • 10560 - [Bug] [PWA] "Add to Home screen" confirmation dialog isn't displayed on certain devices
  • 24133 -[Bug]: Improper flicker displayed when switching between toolbar cards in the Onboarding screen
  • 23064 -[Bug]: "Jump back in" tabs are not visible on homescreen
  • 16128 -[Bug] "Font size" option is aligned to the left on tablets
  • 23860 -[Bug]: Incorrect tab number appears for a moment on swipe
  • 24134 - [Bug]: Improper flicker displayed on engine pictogram and cursor when tapping the URL bar
  • 23174 - [Bug]: Estimated reading time and photo are missing from some stories when "quick-reads" topic is selected
  • 24132 - [Bug]: Jump back in thumbnail image is not displayed sometimes
  • 24106 - [Bug]: A white/grey flicker is displayed for a split second while the website loads or when switching tabs
  • 20810 - [Bug]: If no tab is selected the "Bookmark" and "Close" options from the ⋮ "more options" menu shouldn't be available
  • 22317 - [Bug]: Inconsistent behaviour when opening multiple items in a new tab from history compared to bookmarks
  • 9323 - [Bug]The microphone icon for widget is not displayed on 2x1 size
  • 15996 - [Bug] Search widget is light with dark theme
  • 23532 - [Bug]: Add search engine - Clear icon is not displayed when the user starts typing in fields
  • 17431 - [Bug] Some strings provide search suggestions
  • 22129 - [Bug]: Refined search in result page may be added to wrong search group
  • 22763 - [Bug]: Searches originated from the same search term are not grouped under the term used
  • 22765 - [Bug]: Search term groupings don't disappear after 14 days
  • 22313 - [Bug]: Incorrect link saved for the original search results
  • 22158 - [Bug]: History/Home Search Group tabs created from Google are duplicated
  • 21960 - [Bug]: Disabling "Zoom on all websites" will not reset zoom level on certain webpages until refreshing
  • 21498 - [Bug]: Zooming & scrolling some pages, displays the pages' toolbar dynamic
  • 18694 - [Bug] The dot from the scale overlaps the percentage number
  • 23212 - [Bug]: Deleting a saved login, the account is still displayed on the list
  • 23214 - [Bug]: No success pop-up/ snackbar is displayed after adding manually a login
  • 21065 - [Bug] Permissions in private tabs are not persitent accross the same session.
  • 9773 - [User Story] 3rd party password manager apps support
  • 22012 - [Bug]: Inactive tabs section turns "incognito" dark after returning from private tab
  • 23671 - [Bug]: the same page can be added to bookmarks from tabs tray multiple time (no snackbar/ message is displayed informing that the page is already a bookmark)
  • 21351 -[Bug]: "Always start on home" is not applicable when Fenix is set as device assistant.
  • 18983 -[Bug] Unable to choose a different login after picking a wrong one
  • 24131 - [Bug]: "Disconnect" button is not working on Sony Xperia after a period of time
  • 22315 - [Bug] Inconsistent behaviour when opening multiple items in a new tab from history compared to bookmarks
  • 18900 - [Bug] When reopening a closed page
  • 17523 - [Bug] The Recently closed tabs counter is not updated before opening the list
  • 19308 - [Bug] Page thumbnail is no longer loaded after restoring the tab using "Undo" button
  • 20811 - [Bug] Tabs tray synced tabs "Sign in to sync" button size inconsistency
  • 20812 - [Bug] Tabs tray "Sync" button shouldn't be displayed if the user isn't signed in to sync or needs to reconnect to sync
  • 16820 - [Bug] Unable to play certain videos on the page due to unsupported video format
  • 20434 - [Bug] Media notifications are blank when the user starts/pauses the media from it
  • 22310 - [Bug] Collections - Tapping on "Deselect all" doesn't change the state for tabs previously selected
  • 18702 - [Bug] No snackbar is displayed when adding new tab to a collection
  • 2725 - [Bug] Undo snackbar is not displayed when removing a tab from a collection
  • 13177 - [Bug] Strange Tab in Collections Items Behavior When Deleting Multiple Tabs
  • 23670 - [Bug] The previously deleted tabs are restored when the collection is restored
  • 20391 - [Bug] Empty collection can be created
  • 16685 - [Bug] Tab selection checkmark disappears after background/resume
  • 7230 - [Bug] Option to open external links with private Firefox missing in the new version
  • 7996 - [Bug] Private mode doesn't play nicely with sites added to home screen
  • 8480 - [Bug] Pocket Top Articles top site is present for locales different than EN
  • 1646515 - Copying a styled `` to the clipboard drops style
  • 1640893 - Colors and fonts aren't kept when selection was made in browser and pasted in Google Sheets app
  • 9713 - [Bug] Find in page finds something even after erasing query
  • 23535 - [Bug]: Reader view icon flickers on scroll
  • 16602 - [Bug] Fenix thinks that its reader mode is insecure