MozillaWiki

QA/Fenix/99.0.0/beta.1: Difference between revisions

< QA
No edit summary
No edit summary
 
(20 intermediate revisions by 5 users not shown)
Line 1: Line 1:
<small>[[QA/Fenix/98.1.1/RC| Fenix 98.1.1 RC]] | [[QA/Fenix/99.0.0/beta.1| Fenix 99.0.0 Beta 1]]</small>
<small>[[QA/Fenix/98.3.0/RC| Fenix 98.3.0 RC]] | [[QA/Fenix/99.0.0/beta.1| Fenix 99.0.0 Beta 1]] | [[QA/Fenix/99.0.0/beta.2| Fenix 99.0.0 Beta 2]]</small>




= Firefox 99.0.0 Beta 1 Test Plan =
= Firefox 99.0.0 Beta 1 Test Plan =
* Release date: March 8th, 2022
* Release date: March 9th, 2022
* QA Contact: [mailto:ohorvath@mozilla.com Oana Horvath]; [mailto:sflorean@mozilla.com Sorina Florean]; [mailto:mozilla-mobile-qa@softvision.com SV QA team]
* QA Contact: [mailto:ohorvath@mozilla.com Oana Horvath]; [mailto:sflorean@mozilla.com Sorina Florean]; [mailto:mozilla-mobile-qa@softvision.com SV QA team]
* Slack: [https://mozilla.slack.com/archives/C5VPJJL9F SV Mobile QA Team]
* Slack: [https://mozilla.slack.com/archives/C5VPJJL9F SV Mobile QA Team]
Line 31: Line 31:
  | ARM
  | ARM
  | Motorola Moto G30 (Android 11)
  | Motorola Moto G30 (Android 11)
  | March 8th, 2022
  | March 10th, 2022
  |'''In Progress'''
  |'''Pass'''
  |-
  |-
  | Andrei Jolțan
  | Andrei Jolțan
  | ARM
  | ARM
  | Google Pixel 3a (Android 11)
  | OnePlus A3 (Android 6.0.1)
  | March 8th, 2022
  | March 10th, 2022
  |'''In Progress'''
  |'''Pass'''
  |-
  |-
  | Laurentiu Apahidean
  | Laurentiu Apahidean
  | ARM
  | ARM
  | Huawei Media Pad M3 (Android 7)
  | Huawei Media Pad M3 (Android 7)
  | March 8th, 2022
  | March 10th, 2022
  |'''In Progress'''
  |'''Pass'''
|-
| Laurentiu Apahidean
| ARM
| Samsung S10E (Android 10)
| March 10th, 2022
|'''Pass'''
  |-  
  |-  
  | Sorina Florean
  | Sorina Florean
  | ARM
  | ARM
  | Sony Xperia (Android 6.0.1)
  | Sony Xperia (Android 6.0.1)
  | March 8th, 2022
  | March 10th, 2022
  |'''In Progress'''
  |'''Pass'''
  |-  
  |-  
  |}  
  |}  
Line 71: Line 77:
  |-  
  |-  
  | '''All'''
  | '''All'''
  | March 9th, 2022
  | March 10th, 2022
  | '''In Progress'''
  | '''Done'''
|}  
|}  
</onlyinclude>
</onlyinclude>
 
* [https://github.com/mozilla-mobile/fenix/issues/23644 23644] - Wallpapers do not switch their version based on orientation when changed - '''✅ Verified as fixed on Nightly and Beta 99.0.0-beta.1'''
* [https://github.com/mozilla-mobile/fenix/issues/23662 23662] - Wallpaper settings screen should be scrollable - '''✅ Verified as fixed on Nightly and Beta 99.0.0-beta.1'''
* [https://github.com/mozilla-mobile/fenix/issues/23894 23894] [Bug]: History is truncated if FeatureFlag.historyImprovementFeatures is turned on - '''✅ Verified as fixed on Nightly and Beta 99.0.0-beta.1'''
* [https://github.com/mozilla-mobile/fenix/issues/23399 23399] - [Telemetry] Multi-select on tabs tray - '''✅ Verified as fixed on Nightly and Beta 99.0.0-beta.1'''
== Issues ==
== Issues ==
=== New issues ===
=== New issues ===
Line 81: Line 90:


Other:
Other:
 
* [https://github.com/mozilla-mobile/fenix/issues/24162 24162] -[Bug]: Pages are not displayed in desktop mode if the toggle was previously enabled
* [https://github.com/mozilla-mobile/fenix/issues/24165 24165] -[Bug]: Search groups not displayed under Jump Back in section on Sony Xperia
* [https://github.com/mozilla-mobile/fenix/issues/24163 24163] - [Bug]: Improper transition for "Through provoking stories" when changing the orientation
* [https://github.com/mozilla-mobile/fenix/issues/24187 24187] - [Bug]: Multiple Inactive Tabs CFRs are displayed after background foreground
* [https://github.com/mozilla-mobile/fenix/issues/24188 24188] - [Bug]: Placeholder displayed instead of product name in Inactive Tabs auto-close prompt
* [https://github.com/mozilla-mobile/fenix/issues/24186 24186] - [Bug]: Default top sites can be re-added to the top sites list


=== Known issues ===
=== Known issues ===
Major:
Major:
* [https://github.com/mozilla-mobile/fenix/issues/22486 22486] - History UI deletion of items is very buggy
Other:
* [https://github.com/mozilla-mobile/fenix/issues/23672 23672] - [Bug]: Screen is flickering when switching the ETP toggle from on to off
* [https://github.com/mozilla-mobile/fenix/issues/7907 7907] - ETP doesn't work on a quick first load on first run
* [https://github.com/mozilla-mobile/fenix/issues/18445 18445] - [Bug] Clicking "use precise location" in google search results doesn't work
* [https://github.com/mozilla-mobile/fenix/issues/11589 11589] - [Bug] Force closing Fenix after disabling an Add-on uninstalls it
* [https://github.com/mozilla-mobile/fenix/issues/14939 14939] - [Bug]White "Run in private browsing" icon
* [https://github.com/mozilla-mobile/fenix/issues/12661 12661] - [Feature request] Add-ons sub-menu overlay should not disappear after rotation
* [https://github.com/mozilla-mobile/fenix/issues/12897 12897] - [Bug] YouTube High Definition add-on: Video can't be muted on some devices
* [https://github.com/mozilla-mobile/fenix/issues/15627 15627] - [Bug] Tomato Clock "Stats" are opened in the background
* [https://github.com/mozilla-mobile/fenix/issues/12079 12079] - [Bug]Run in Private browsing toggle state lost after force closing Fenix
* [https://github.com/mozilla-mobile/fenix/issues/9196 9196] - [Bug]Add-ons uninstall confirmation snackbar covers the nav bar
* [https://github.com/mozilla-mobile/fenix/issues/22062 22062] - [Bug]: Download dialog does not decode multibyte file name
* [https://github.com/mozilla-mobile/fenix/issues/15069 15069] - [Bug][downloads] "Try again" doesn't work after the connection is reestablished
* [https://github.com/mozilla-mobile/fenix/issues/17716 17716] - [Bug] can not downloads images from Pixiv anymore
* [https://github.com/mozilla-mobile/fenix/issues/20848 20848] - Downloaded items can be deleted individually in multiselect mode
* [https://github.com/mozilla-mobile/fenix/issues/20280 20280] - [Bug] Youtube autoplay leads to non-fullscreen picture in picture (PiP) mode
* [https://github.com/mozilla-mobile/fenix/issues/9910 9910] - Display video in full-screen when returning from PiP mode
* [https://github.com/mozilla-mobile/fenix/issues/10319 10319] - [Bug] Tapping a media notification from a PWA should open the PWA
* [https://github.com/mozilla-mobile/fenix/issues/13123 13123] - [Bug] Missing Fenix Notification for Myntra TWA in android taskbar
* [https://github.com/mozilla-mobile/fenix/issues/8761 8761] - [Bug] Open in Fenix from a PWA custom tab, replaces the PWA with Fenix
* [https://github.com/mozilla-mobile/fenix/issues/8966 8966] - [Bug] Share icon in custom PWA toolbar has wrong color
* [https://github.com/mozilla-mobile/fenix/issues/10560 10560] - [Bug] [PWA] "Add to Home screen" confirmation dialog isn't displayed on certain devices
* [https://github.com/mozilla-mobile/fenix/issues/24133 24133] -[Bug]: Improper flicker displayed when switching between toolbar cards in the Onboarding screen
* [https://github.com/mozilla-mobile/fenix/issues/23064 23064] -[Bug]: "Jump back in" tabs are not visible on homescreen
* [https://github.com/mozilla-mobile/fenix/issues/16128 16128] -[Bug] "Font size" option is aligned to the left on tablets
* [https://github.com/mozilla-mobile/fenix/issues/23860 23860] -[Bug]: Incorrect tab number appears for a moment on swipe
* [https://github.com/mozilla-mobile/fenix/issues/24134 24134] - [Bug]: Improper flicker displayed on engine pictogram and cursor when tapping the URL bar
* [https://github.com/mozilla-mobile/fenix/issues/23174 23174] - [Bug]: Estimated reading time and photo are missing from some stories when "quick-reads" topic is selected
* [https://github.com/mozilla-mobile/fenix/issues/24132 24132] - [Bug]: Jump back in thumbnail image is not displayed sometimes
* [https://github.com/mozilla-mobile/fenix/issues/24106 24106] - [Bug]: A white/grey flicker is displayed for a split second while the website loads or when switching tabs
* [https://github.com/mozilla-mobile/fenix/issues/20810 20810] - [Bug]: If no tab is selected the "Bookmark" and "Close" options from the ⋮ "more options" menu shouldn't be available
* [https://github.com/mozilla-mobile/fenix/issues/22315 22317] - [Bug]: Inconsistent behaviour when opening multiple items in a new tab from history compared to bookmarks
* [https://github.com/mozilla-mobile/fenix/issues/9323 9323] - [Bug]The microphone icon for widget is not displayed on 2x1 size
* [https://github.com/mozilla-mobile/fenix/issues/15996 15996] - [Bug] Search widget is light with dark theme
* [https://github.com/mozilla-mobile/fenix/issues/23532 23532] - [Bug]: Add search engine - Clear icon is not displayed when the user starts typing in fields
* [https://github.com/mozilla-mobile/fenix/issues/17431 17431] - [Bug] Some strings provide search suggestions
* [https://github.com/mozilla-mobile/fenix/issues/22129 22129] - [Bug]: Refined search in result page may be added to wrong search group
* [https://github.com/mozilla-mobile/fenix/issues/22763 22763] - [Bug]: Searches originated from the same search term are not grouped under the term used
* [https://github.com/mozilla-mobile/fenix/issues/22765 22765] - [Bug]: Search term groupings don't disappear after 14 days
* [https://github.com/mozilla-mobile/fenix/issues/22313 22313] - [Bug]: Incorrect link saved for the original search results
* [https://github.com/mozilla-mobile/fenix/issues/22158 22158] - [Bug]: History/Home Search Group tabs created from Google are duplicated
* [https://github.com/mozilla-mobile/fenix/issues/21960 21960] - [Bug]: Disabling "Zoom on all websites" will not reset zoom level on certain webpages until refreshing
* [https://github.com/mozilla-mobile/fenix/issues/21498 21498] - [Bug]: Zooming & scrolling some pages, displays the pages' toolbar dynamic
* [https://github.com/mozilla-mobile/fenix/issues/18694 18694] - [Bug] The dot from the scale overlaps the percentage number
* [https://github.com/mozilla-mobile/fenix/issues/23212 23212] - [Bug]: Deleting a saved login, the account is still displayed on the list
* [https://github.com/mozilla-mobile/fenix/issues/23214 23214] - [Bug]: No success pop-up/ snackbar is displayed after adding manually a login
* [https://github.com/mozilla-mobile/fenix/issues/21065 21065] - [Bug] Permissions in private tabs are not persitent accross the same session.
* [https://github.com/mozilla-mobile/fenix/issues/9773 9773] - [User Story] 3rd party password manager apps support
* [https://github.com/mozilla-mobile/fenix/issues/22012 22012] - [Bug]: Inactive tabs section turns "incognito" dark after returning from private tab
* [https://github.com/mozilla-mobile/fenix/issues/23671 23671] - [Bug]: the same page can be added to bookmarks from tabs tray multiple time (no snackbar/ message is displayed informing that the page is already a bookmark)
* [https://github.com/mozilla-mobile/fenix/issues/21351 21351] -[Bug]: "Always start on home" is not applicable when Fenix is set as device assistant.
* [https://github.com/mozilla-mobile/fenix/issues/18983 18983] -[Bug] Unable to choose a different login after picking a wrong one
* [https://github.com/mozilla-mobile/fenix/issues/24131 24131] - [Bug]: "Disconnect" button is not working on Sony Xperia after a period of time
* [https://github.com/mozilla-mobile/fenix/issues/22315 22315] - [Bug] Inconsistent behaviour when opening multiple items in a new tab from history compared to bookmarks
* [https://github.com/mozilla-mobile/fenix/issues/18900 18900] - [Bug] When reopening a closed page
* [https://github.com/mozilla-mobile/fenix/issues/17523 17523] - [Bug] The Recently closed tabs counter is not updated before opening the list
* [https://github.com/mozilla-mobile/fenix/issues/19308 19308] - [Bug] Page thumbnail is no longer loaded after restoring the tab using "Undo" button
* [https://github.com/mozilla-mobile/fenix/issues/20811 20811] - [Bug] Tabs tray synced tabs "Sign in to sync" button size inconsistency
* [https://github.com/mozilla-mobile/fenix/issues/20812 20812] - [Bug] Tabs tray "Sync" button shouldn't be displayed if the user isn't signed in to sync or needs to reconnect to sync
* [https://github.com/mozilla-mobile/fenix/issues/16820 16820] - [Bug] Unable to play certain videos on the page due to unsupported video format
* [https://github.com/mozilla-mobile/fenix/issues/20434 20434] - [Bug] Media notifications are blank when the user starts/pauses the media from it
* [https://github.com/mozilla-mobile/fenix/issues/22310 22310] - [Bug] Collections - Tapping on "Deselect all" doesn't change the state for tabs previously selected
* [https://github.com/mozilla-mobile/fenix/issues/18702 18702] - [Bug] No snackbar is displayed when adding new tab to a collection
* [https://github.com/mozilla-mobile/fenix/issues/2725 2725] - [Bug] Undo snackbar is not displayed when removing a tab from a collection
* [https://github.com/mozilla-mobile/fenix/issues/13177 13177] - [Bug] Strange Tab in Collections Items Behavior When Deleting Multiple Tabs
* [https://github.com/mozilla-mobile/fenix/issues/23670 23670] - [Bug] The previously deleted tabs are restored when the collection is restored
* [https://github.com/mozilla-mobile/fenix/issues/20391 20391] - [Bug] Empty collection can be created
* [https://github.com/mozilla-mobile/fenix/issues/16685 16685] - [Bug] Tab selection checkmark disappears after background/resume
* [https://github.com/mozilla-mobile/fenix/issues/7230 7230] - [Bug] Option to open external links with private Firefox missing in the new version
* [https://github.com/mozilla-mobile/fenix/issues/7996 7996] - [Bug] Private mode doesn't play nicely with sites added to home screen
* [https://github.com/mozilla-mobile/fenix/issues/8480 8480] - [Bug] Pocket Top Articles top site is present for locales different than EN
* [https://bugzilla.mozilla.org/show_bug.cgi?id=1646515 1646515] - Copying a styled `<table>` to the clipboard drops style
* [https://bugzilla.mozilla.org/show_bug.cgi?id=1640893 1640893] - Colors and fonts aren't kept when selection was made in browser and pasted in Google Sheets app
* [https://github.com/mozilla-mobile/fenix/issues/9713 9713] - [Bug] Find in page finds something even after erasing query
* [https://github.com/mozilla-mobile/fenix/issues/23535 23535] - [Bug]: Reader view icon flickers on scroll
* [https://github.com/mozilla-mobile/fenix/issues/16602 16602] - [Bug] Fenix thinks that its reader mode is insecure

Latest revision as of 04:55, 23 March 2022

Fenix 98.3.0 RC | Fenix 99.0.0 Beta 1 | Fenix 99.0.0 Beta 2


Firefox 99.0.0 Beta 1 Test Plan

Full Functional & UI tests

QA Task Person/Group
Softvision Alternating

QA Assignment

Assigned Build type Device Completed Results
Delia Pop ARM Motorola Moto G30 (Android 11) March 10th, 2022 Pass
Andrei Jolțan ARM OnePlus A3 (Android 6.0.1) March 10th, 2022 Pass
Laurentiu Apahidean ARM Huawei Media Pad M3 (Android 7) March 10th, 2022 Pass
Laurentiu Apahidean ARM Samsung S10E (Android 10) March 10th, 2022 Pass
Sorina Florean ARM Sony Xperia (Android 6.0.1) March 10th, 2022 Pass


Full Functional and UI Tests

https://testrail.stage.mozaws.net/index.php?/plans/view/54619

Tablets

Phones

Telemetry

Bug verification

All March 10th, 2022 Done
  • 23644 - Wallpapers do not switch their version based on orientation when changed - ✅ Verified as fixed on Nightly and Beta 99.0.0-beta.1
  • 23662 - Wallpaper settings screen should be scrollable - ✅ Verified as fixed on Nightly and Beta 99.0.0-beta.1
  • 23894 [Bug]: History is truncated if FeatureFlag.historyImprovementFeatures is turned on - ✅ Verified as fixed on Nightly and Beta 99.0.0-beta.1
  • 23399 - [Telemetry] Multi-select on tabs tray - ✅ Verified as fixed on Nightly and Beta 99.0.0-beta.1

Issues

New issues

Major:

Other:

  • 24162 -[Bug]: Pages are not displayed in desktop mode if the toggle was previously enabled
  • 24165 -[Bug]: Search groups not displayed under Jump Back in section on Sony Xperia
  • 24163 - [Bug]: Improper transition for "Through provoking stories" when changing the orientation
  • 24187 - [Bug]: Multiple Inactive Tabs CFRs are displayed after background foreground
  • 24188 - [Bug]: Placeholder displayed instead of product name in Inactive Tabs auto-close prompt
  • 24186 - [Bug]: Default top sites can be re-added to the top sites list

Known issues

Major:

  • 22486 - History UI deletion of items is very buggy

Other:

  • 23672 - [Bug]: Screen is flickering when switching the ETP toggle from on to off
  • 7907 - ETP doesn't work on a quick first load on first run
  • 18445 - [Bug] Clicking "use precise location" in google search results doesn't work
  • 11589 - [Bug] Force closing Fenix after disabling an Add-on uninstalls it
  • 14939 - [Bug]White "Run in private browsing" icon
  • 12661 - [Feature request] Add-ons sub-menu overlay should not disappear after rotation
  • 12897 - [Bug] YouTube High Definition add-on: Video can't be muted on some devices
  • 15627 - [Bug] Tomato Clock "Stats" are opened in the background
  • 12079 - [Bug]Run in Private browsing toggle state lost after force closing Fenix
  • 9196 - [Bug]Add-ons uninstall confirmation snackbar covers the nav bar
  • 22062 - [Bug]: Download dialog does not decode multibyte file name
  • 15069 - [Bug][downloads] "Try again" doesn't work after the connection is reestablished
  • 17716 - [Bug] can not downloads images from Pixiv anymore
  • 20848 - Downloaded items can be deleted individually in multiselect mode
  • 20280 - [Bug] Youtube autoplay leads to non-fullscreen picture in picture (PiP) mode
  • 9910 - Display video in full-screen when returning from PiP mode
  • 10319 - [Bug] Tapping a media notification from a PWA should open the PWA
  • 13123 - [Bug] Missing Fenix Notification for Myntra TWA in android taskbar
  • 8761 - [Bug] Open in Fenix from a PWA custom tab, replaces the PWA with Fenix
  • 8966 - [Bug] Share icon in custom PWA toolbar has wrong color
  • 10560 - [Bug] [PWA] "Add to Home screen" confirmation dialog isn't displayed on certain devices
  • 24133 -[Bug]: Improper flicker displayed when switching between toolbar cards in the Onboarding screen
  • 23064 -[Bug]: "Jump back in" tabs are not visible on homescreen
  • 16128 -[Bug] "Font size" option is aligned to the left on tablets
  • 23860 -[Bug]: Incorrect tab number appears for a moment on swipe
  • 24134 - [Bug]: Improper flicker displayed on engine pictogram and cursor when tapping the URL bar
  • 23174 - [Bug]: Estimated reading time and photo are missing from some stories when "quick-reads" topic is selected
  • 24132 - [Bug]: Jump back in thumbnail image is not displayed sometimes
  • 24106 - [Bug]: A white/grey flicker is displayed for a split second while the website loads or when switching tabs
  • 20810 - [Bug]: If no tab is selected the "Bookmark" and "Close" options from the ⋮ "more options" menu shouldn't be available
  • 22317 - [Bug]: Inconsistent behaviour when opening multiple items in a new tab from history compared to bookmarks
  • 9323 - [Bug]The microphone icon for widget is not displayed on 2x1 size
  • 15996 - [Bug] Search widget is light with dark theme
  • 23532 - [Bug]: Add search engine - Clear icon is not displayed when the user starts typing in fields
  • 17431 - [Bug] Some strings provide search suggestions
  • 22129 - [Bug]: Refined search in result page may be added to wrong search group
  • 22763 - [Bug]: Searches originated from the same search term are not grouped under the term used
  • 22765 - [Bug]: Search term groupings don't disappear after 14 days
  • 22313 - [Bug]: Incorrect link saved for the original search results
  • 22158 - [Bug]: History/Home Search Group tabs created from Google are duplicated
  • 21960 - [Bug]: Disabling "Zoom on all websites" will not reset zoom level on certain webpages until refreshing
  • 21498 - [Bug]: Zooming & scrolling some pages, displays the pages' toolbar dynamic
  • 18694 - [Bug] The dot from the scale overlaps the percentage number
  • 23212 - [Bug]: Deleting a saved login, the account is still displayed on the list
  • 23214 - [Bug]: No success pop-up/ snackbar is displayed after adding manually a login
  • 21065 - [Bug] Permissions in private tabs are not persitent accross the same session.
  • 9773 - [User Story] 3rd party password manager apps support
  • 22012 - [Bug]: Inactive tabs section turns "incognito" dark after returning from private tab
  • 23671 - [Bug]: the same page can be added to bookmarks from tabs tray multiple time (no snackbar/ message is displayed informing that the page is already a bookmark)
  • 21351 -[Bug]: "Always start on home" is not applicable when Fenix is set as device assistant.
  • 18983 -[Bug] Unable to choose a different login after picking a wrong one
  • 24131 - [Bug]: "Disconnect" button is not working on Sony Xperia after a period of time
  • 22315 - [Bug] Inconsistent behaviour when opening multiple items in a new tab from history compared to bookmarks
  • 18900 - [Bug] When reopening a closed page
  • 17523 - [Bug] The Recently closed tabs counter is not updated before opening the list
  • 19308 - [Bug] Page thumbnail is no longer loaded after restoring the tab using "Undo" button
  • 20811 - [Bug] Tabs tray synced tabs "Sign in to sync" button size inconsistency
  • 20812 - [Bug] Tabs tray "Sync" button shouldn't be displayed if the user isn't signed in to sync or needs to reconnect to sync
  • 16820 - [Bug] Unable to play certain videos on the page due to unsupported video format
  • 20434 - [Bug] Media notifications are blank when the user starts/pauses the media from it
  • 22310 - [Bug] Collections - Tapping on "Deselect all" doesn't change the state for tabs previously selected
  • 18702 - [Bug] No snackbar is displayed when adding new tab to a collection
  • 2725 - [Bug] Undo snackbar is not displayed when removing a tab from a collection
  • 13177 - [Bug] Strange Tab in Collections Items Behavior When Deleting Multiple Tabs
  • 23670 - [Bug] The previously deleted tabs are restored when the collection is restored
  • 20391 - [Bug] Empty collection can be created
  • 16685 - [Bug] Tab selection checkmark disappears after background/resume
  • 7230 - [Bug] Option to open external links with private Firefox missing in the new version
  • 7996 - [Bug] Private mode doesn't play nicely with sites added to home screen
  • 8480 - [Bug] Pocket Top Articles top site is present for locales different than EN
  • 1646515 - Copying a styled `` to the clipboard drops style
  • 1640893 - Colors and fonts aren't kept when selection was made in browser and pasted in Google Sheets app
  • 9713 - [Bug] Find in page finds something even after erasing query
  • 23535 - [Bug]: Reader view icon flickers on scroll
  • 16602 - [Bug] Fenix thinks that its reader mode is insecure
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Fenix/99.0.0/beta.1&oldid=1241369"