QA/Fenix/91.0.0/beta.1: Difference between revisions

From MozillaWiki
< QA
Jump to navigation Jump to search
No edit summary
 
(6 intermediate revisions by 4 users not shown)
Line 1: Line 1:
<small>« [[QA/Fenix/90.1.1/RC1 | Fenix 90.1.1 RC 1]] | [[QA/Fenix/91.0.0/beta.1 | Fenix 91.0.0 Beta 1]] | [[QA/Fenix/91.0.0/beta.2 | Fenix 91.0.0 Beta 2]]</small>
<small>« [[QA/Fenix/90.1.3/RC1 | Fenix RC 90.1.3 ]] | [[QA/Fenix/91.0.0/beta.1 | Fenix 91.0.0 Beta 1]] | [[QA/Fenix/91.0.0/beta.2 | Fenix 91.0.0 Beta 2]]</small>


= Firefox 91.0.0 Beta 1 Test Plan =
= Firefox 91.0.0 Beta 1 Test Plan =
Line 31: Line 31:
  | Huawei MediaPad M3 (Android 7.0)
  | Huawei MediaPad M3 (Android 7.0)
  | July 16th, 2021
  | July 16th, 2021
  |'''In Progress'''
  |'''Pass'''
  |-
  |-
  | Oana Horvath
  | Oana Horvath
Line 43: Line 43:
  | Samsung Galaxy S7 (Android 7)
  | Samsung Galaxy S7 (Android 7)
  | July 16th, 2021
  | July 16th, 2021
  |'''In Progress'''
  |'''Pass'''
  |-
  |-
  | Sorina Florean
  | Sorina Florean
Line 69: Line 69:


=== Tablets ===
=== Tablets ===
* https://testrail.stage.mozaws.net/index.php?/runs/view/45243
* https://testrail.stage.mozaws.net/index.php?/runs/view/45243&group_by=cases:section_id&group_order=asc&group_id=45740
=== Phones ===
=== Phones ===
* https://testrail.stage.mozaws.net/index.php?/runs/view/45244
* https://testrail.stage.mozaws.net/index.php?/runs/view/45244&group_by=cases:section_id&group_order=asc&group_id=45740
=== Telemetry ===
=== Telemetry ===
* https://testrail.stage.mozaws.net/index.php?/runs/view/45245
* https://testrail.stage.mozaws.net/index.php?/runs/view/45245&group_by=cases:section_id&group_order=asc&group_id=45537


=== Bug verification ===
=== Bug verification ===
Line 79: Line 79:
  |-  
  |-  
  | '''All'''
  | '''All'''
  | July 16th, 2021
  | 16th of July, 2021
  |'''Done'''
  | '''Done'''
|}  
|}  
</onlyinclude>
</onlyinclude>
* [https://github.com/mozilla-mobile/fenix/issues/18711 18711] - [Telemetry] Credit Card Autofill - '''✔️ Verified as fixed on both Nightly 6/2, and Beta 90.0.0-beta.1'''
* [https://github.com/mozilla-mobile/fenix/issues/19564 19564] - [Bug] Sync cards switch On and OFF from Credit cards is not announced - '''✔️ Verified as fixed on both Nightly 6/2, and Beta 90.0.0-beta.1'''
* [https://github.com/mozilla-mobile/fenix/issues/19638 19638] - [Bug] Name on card title is not displayed when trying to add a new card on landscape mode - '''✔️ Verified as fixed on both Nightly 6/2, and Beta 90.0.0-beta.1'''


== Issues ==
== Issues ==
=== New issues ===
=== New issues ===
Major:  
Major:  


Other:
Other:
* [https://github.com/mozilla-mobile/fenix/issues/20391 20391 - [Bug]: Empty collection can be created
* [https://github.com/mozilla-mobile/fenix/issues/20391 20391] - [Bug] Empty collection can be created
* [https://github.com/mozilla-mobile/fenix/issues/20392 20392] - [Bug]: Missing ✓ Check mark symbol when selecting: open tabs, history items, bookmarked items
* [https://github.com/mozilla-mobile/fenix/issues/20392 20392] - [Bug] Missing ✓ Check mark symbol when selecting: open tabs, history items, bookmarked items


=== Known issues ===
=== Known issues ===
Line 98: Line 100:


Other:
Other:
* [https://github.com/mozilla-mobile/fenix/issues/18694 18694] - [Bug] The dot from the scale overlaps the percentage number
*[https://github.com/mozilla-mobile/fenix/issues/1585 1585] - FNX-5118 ⁃ Share a tab group
* [https://github.com/mozilla-mobile/fenix/issues/16352 16352] - [Bug] URL panel reappears when scrolling down
*[https://github.com/mozilla-mobile/fenix/issues/2725 2725] - [Bug] Undo snackbar is not displayed when removing a tab from a collection
* [https://github.com/mozilla-mobile/fenix/issues/13833 13833] - [Bug] The opened tabs / bookmarks suggestions are displayed at the bottom of the search screen
*[https://github.com/mozilla-mobile/fenix/issues/2783 2783] - Add snackbar to collection deletion
* [https://github.com/mozilla-mobile/fenix/issues/10737 10737] - [Bug] Searching a language/saved password displays a misplaced "x"
*[https://github.com/mozilla-mobile/android-components/issues/3108 3108] - Add new safe browsing policies for Malware in iframe and Billing warning.
* [https://github.com/mozilla-mobile/fenix/issues/8670 8670] - Selected browser language should be on top of languages
*[https://github.com/mozilla-mobile/fenix/issues/4178 4178] - [Bug] Sharing multiple tabs to another browser, only opens 1 tab
* [https://github.com/mozilla-mobile/fenix/issues/15996 15996] - [Bug] Search widget is light with dark theme
*[https://github.com/mozilla-mobile/fenix/issues/5010 5010] - [Bug]Add undo option when deleting a bookmark from edit mode
* [https://github.com/mozilla-mobile/fenix/issues/10319 10319] - [Bug] Tapping a media notification from a PWA should open the PWA
*[https://github.com/mozilla-mobile/fenix/issues/5298 5298] - [Bug] The same page appears in the History section multiple times
* [https://github.com/mozilla-mobile/fenix/issues/10560 10560] - [Bug] [PWA] "Add to Home screen" confirmation dialog isn't displayed on certain devices
*[https://github.com/mozilla-mobile/fenix/issues/7230 7230] - [Bug] Option to open external links with private Firefox missing in the new version
* [https://github.com/mozilla-mobile/fenix/issues/18079 18079] - [Bug] The "play/pause" media control button's color is inconsistent when switching from normal to private and viceversa
*[https://github.com/mozilla-mobile/fenix/issues/7723 7723] - [Bug] The account sync doesn't start automatically when the app is brought to the foreground
* [https://github.com/mozilla-mobile/fenix/issues/18897 18897] - [Bug] Dynamic toolbar isn't working on yr.no timetable
*[https://github.com/mozilla-mobile/fenix/issues/7866 7866] - [Bug] Custom search engines do not provide search suggestions
* [https://github.com/mozilla-mobile/fenix/issues/16602 16602] - [Bug] Fenix thinks that its reader mode is insecure
*[https://github.com/mozilla-mobile/fenix/issues/7953 7953] - [Bug] Error 0/0 displayed when double tapping on Find in page toolbar
* [https://github.com/mozilla-mobile/fenix/issues/14567 14567] - [Bug] Reader mode fails to preserve scroll position across back/forward
*[https://github.com/mozilla-mobile/fenix/issues/7996 7996] - [Bug] Private mode doesn't play nicely with sites added to home screen
* [https://github.com/mozilla-mobile/fenix/issues/7953 7953] - [Bug] Error 0/0 displayed when double tapping on Find in page toolbar
*[https://github.com/mozilla-mobile/fenix/issues/8108 8108] - [Bug] The same site can be added multiple times to home screen
* [https://github.com/mozilla-mobile/fenix/issues/9713 9713] - [Bug] Find in page finds something even after erasing query
*[https://github.com/mozilla-mobile/fenix/issues/8480 8480] - [Bug] Pocket Top Articles top site is present for locales different than EN
* [https://github.com/mozilla-mobile/fenix/issues/20216 20216] - [Bug] “Find in page“ toolbar randomly disappears while searching certain web pages
*[https://github.com/mozilla-mobile/fenix/issues/8545 8545] - [Bug] Home screen scrolls when it doesn't need to
* [https://github.com/mozilla-mobile/fenix/issues/19363 19363] - [Bug] Performing a Search on selected text is failing the second time
*[https://github.com/mozilla-mobile/fenix/issues/8670 8670] - Selected browser language should be on top of languages
* [https://github.com/mozilla-mobile/android-components/issues/3108 3108] - Add new safe browsing policies for Malware in iframe and Billing warning
*[https://github.com/mozilla-mobile/fenix/issues/8729 8729] - [Bug] Add-ons - Both main and detailed descriptions don't follow the selected language
* [https://github.com/mozilla-mobile/fenix/issues/8480 8480] - [Bug] Pocket Top Articles top site is present for locales different than EN
*[https://github.com/mozilla-mobile/fenix/issues/8761 8761] - [Bug] Open in Fenix from a PWA custom tab, replaces the PWA with Fenix
* [https://github.com/mozilla-mobile/fenix/issues/8108 8108] - [Bug] The same site can be added multiple times to home screen
*[https://github.com/mozilla-mobile/fenix/issues/8966 8966] -[Bug] Share icon in custom PWA toolbar has wrong color
* [https://github.com/mozilla-mobile/fenix/issues/7996 7996] - [Bug] Private mode doesn't play nicely with sites added to home screen
*[https://github.com/mozilla-mobile/fenix/issues/9196 9196] - [Bug]Add-ons uninstall confirmation snackbar covers the nav bar
* [https://github.com/mozilla-mobile/fenix/issues/7230 7230] - [Bug] Option to open external links with private Firefox missing in the new version
*[https://github.com/mozilla-mobile/fenix/issues/9713 9713] - [Bug] Find in page finds something even after erasing query
* [https://github.com/mozilla-mobile/fenix/issues/2783 2783] - Add snackbar to collection deletion
*[https://github.com/mozilla-mobile/fenix/issues/9773 9773] - [User Story] 3rd party password manager apps support
* [https://github.com/mozilla-mobile/fenix/issues/4178 4178] - [Bug] Sharing multiple tabs to another browser, only opens 1 tab
*[https://github.com/mozilla-mobile/fenix/issues/9910 9910] - Display video in full-screen when returning from PiP mode
* [https://github.com/mozilla-mobile/fenix/issues/2725 2725] - [Bug] Undo snackbar is not displayed when removing a tab from a collection
*[https://github.com/mozilla-mobile/fenix/issues/9916 9916] - [Bug] PWA - The pwa icon's are displayed as white on device homescreen
* [https://github.com/mozilla-mobile/fenix/issues/13177 13177] - [Bug] Strange Tab in Collections Items Behavior When Deleting Multiple Tabs
*[https://github.com/mozilla-mobile/fenix/issues/10057 10057] - [Bug] Weird graphic glitches when using Dark Reader extension
* [https://github.com/mozilla-mobile/fenix/issues/16685 16685]- [Bug]Tab selection checkmark disappears after background/resume
*[https://github.com/mozilla-mobile/fenix/issues/10319 10319] - [Bug] Tapping a media notification from a PWA should open the PWA
* [https://github.com/mozilla-mobile/fenix/issues/17523 17523] - [Bug] The Recently closed tabs counter is not updated before opening the list
*[https://github.com/mozilla-mobile/fenix/issues/10555 10555] - [Bug][PiP] The video cannot be seen as the URL and website elements are displayed when a new video starts
* [https://github.com/mozilla-mobile/fenix/issues/8761 8761] - [Bug] Open in Fenix from a PWA custom tab, replaces the PWA with Fenix
*[https://github.com/mozilla-mobile/fenix/issues/10560 10560] - [Bug] [PWA] "Add to Home screen" confirmation dialog isn't displayed on certain devices
* [https://github.com/mozilla-mobile/fenix/issues/13123 13123] - [Bug] Missing Fenix Notification for Myntra TWA in android taskbar
*[https://github.com/mozilla-mobile/fenix/issues/10737 10737] - [Bug] Searching a language/saved password displays a misplaced "x"
* [https://github.com/mozilla-mobile/fenix/issues/9916 9916] - [Bug] PWA - The pwa icon's are displayed as white on device homescreen
*[https://github.com/mozilla-mobile/fenix/issues/11589 11589] - [Bug] Force closing Fenix after disabling an Add-on uninstalls it
* [https://github.com/mozilla-mobile/fenix/issues/10319 10319] - [Bug] Tapping a media notification from a PWA should open the PWA
*[https://github.com/mozilla-mobile/fenix/issues/13123 13123] - [Bug] Missing Fenix Notification for Myntra TWA in android taskbar
* [https://github.com/mozilla-mobile/fenix/issues/10560 10560] - [Bug] [PWA] "Add to Home screen" confirmation dialog isn't displayed on certain devices
*[https://github.com/mozilla-mobile/fenix/issues/13177 13177] - [Bug] Strange Tab in Collections Items Behavior When Deleting Multiple Tabs
* [https://github.com/mozilla-mobile/fenix/issues/8966 8966] - [Bug] Share icon in custom PWA toolbar has wrong color
*[https://github.com/mozilla-mobile/fenix/issues/13833 13833] - [Bug] The opened tabs / bookmarks suggestions are displayed at the bottom of the search screen
* [https://github.com/mozilla-mobile/fenix/issues/10555 10555] - [Bug][PiP] The video cannot be seen as the URL and website elements are displayed when a new video starts
*[https://github.com/mozilla-mobile/fenix/issues/14290 14290] - [Bug] Decremented open tabs value after deleting a tab while using the switch gesture
* [https://github.com/mozilla-mobile/fenix/issues/9910 9910] - Display video in full-screen when returning from PiP mode
*[https://github.com/mozilla-mobile/fenix/issues/14567 14567] - [Bug] Reader mode fails to preserve scroll position across back/forward
*[https://github.com/mozilla-mobile/fenix/issues/14939 14939] - [Bug]White "Run in private browsing" icon
*[https://github.com/mozilla-mobile/fenix/issues/15069 15069] - [Bug][downloads] "Try again" doesn't work after the connection is reestablished
*[https://github.com/mozilla-mobile/fenix/issues/15996 15996] - [Bug] Search widget is light with dark theme
*[https://github.com/mozilla-mobile/fenix/issues/16152 16152] - [Grid View] Tab titles should have dark background for dark theme
*[https://github.com/mozilla-mobile/fenix/issues/16602 16602] - [Bug] Fenix thinks that its reader mode is insecure
*[https://github.com/mozilla-mobile/fenix/issues/16685 16685] - [Bug]Tab selection checkmark disappears after background/resume
*[https://github.com/mozilla-mobile/fenix/issues/17431 17431] - [Bug] Some strings provide search suggestions
*[https://github.com/mozilla-mobile/fenix/issues/17523 17523] - [Bug] The Recently closed tabs counter is not updated before opening the list
*[https://github.com/mozilla-mobile/fenix/issues/18694 18694] - [Bug] The dot from the scale overlaps the percentage number
*[https://github.com/mozilla-mobile/fenix/issues/19189 19189] - [Bug] History not shared between TWA and the browser
*[https://github.com/mozilla-mobile/fenix/issues/19363 19363] - [Bug] Performing a Search on selected text is failing the second time
*[https://github.com/mozilla-mobile/fenix/issues/19760 19760] - [Bug] Improperly displayed open links in apps banner in landscape view
*[https://github.com/mozilla-mobile/fenix/issues/19766 19766] - [Bug] Search engine selection based on typed text shows default search engine
*[https://github.com/mozilla-mobile/fenix/issues/20216 20216] - [Bug] “Find in page“ toolbar randomly disappears while searching certain web pages
*[https://github.com/mozilla-mobile/fenix/issues/20292 20292] - [Bug] Several missing icons in all themes

Latest revision as of 07:53, 30 July 2021

«  Fenix RC 90.1.3 | Fenix 91.0.0 Beta 1 | Fenix 91.0.0 Beta 2

Firefox 91.0.0 Beta 1 Test Plan

Full Functional & UI tests

QA Task Person/Group
Softvision Alternating

QA Assignment

Assigned Build type Device Completed Results
Laurentiu Apahidean ARM Huawei MediaPad M3 (Android 7.0) July 16th, 2021 Pass
Oana Horvath ARM Pixel 2 (Android 9) July 16th, 2021 Pass
Bodea Andrei ARM Samsung Galaxy S7 (Android 7) July 16th, 2021 Pass
Sorina Florean ARM LG G7 Fit (Android 8.1) July 16th, 2021 Pass
Lorand Janos ARM Samsung Galaxy Tab 3 (Android 9) July 16th, 2021 Pass
Andrei Jolțan ARM OnePlus A3 (Android 6.0.1) July 16th, 2021 Pass


Full Functional and UI Tests

Tablets

Phones

Telemetry

Bug verification

All 16th of July, 2021 Done
  • 18711 - [Telemetry] Credit Card Autofill - ✔️ Verified as fixed on both Nightly 6/2, and Beta 90.0.0-beta.1
  • 19564 - [Bug] Sync cards switch On and OFF from Credit cards is not announced - ✔️ Verified as fixed on both Nightly 6/2, and Beta 90.0.0-beta.1
  • 19638 - [Bug] Name on card title is not displayed when trying to add a new card on landscape mode - ✔️ Verified as fixed on both Nightly 6/2, and Beta 90.0.0-beta.1

Issues

New issues

Major:

Other:

  • 20391 - [Bug] Empty collection can be created
  • 20392 - [Bug] Missing ✓ Check mark symbol when selecting: open tabs, history items, bookmarked items

Known issues

Major:

  • 20292 - [Bug] Several missing icons in all themes

Other:

  • 1585 - FNX-5118 ⁃ Share a tab group
  • 2725 - [Bug] Undo snackbar is not displayed when removing a tab from a collection
  • 2783 - Add snackbar to collection deletion
  • 3108 - Add new safe browsing policies for Malware in iframe and Billing warning.
  • 4178 - [Bug] Sharing multiple tabs to another browser, only opens 1 tab
  • 5010 - [Bug]Add undo option when deleting a bookmark from edit mode
  • 5298 - [Bug] The same page appears in the History section multiple times
  • 7230 - [Bug] Option to open external links with private Firefox missing in the new version
  • 7723 - [Bug] The account sync doesn't start automatically when the app is brought to the foreground
  • 7866 - [Bug] Custom search engines do not provide search suggestions
  • 7953 - [Bug] Error 0/0 displayed when double tapping on Find in page toolbar
  • 7996 - [Bug] Private mode doesn't play nicely with sites added to home screen
  • 8108 - [Bug] The same site can be added multiple times to home screen
  • 8480 - [Bug] Pocket Top Articles top site is present for locales different than EN
  • 8545 - [Bug] Home screen scrolls when it doesn't need to
  • 8670 - Selected browser language should be on top of languages
  • 8729 - [Bug] Add-ons - Both main and detailed descriptions don't follow the selected language
  • 8761 - [Bug] Open in Fenix from a PWA custom tab, replaces the PWA with Fenix
  • 8966 -[Bug] Share icon in custom PWA toolbar has wrong color
  • 9196 - [Bug]Add-ons uninstall confirmation snackbar covers the nav bar
  • 9713 - [Bug] Find in page finds something even after erasing query
  • 9773 - [User Story] 3rd party password manager apps support
  • 9910 - Display video in full-screen when returning from PiP mode
  • 9916 - [Bug] PWA - The pwa icon's are displayed as white on device homescreen
  • 10057 - [Bug] Weird graphic glitches when using Dark Reader extension
  • 10319 - [Bug] Tapping a media notification from a PWA should open the PWA
  • 10555 - [Bug][PiP] The video cannot be seen as the URL and website elements are displayed when a new video starts
  • 10560 - [Bug] [PWA] "Add to Home screen" confirmation dialog isn't displayed on certain devices
  • 10737 - [Bug] Searching a language/saved password displays a misplaced "x"
  • 11589 - [Bug] Force closing Fenix after disabling an Add-on uninstalls it
  • 13123 - [Bug] Missing Fenix Notification for Myntra TWA in android taskbar
  • 13177 - [Bug] Strange Tab in Collections Items Behavior When Deleting Multiple Tabs
  • 13833 - [Bug] The opened tabs / bookmarks suggestions are displayed at the bottom of the search screen
  • 14290 - [Bug] Decremented open tabs value after deleting a tab while using the switch gesture
  • 14567 - [Bug] Reader mode fails to preserve scroll position across back/forward
  • 14939 - [Bug]White "Run in private browsing" icon
  • 15069 - [Bug][downloads] "Try again" doesn't work after the connection is reestablished
  • 15996 - [Bug] Search widget is light with dark theme
  • 16152 - [Grid View] Tab titles should have dark background for dark theme
  • 16602 - [Bug] Fenix thinks that its reader mode is insecure
  • 16685 - [Bug]Tab selection checkmark disappears after background/resume
  • 17431 - [Bug] Some strings provide search suggestions
  • 17523 - [Bug] The Recently closed tabs counter is not updated before opening the list
  • 18694 - [Bug] The dot from the scale overlaps the percentage number
  • 19189 - [Bug] History not shared between TWA and the browser
  • 19363 - [Bug] Performing a Search on selected text is failing the second time
  • 19760 - [Bug] Improperly displayed open links in apps banner in landscape view
  • 19766 - [Bug] Search engine selection based on typed text shows default search engine
  • 20216 - [Bug] “Find in page“ toolbar randomly disappears while searching certain web pages
  • 20292 - [Bug] Several missing icons in all themes