QA/Fenix/84.0.0/beta4: Difference between revisions

From MozillaWiki
< QA
Jump to navigation Jump to search
(Created page with "<small>« Fenix 84 Beta 3 | Fenix 84 Beta 4 </small> = Firefox Beta 84.0.0-beta.4 Test Plan = * Release date: December...")
 
No edit summary
 
(11 intermediate revisions by 6 users not shown)
Line 1: Line 1:
<small>« [[QA/Fenix/84.0.0/beta3| Fenix 84 Beta 3]] | [[QA/Fenix/84.0.0/beta4| Fenix 84 Beta 4]] </small>  
<small>« [[QA/Fenix/84.0.0/beta3| Fenix 84 Beta 3]] | [[QA/Fenix/84.0.0/beta4| Fenix 84 Beta 4]] | [[QA/Fenix/84.1.0/RC1 | Fenix 84.1.0 RC1]] </small>  


= Firefox Beta 84.0.0-beta.4 Test Plan =
= Firefox Beta 84.0.0-beta.4 Test Plan =
Line 31: Line 31:
  | Samsung Galaxy Tab S6 (Android 10)
  | Samsung Galaxy Tab S6 (Android 10)
  | December 8th, 2020
  | December 8th, 2020
  | '''In progress'''
  | '''Pass'''
  |-
  |-
  | Andrei Joltan
  | Andrei Joltan
Line 37: Line 37:
  | OnePlus A3 (Android 6.0.1)
  | OnePlus A3 (Android 6.0.1)
  | December 8th, 2020
  | December 8th, 2020
  | '''In progress'''
  | '''Pass'''
  |-
  |-
  | Laurentiu Apahidean
  | Laurentiu Apahidean
Line 43: Line 43:
  | Google Pixel 3 XL (Android 9)
  | Google Pixel 3 XL (Android 9)
  | December 8th, 2020
  | December 8th, 2020
  | '''In progress'''
  | '''Pass'''
  |-
  |-
  | Eliza Ciure
  | Eliza Ciure
Line 49: Line 49:
  | Motorola Moto G6 (Android 8)
  | Motorola Moto G6 (Android 8)
  | December 8th, 2020
  | December 8th, 2020
  | '''In progress'''
  | '''Pass'''
  |-
  |-
  | Sorina Florean
  | Sorina Florean
| x86
| Nexus 7(Android 5.1)
| December 8th, 2020
| '''Pass'''
|-
| Andrei Bodea
  | ARM
  | ARM
  |  
  | Google Pixel 4 XL (Android 11)
  | December 8th, 2020
  | December 8th, 2020
  | '''In progress'''
  | '''Pass'''
  |-
  |-
  |}  
  |}  
Line 70: Line 76:
  | All
  | All
  | December 8th, 2020
  | December 8th, 2020
  | '''In progress'''
  | '''Done'''
|}  
|}  
</onlyinclude>
</onlyinclude>


Issues that need QA:
Issues that need QA:
* [https://github.com/mozilla-mobile/fenix/issues/16397 16397] - [crash] kotlinx.coroutines.CompletionHandlerException at kotlinx.coroutines.JobSupport.completeStateFinalization(JobSupport.kt:15)
* [https://github.com/mozilla-mobile/fenix/issues/16397 16397] - [crash] kotlinx.coroutines.CompletionHandlerException at kotlinx.coroutines.JobSupport.completeStateFinalization(JobSupport.kt:15) - '''✔️ Verified as fixed on both the latest Nightly 201208 and 84.0.0-beta.4'''
* [https://github.com/mozilla-mobile/fenix/issues/16398 16398] - [Bug] The Disconnect button from Sign out is invisible - '''✔️ Verified as fixed on both the latest Nightly 201208 and 84.0.0-beta.4'''


== Issues ==
== Issues ==
=== New issues ===
=== New issues ===
Major:  
Major:  
* none


Other:
Other:
* none


=== Known issues ===
=== Known issues ===
Major:  
Major:  
 
* [https://github.com/mozilla-mobile/fenix/issues/9354 9354] - [Bug]Failed download after resuming it
* [https://github.com/mozilla-mobile/fenix/issues/16681 16681] - [Bug]New Tab FAB disappears after rotation
* [https://github.com/mozilla-mobile/fenix/issues/16685 16685]- [Bug]Tab selection checkmark disappears after background/resume
* [https://github.com/mozilla-mobile/fenix/issues/14284 14284] - [Bug]Firefox remains stuck in landscape view after opening a video in full screen mode




Other:
Other:
* [https://github.com/mozilla-mobile/fenix/issues/10010 10010] - [Bug] Botton Dynamic Navigation Bar does not hide with a single swipe and does it but leaves a white space with two rapid swipes on feedbin.com
* [https://github.com/mozilla-mobile/fenix/issues/10200 10200] - [Bug] Dynamic toolbar not displayed while the page is loading
* [https://github.com/mozilla-mobile/fenix/issues/12873 12873] - [Bug] No preview when swiping between tabs
* [https://github.com/mozilla-mobile/fenix/issues/12661 12661] - [Bug]Add-ons sub-menu overlay disappears after rotation
* [https://github.com/mozilla-mobile/fenix/issues/7953 7953] - [Bug] Error 0/0 displayed when double tapping on Find in page toolbar
* [https://github.com/mozilla-mobile/fenix/issues/9713 9713] - [Bug] Find in page finds something even after erasing query
* [https://github.com/mozilla-mobile/fenix/issues/10737 10737] - [Bug] Searching a language/saved password displays a misplaced "x"
* [https://github.com/mozilla-mobile/fenix/issues/8670 8670] - Selected browser language should be on top of languages
* [https://github.com/mozilla-mobile/fenix/issues/12854 12854] - [Bug] Blocking tracking content only in private tabs shows ETP off on normal tabs
* [https://github.com/mozilla-mobile/fenix/issues/10475 10475] - [Bug] Delay in hiding the "Run in private browsing" for the HTTS Everywhere Add-on
* [https://github.com/mozilla-mobile/fenix/issues/9196 9196] - [Bug]uBlock install/uninstall confirmation snackbar covers the nav bar
* [https://github.com/mozilla-mobile/fenix/issues/11589 11589] - [Bug] Force closing Fenix after disabling an Add-on uninstalls it
* [https://github.com/mozilla-mobile/fenix/issues/13522 13522] - [Bug] Tab history still visible after clearing all history
* [https://github.com/mozilla-mobile/fenix/issues/13833 13833] - [Bug] The opened tabs / bookmarks are displayed in the search screen at the bottom of the search screen
* [https://github.com/mozilla-mobile/fenix/issues/11819 11819] - [Bug] Mic displayed on widget when Show voice search option is disabled
* [https://github.com/mozilla-mobile/fenix/issues/15867 15867] - [Bug] Google is available in the "Add search engine" list when its also available in the "Default search engine" list
* [https://github.com/mozilla-mobile/fenix/issues/9323 9323] - [Bug]The microphone icon for widget is not displayed on 2x1 size
* [https://github.com/mozilla-mobile/fenix/issues/10740 10740] - [Bug]Tab Tray: Open Tabs media controls aren't displayed
* [https://github.com/mozilla-mobile/fenix/issues/4178 4178] - [Bug] Sharing multiple tabs to another browser, only opens 1 tab
* [https://github.com/mozilla-mobile/fenix/issues/11746 11746] - [Bug] Inconsistent FAB entry/exit animation on tabs tray
* [https://github.com/mozilla-mobile/fenix/issues/16152 16152] - [Grid View] Tab titles should have dark background for dark theme
* [https://github.com/mozilla-mobile/fenix/issues/8716 8716] - [Bug] Private custom tab opened when signing in to sync records history
* [https://github.com/mozilla-mobile/fenix/issues/12668 12668] - [Bug] Close private tabs from lock-screen while media is playing leaves an empty notification
* [https://github.com/mozilla-mobile/fenix/issues/4147 4147] - [Bug]Vimeo Cookie policy banner can't be dismissed
* [https://github.com/mozilla-mobile/fenix/issues/4375 4375] - [Bug]Mute/Unmute a video displays a white/grey rectangle over the volume bar
* [https://github.com/mozilla-mobile/fenix/issues/8456 8456] - [Bug] distorted audio while playing video at higher speed
* [https://github.com/mozilla-mobile/fenix/issues/15414 15414] - [Bug]Improperly displayed and unusable "Cast to" button on Rockfm.ro
* [https://github.com/mozilla-mobile/fenix/issues/4793 4793] - [Bug] Soundcloud: Audio plays without media notification showing
* [https://github.com/mozilla-mobile/fenix/issues/5133 5133] - [Bug] Phone goes to sleep while audio is playing
* [https://github.com/mozilla-mobile/fenix/issues/13389 13389] - [Bug] Private browsing homescreen displayed when tapping "View" after creating a collection from tabs tray
* [https://github.com/mozilla-mobile/fenix/issues/13036 13036] - [Bug] Reader Mode -> Save To collection saves the moz extension link
* [https://github.com/mozilla-mobile/fenix/issues/12152 12152] - [Bug]Improperly displayed collections overlay after rotation
* [https://github.com/mozilla-mobile/fenix/issues/15388 15388] - [Bug] "Collection saved!" snackbar is displayed when adding new tab to a collection
* [https://github.com/mozilla-mobile/fenix/issues/2725 2725] - [Bug] Undo snackbar is not displayed when removing a tab from a collection
* [https://github.com/mozilla-mobile/fenix/issues/2783 2783] - Add snackbar to collection deletion
* [https://github.com/mozilla-mobile/fenix/issues/11699 11699] - [Bug] Can't access shortcut sites from device's home screen when saved in reader mode
* [https://github.com/mozilla-mobile/fenix/issues/7996 7996] - [Bug] Private mode doesn't play nicely with sites added to home screen
* [https://github.com/mozilla-mobile/fenix/issues/8843 8843] - [Bug] Address not found page text doesn't show without JavaScript
* [https://github.com/mozilla-mobile/android-components/issues/3108 3108] - Add new safe browsing policies for Malware in iframe and Billing warning
* [https://github.com/mozilla-mobile/fenix/issues/12982 12982] - [Bug] Keyboard does not show after switching to a private tab and back
* [https://github.com/mozilla-mobile/fenix/issues/15498 15498] - [Bug] Clicking on Reader mode just refreshes the page on whatsapp.com/features
* [https://github.com/mozilla-mobile/fenix/issues/14567 14567] - [Bug] Reader mode fails to preserve scroll position across back/forward
* [https://github.com/mozilla-mobile/fenix/issues/13162 13162] - [Bug] Account not displayed in Settings after turning on sync
* [https://github.com/mozilla-mobile/fenix/issues/8388 8388] - [Bug]Improperly displayed ⋮ Main menu (3dot menu) overlay in landscape mode
* [https://github.com/mozilla-mobile/fenix/issues/8964 8964] - [Bug] Floating custom tabs ⋮ Main menu (3dot menu) overlay after rotation
* [https://github.com/mozilla-mobile/fenix/issues/8761 8761] - [Bug] Open in Fenix from a PWA custom tab, replaces the PWA with Fenix
* [https://github.com/mozilla-mobile/fenix/issues/8966 8966] - [Bug] Share icon in custom PWA toolbar has wrong color
* [https://github.com/mozilla-mobile/fenix/issues/10560 10560] - [Bug] [PWA] "Add to Home screen" confirmation dialog isn't displayed on certain devices
* [https://github.com/mozilla-mobile/fenix/issues/9916 9916] - [Bug] PWA - The pwa icon's are displayed as white on device homescreen
* [https://github.com/mozilla-mobile/fenix/issues/10319 10319] - [Bug] Tapping a media notification from a PWA should open the PWA
* [https://github.com/mozilla-mobile/fenix/issues/9910 9910] - Display video in full-screen when returning from PiP mode
* [https://github.com/mozilla-mobile/fenix/issues/16726 16726] - [Bug] Keyboard is triggered when changing the theme or the position of the toolbar on onboarding
* [https://github.com/mozilla-mobile/fenix/issues/10428 10428] - [Bug] Cannot open ZIP file after downloading from Fenix
* [https://github.com/mozilla-mobile/fenix/issues/12155 12155] - [Bug]System media notification and Tab view media state displayed on www.dailymotion.com/us without any media being actually played
* [https://github.com/mozilla-mobile/fenix/issues/15996 15996] - [Bug] Search widget is light with dark theme on API version 28/Android 9
* [https://github.com/mozilla-mobile/fenix/issues/16684 16684] - [Bug] [L10n] "Select tabs" from Tabs Tray is not translated in many languages
* [https://github.com/mozilla-mobile/fenix/issues/14290 14290] - [Bug]Decremented open tabs value after deleting a tab while using the switch gesture
* [https://github.com/mozilla-mobile/fenix/issues/12848 12848] - [Bug] No tracking protection icon shown after clicking on "report site issue"

Latest revision as of 06:30, 9 December 2020

«  Fenix 84 Beta 3 | Fenix 84 Beta 4 | Fenix 84.1.0 RC1

Firefox Beta 84.0.0-beta.4 Test Plan

Full functional & UI tests

QA Task Person/Group
Softvision Alternating

QA Assignment

Assigned Build type Device Completed Results
Mirabela Lobontiu ARM 64 Samsung Galaxy Tab S6 (Android 10) December 8th, 2020 Pass
Andrei Joltan ARM OnePlus A3 (Android 6.0.1) December 8th, 2020 Pass
Laurentiu Apahidean ARM Google Pixel 3 XL (Android 9) December 8th, 2020 Pass
Eliza Ciure ARM Motorola Moto G6 (Android 8) December 8th, 2020 Pass
Sorina Florean x86 Nexus 7(Android 5.1) December 8th, 2020 Pass
Andrei Bodea ARM Google Pixel 4 XL (Android 11) December 8th, 2020 Pass


Results

Smoke Tests

Bug verification

All December 8th, 2020 Done


Issues that need QA:

  • 16397 - [crash] kotlinx.coroutines.CompletionHandlerException at kotlinx.coroutines.JobSupport.completeStateFinalization(JobSupport.kt:15) - ✔️ Verified as fixed on both the latest Nightly 201208 and 84.0.0-beta.4
  • 16398 - [Bug] The Disconnect button from Sign out is invisible - ✔️ Verified as fixed on both the latest Nightly 201208 and 84.0.0-beta.4

Issues

New issues

Major:

  • none

Other:

  • none

Known issues

Major:

  • 9354 - [Bug]Failed download after resuming it
  • 16681 - [Bug]New Tab FAB disappears after rotation
  • 16685- [Bug]Tab selection checkmark disappears after background/resume
  • 14284 - [Bug]Firefox remains stuck in landscape view after opening a video in full screen mode


Other:

  • 10010 - [Bug] Botton Dynamic Navigation Bar does not hide with a single swipe and does it but leaves a white space with two rapid swipes on feedbin.com
  • 10200 - [Bug] Dynamic toolbar not displayed while the page is loading
  • 12873 - [Bug] No preview when swiping between tabs
  • 12661 - [Bug]Add-ons sub-menu overlay disappears after rotation
  • 7953 - [Bug] Error 0/0 displayed when double tapping on Find in page toolbar
  • 9713 - [Bug] Find in page finds something even after erasing query
  • 10737 - [Bug] Searching a language/saved password displays a misplaced "x"
  • 8670 - Selected browser language should be on top of languages
  • 12854 - [Bug] Blocking tracking content only in private tabs shows ETP off on normal tabs
  • 10475 - [Bug] Delay in hiding the "Run in private browsing" for the HTTS Everywhere Add-on
  • 9196 - [Bug]uBlock install/uninstall confirmation snackbar covers the nav bar
  • 11589 - [Bug] Force closing Fenix after disabling an Add-on uninstalls it
  • 13522 - [Bug] Tab history still visible after clearing all history
  • 13833 - [Bug] The opened tabs / bookmarks are displayed in the search screen at the bottom of the search screen
  • 11819 - [Bug] Mic displayed on widget when Show voice search option is disabled
  • 15867 - [Bug] Google is available in the "Add search engine" list when its also available in the "Default search engine" list
  • 9323 - [Bug]The microphone icon for widget is not displayed on 2x1 size
  • 10740 - [Bug]Tab Tray: Open Tabs media controls aren't displayed
  • 4178 - [Bug] Sharing multiple tabs to another browser, only opens 1 tab
  • 11746 - [Bug] Inconsistent FAB entry/exit animation on tabs tray
  • 16152 - [Grid View] Tab titles should have dark background for dark theme
  • 8716 - [Bug] Private custom tab opened when signing in to sync records history
  • 12668 - [Bug] Close private tabs from lock-screen while media is playing leaves an empty notification
  • 4147 - [Bug]Vimeo Cookie policy banner can't be dismissed
  • 4375 - [Bug]Mute/Unmute a video displays a white/grey rectangle over the volume bar
  • 8456 - [Bug] distorted audio while playing video at higher speed
  • 15414 - [Bug]Improperly displayed and unusable "Cast to" button on Rockfm.ro
  • 4793 - [Bug] Soundcloud: Audio plays without media notification showing
  • 5133 - [Bug] Phone goes to sleep while audio is playing
  • 13389 - [Bug] Private browsing homescreen displayed when tapping "View" after creating a collection from tabs tray
  • 13036 - [Bug] Reader Mode -> Save To collection saves the moz extension link
  • 12152 - [Bug]Improperly displayed collections overlay after rotation
  • 15388 - [Bug] "Collection saved!" snackbar is displayed when adding new tab to a collection
  • 2725 - [Bug] Undo snackbar is not displayed when removing a tab from a collection
  • 2783 - Add snackbar to collection deletion
  • 11699 - [Bug] Can't access shortcut sites from device's home screen when saved in reader mode
  • 7996 - [Bug] Private mode doesn't play nicely with sites added to home screen
  • 8843 - [Bug] Address not found page text doesn't show without JavaScript
  • 3108 - Add new safe browsing policies for Malware in iframe and Billing warning
  • 12982 - [Bug] Keyboard does not show after switching to a private tab and back
  • 15498 - [Bug] Clicking on Reader mode just refreshes the page on whatsapp.com/features
  • 14567 - [Bug] Reader mode fails to preserve scroll position across back/forward
  • 13162 - [Bug] Account not displayed in Settings after turning on sync
  • 8388 - [Bug]Improperly displayed ⋮ Main menu (3dot menu) overlay in landscape mode
  • 8964 - [Bug] Floating custom tabs ⋮ Main menu (3dot menu) overlay after rotation
  • 8761 - [Bug] Open in Fenix from a PWA custom tab, replaces the PWA with Fenix
  • 8966 - [Bug] Share icon in custom PWA toolbar has wrong color
  • 10560 - [Bug] [PWA] "Add to Home screen" confirmation dialog isn't displayed on certain devices
  • 9916 - [Bug] PWA - The pwa icon's are displayed as white on device homescreen
  • 10319 - [Bug] Tapping a media notification from a PWA should open the PWA
  • 9910 - Display video in full-screen when returning from PiP mode
  • 16726 - [Bug] Keyboard is triggered when changing the theme or the position of the toolbar on onboarding
  • 10428 - [Bug] Cannot open ZIP file after downloading from Fenix
  • 12155 - [Bug]System media notification and Tab view media state displayed on www.dailymotion.com/us without any media being actually played
  • 15996 - [Bug] Search widget is light with dark theme on API version 28/Android 9
  • 16684 - [Bug] [L10n] "Select tabs" from Tabs Tray is not translated in many languages
  • 14290 - [Bug]Decremented open tabs value after deleting a tab while using the switch gesture
  • 12848 - [Bug] No tracking protection icon shown after clicking on "report site issue"