QA/Fenix/87.0.0/beta3: Difference between revisions

From MozillaWiki
< QA
Jump to navigation Jump to search
No edit summary
 
(8 intermediate revisions by 4 users not shown)
Line 1: Line 1:
<small>« [[QA/Fenix/87.0.0/beta2 | Fenix 87.0.0 Beta 2]] | [[QA/Fenix/87.0.0/beta3 | Fenix 87.0.0 Beta 3]] </small>  
<small>« [[QA/Fenix/87.0.0/beta2 | Fenix 87.0.0 Beta 2]] | [[QA/Fenix/87.0.0/beta3 | Fenix 87.0.0 Beta 3]] | [[QA/Fenix/87.0.0/beta4 | Fenix 87.0.0 Beta 4]] </small>  


= Firefox 87.0.0 Beta 3 Test Plan =
= Firefox 87.0.0 Beta 3 Test Plan =
Line 5: Line 5:
* QA Contact: [mailto:ohorvath@mozilla.com Oana Horvath]; [mailto:sflorean@mozilla.com Sorina Florean]; [mailto:mozilla-mobile-qa@softvision.com SV QA team]
* QA Contact: [mailto:ohorvath@mozilla.com Oana Horvath]; [mailto:sflorean@mozilla.com Sorina Florean]; [mailto:mozilla-mobile-qa@softvision.com SV QA team]
* Slack: [https://mozilla.slack.com/archives/C5VPJJL9F SV Mobile QA Team]
* Slack: [https://mozilla.slack.com/archives/C5VPJJL9F SV Mobile QA Team]
* Build: [https://firefox-ci-tc.services.mozilla.com/tasks/index/mobile.v2.fenix.beta.latest Firefox 87.0.0 Beta 3]
* Build: [https://github.com/mozilla-mobile/fenix/releases/tag/v87.0.0-beta.3 Firefox 87.0.0 Beta 3]
* TestRail test plan: [https://testrail.stage.mozaws.net/index.php?/plans/view/40651 Test Plan]  
* TestRail test plan: [https://testrail.stage.mozaws.net/index.php?/plans/view/40869 Test Plan]  


== Smoke and sanity tests ==
== Smoke and sanity tests ==
Line 28: Line 28:
  |-
  |-
  | Mirabela Lobontiu
  | Mirabela Lobontiu
  | ARM
  | x86
  | emulator (Android )
  | emulator Nexus 9 (Android 9)
  | March 5th, 2021
  | March 5th, 2021
  | '''in progress'''
  | '''Pass'''
  |-
  |-
  | Laurentiu Apahidean
  | Laurentiu Apahidean
Line 37: Line 37:
  | Huawei MediaPad M3 (Android 7.0)
  | Huawei MediaPad M3 (Android 7.0)
  | March 5th, 2021
  | March 5th, 2021
  | '''in progress'''
  | '''Pass'''
  |-
  |-
  | Andrei Bodea
  | Andrei Bodea
Line 43: Line 43:
  | Google Pixel 4 XL (Android 11)
  | Google Pixel 4 XL (Android 11)
  | March 5th, 2021
  | March 5th, 2021
  | '''in progress'''
  | '''Pass'''
  |-
  |-
  | Andrei Jolțan
  | Andrei Jolțan
Line 49: Line 49:
  | OnePlus A3 (Android 6.0.1)
  | OnePlus A3 (Android 6.0.1)
  | March 5th, 2021
  | March 5th, 2021
  | '''in progress'''
  | '''Pass'''
|-
| Eliza Ciure
| ARM
| Samsung Galaxy Tab S3 (Android 8)
| March 5th, 2021
| '''in progress'''
  |-
  |-
  |}  
  |}  
Line 61: Line 55:


=== Smoke tests ===
=== Smoke tests ===
* https://testrail.stage.mozaws.net/index.php?/plans/view/40651
* https://testrail.stage.mozaws.net/index.php?/plans/view/40869


=== Bug verification ===
=== Bug verification ===
Line 71: Line 65:
|}  
|}  
</onlyinclude>
</onlyinclude>
*
* Update to AC 73.0.5


== Issues ==
== Issues ==
Line 82: Line 76:
=== Known issues ===
=== Known issues ===
Major:
Major:
 
* [https://bugzilla.mozilla.org/show_bug.cgi?id=1695138 1695138] - Crash in [@ OOM | small]
* [https://github.com/mozilla-mobile/fenix/issues/18312 18312] - [Bug] Saved logins page is visible when in Recent apps
* [https://github.com/mozilla-mobile/fenix/issues/17865 17865] - [Bug] Reader view gets re-rendered with default appearance settings after a while when switching tabs
* [https://github.com/mozilla-mobile/fenix/issues/17755 17755] - [Bug]Download Prompt isn't displayed again after dismissing it


Other:
Other:
*
* [https://github.com/mozilla-mobile/fenix/issues/14290 14290] - [Bug] Decremented open tabs value after deleting a tab while using the switch gesture
* [https://github.com/mozilla-mobile/fenix/issues/18079 18079] - [Bug] The "play/pause" media control button's color is inconsistent when switching from normal to private and viceversa
* [https://github.com/mozilla-mobile/fenix/issues/17633 17633] - [Bug] Changing the theme or the tollbar position in private onboarding jumps the focus to the top
* [https://github.com/mozilla-mobile/fenix/issues/10200 10200] - [Bug] Dynamic toolbar not displayed while the page is loading
* [https://github.com/mozilla-mobile/fenix/issues/7953 7953] - [Bug] Error 0/0 displayed when double tapping on Find in page toolbar
* [https://github.com/mozilla-mobile/fenix/issues/9713 9713] - [Bug] Find in page finds something even after erasing query
* [https://github.com/mozilla-mobile/fenix/issues/11367 11367] - [Bug] "Report Site Issue" icon is black in dark theme
* [https://github.com/mozilla-mobile/fenix/issues/10737 10737] - [Bug] Searching a language/saved password displays a misplaced "x"
* [https://github.com/mozilla-mobile/fenix/issues/8670 8670] - Selected browser language should be on top of languages
* [https://github.com/mozilla-mobile/fenix/issues/12854 12854] - [Bug] Blocking tracking content only in private tabs shows ETP off on normal tabs
* [https://github.com/mozilla-mobile/fenix/issues/11589 11589] - [Bug] Force closing Fenix after disabling an Add-on uninstalls it
* [https://github.com/mozilla-mobile/fenix/issues/9196 9196] - [Bug]uBlock install/uninstall confirmation snackbar covers the nav bar
* [https://github.com/mozilla-mobile/fenix/issues/16049 16049] - [Bug]Improperly displayed visual labling for tablet synced tabs
* [https://github.com/mozilla-mobile/fenix/issues/13833 13833] - [Bug] The opened tabs / bookmarks are displayed in the search screen at the bottom of the search screen
* [https://github.com/mozilla-mobile/fenix/issues/11819 11819] - [Bug] Mic displayed on widget when Show voice search option is disabled
* [https://github.com/mozilla-mobile/fenix/issues/9323 9323] - [Bug]The microphone icon for widget is not displayed on 2x1 size
* [https://github.com/mozilla-mobile/fenix/issues/17398 17398] - [Bug] Media play/pause state is displayed on multiple opened tabs in tabs tray
* [https://github.com/mozilla-mobile/fenix/issues/4178 4178] - [Bug] Sharing multiple tabs to another browser, only opens 1 tab
* [https://github.com/mozilla-mobile/fenix/issues/16152 16152] - [Grid View] Tab titles should have dark background for dark theme
* [https://github.com/mozilla-mobile/fenix/issues/12668 12668] - [Bug] Close private tabs from lock-screen while media is playing leaves an empty notification
* [https://github.com/mozilla-mobile/fenix/issues/4147 4147] - [Bug]Vimeo Cookie policy banner can't be dismissed
* [https://github.com/mozilla-mobile/fenix/issues/8456 8456] - [Bug] distorted audio while playing video at higher speed
* [https://github.com/mozilla-mobile/fenix/issues/5133 5133] - [Bug] Phone goes to sleep while audio is playing
* [https://github.com/mozilla-mobile/fenix/issues/15414 15414] - [Bug]Improperly displayed and unusable "Cast to" button on Rockfm.ro
* [https://github.com/mozilla-mobile/android-components/issues/9748 9748] - Streaming downloadable media does not have media notification
* [https://github.com/mozilla-mobile/fenix/issues/13389 13389] - [Bug] Private browsing homescreen displayed when tapping "View" after creating a collection from tabs
* [https://github.com/mozilla-mobile/fenix/issues/16685 16685]- [Bug]Tab selection checkmark disappears after background/resume
* [https://github.com/mozilla-mobile/fenix/issues/2783 2783] - Add snackbar to collection deletion
* [https://github.com/mozilla-mobile/android-components/issues/3108 3108] - Add new safe browsing policies for Malware in iframe and Billing warning
* [https://github.com/mozilla-mobile/fenix/issues/16602 16602] - [Bug] Fenix thinks that its reader mode is insecure
* [https://github.com/mozilla-mobile/fenix/issues/14567 14567] - [Bug] Reader mode fails to preserve scroll position across back/forward
* [https://github.com/mozilla-mobile/fenix/issues/9916 9916] - [Bug] PWA - The pwa icon's are displayed as white on device homescreen
* [https://github.com/mozilla-mobile/fenix/issues/10319 10319] - [Bug] Tapping a media notification from a PWA should open the PWA
* [https://github.com/mozilla-mobile/fenix/issues/10560 10560] - [Bug] [PWA] "Add to Home screen" confirmation dialog isn't displayed on certain devices
* [https://github.com/mozilla-mobile/fenix/issues/8966 8966] - [Bug] Share icon in custom PWA toolbar has wrong color
* [https://github.com/mozilla-mobile/fenix/issues/8388 8388] - [Bug]Improperly displayed ⋮ Main menu (3dot menu) overlay in landscape mode
* [https://github.com/mozilla-mobile/fenix/issues/8964 8964] - [Bug] Floating custom tabs ⋮ Main menu (3dot menu) overlay after rotation
* [https://github.com/mozilla-mobile/fenix/issues/16647 16647] - [Bug]Inconsistent display of the "Add private browsing shortcut" recommender after switch to landscape view
* [https://github.com/mozilla-mobile/fenix/issues/9910 9910] - Display video in full-screen when returning from PiP mode
* [https://github.com/mozilla-mobile/fenix/issues/10365 10365] - [UX] [Bug] Open in New Tab should insert tab below current tab rather than above

Latest revision as of 09:11, 9 March 2021

«  Fenix 87.0.0 Beta 2 | Fenix 87.0.0 Beta 3 | Fenix 87.0.0 Beta 4

Firefox 87.0.0 Beta 3 Test Plan

Smoke and sanity tests

QA Task Person/Group
Softvision Alternating

QA Assignment

Assigned Build type Device Completed Results
Mirabela Lobontiu x86 emulator Nexus 9 (Android 9) March 5th, 2021 Pass
Laurentiu Apahidean ARM Huawei MediaPad M3 (Android 7.0) March 5th, 2021 Pass
Andrei Bodea ARM Google Pixel 4 XL (Android 11) March 5th, 2021 Pass
Andrei Jolțan ARM OnePlus A3 (Android 6.0.1) March 5th, 2021 Pass


Smoke tests

Bug verification

N/A March 5th, 2021 N/A
  • Update to AC 73.0.5

Issues

New issues

Major:

Other:

Known issues

Major:

  • 1695138 - Crash in [@ OOM | small]
  • 18312 - [Bug] Saved logins page is visible when in Recent apps
  • 17865 - [Bug] Reader view gets re-rendered with default appearance settings after a while when switching tabs
  • 17755 - [Bug]Download Prompt isn't displayed again after dismissing it

Other:

  • 14290 - [Bug] Decremented open tabs value after deleting a tab while using the switch gesture
  • 18079 - [Bug] The "play/pause" media control button's color is inconsistent when switching from normal to private and viceversa
  • 17633 - [Bug] Changing the theme or the tollbar position in private onboarding jumps the focus to the top
  • 10200 - [Bug] Dynamic toolbar not displayed while the page is loading
  • 7953 - [Bug] Error 0/0 displayed when double tapping on Find in page toolbar
  • 9713 - [Bug] Find in page finds something even after erasing query
  • 11367 - [Bug] "Report Site Issue" icon is black in dark theme
  • 10737 - [Bug] Searching a language/saved password displays a misplaced "x"
  • 8670 - Selected browser language should be on top of languages
  • 12854 - [Bug] Blocking tracking content only in private tabs shows ETP off on normal tabs
  • 11589 - [Bug] Force closing Fenix after disabling an Add-on uninstalls it
  • 9196 - [Bug]uBlock install/uninstall confirmation snackbar covers the nav bar
  • 16049 - [Bug]Improperly displayed visual labling for tablet synced tabs
  • 13833 - [Bug] The opened tabs / bookmarks are displayed in the search screen at the bottom of the search screen
  • 11819 - [Bug] Mic displayed on widget when Show voice search option is disabled
  • 9323 - [Bug]The microphone icon for widget is not displayed on 2x1 size
  • 17398 - [Bug] Media play/pause state is displayed on multiple opened tabs in tabs tray
  • 4178 - [Bug] Sharing multiple tabs to another browser, only opens 1 tab
  • 16152 - [Grid View] Tab titles should have dark background for dark theme
  • 12668 - [Bug] Close private tabs from lock-screen while media is playing leaves an empty notification
  • 4147 - [Bug]Vimeo Cookie policy banner can't be dismissed
  • 8456 - [Bug] distorted audio while playing video at higher speed
  • 5133 - [Bug] Phone goes to sleep while audio is playing
  • 15414 - [Bug]Improperly displayed and unusable "Cast to" button on Rockfm.ro
  • 9748 - Streaming downloadable media does not have media notification
  • 13389 - [Bug] Private browsing homescreen displayed when tapping "View" after creating a collection from tabs
  • 16685- [Bug]Tab selection checkmark disappears after background/resume
  • 2783 - Add snackbar to collection deletion
  • 3108 - Add new safe browsing policies for Malware in iframe and Billing warning
  • 16602 - [Bug] Fenix thinks that its reader mode is insecure
  • 14567 - [Bug] Reader mode fails to preserve scroll position across back/forward
  • 9916 - [Bug] PWA - The pwa icon's are displayed as white on device homescreen
  • 10319 - [Bug] Tapping a media notification from a PWA should open the PWA
  • 10560 - [Bug] [PWA] "Add to Home screen" confirmation dialog isn't displayed on certain devices
  • 8966 - [Bug] Share icon in custom PWA toolbar has wrong color
  • 8388 - [Bug]Improperly displayed ⋮ Main menu (3dot menu) overlay in landscape mode
  • 8964 - [Bug] Floating custom tabs ⋮ Main menu (3dot menu) overlay after rotation
  • 16647 - [Bug]Inconsistent display of the "Add private browsing shortcut" recommender after switch to landscape view
  • 9910 - Display video in full-screen when returning from PiP mode
  • 10365 - [UX] [Bug] Open in New Tab should insert tab below current tab rather than above