QA/Fenix/79.1.0/beta.1: Difference between revisions

From MozillaWiki
< QA
Jump to navigation Jump to search
No edit summary
 
(14 intermediate revisions by 6 users not shown)
Line 1: Line 1:
<small>«[[QA/Fenix/79.0.0/RC1 | Fenix 79.0.0 RC1]]| [[QA/Fenix/79.1.0/beta.1 | Fenix 79.1.0 beta.1]]»</small>
<small>« [[QA/Fenix/79.0.4/RC1 | Fenix 79.0.4 RC1]] | [[QA/Fenix/79.1.0/beta.1 | Fenix 79.1.0 beta.1]] | [[QA/Fenix/80.0.0/beta.1 | Fenix 80.0.0 beta.1]]»</small>


= Firefox Beta 79.1.0-beta.1 Test Plan =
= Firefox Beta 79.1.0-beta.1 Test Plan =
* Release date: 23th of July, 2020
* Release date: 24th of July, 2020
* QA Contact: [mailto:ohorvath@mozilla.com Oana Horvath]; [mailto:fennec@softvision.ro SV QA team]
* QA Contact: [mailto:ohorvath@mozilla.com Oana Horvath]; [mailto:fennec@softvision.ro SV QA team]
* Slack: [https://mozilla.slack.com/messages/D58NA0CB0 Oana]; [https://mozilla.slack.com/archives/C5VPJJL9F SV Mobile QA Team]
* Slack: [https://mozilla.slack.com/messages/D58NA0CB0 Oana]; [https://mozilla.slack.com/archives/C5VPJJL9F SV Mobile QA Team]
Line 31: Line 31:
  | OnePlus A3 (Android 6.0.1)
  | OnePlus A3 (Android 6.0.1)
  | July 24th, 2020
  | July 24th, 2020
  | '''In Progress'''
  | '''Pass'''
  |-
  |-
  | Andrei Bodea
  | Andrei Bodea
Line 37: Line 37:
  | Google Pixel 4XL (Android 11)
  | Google Pixel 4XL (Android 11)
  | July 24th, 2020
  | July 24th, 2020
  | '''In Progress'''
  | '''Pass'''
  |-
  |-
  | Sorina Florean
  | Sorina Florean
Line 43: Line 43:
  | Huawei MediaPad M2 (Android 5.1.1)
  | Huawei MediaPad M2 (Android 5.1.1)
  | July 24th, 2020
  | July 24th, 2020
  | '''In Progress'''
  | '''Pass'''
  |-
  |-
  | Mirabela Lobontiu
  | Mirabela Lobontiu
Line 49: Line 49:
  | Samsung Galaxy Tab S6 (Android 9)
  | Samsung Galaxy Tab S6 (Android 9)
  | July 24th, 2020
  | July 24th, 2020
  | '''In Progress'''
  | '''Pass'''
  |-
  |-
  | Oana Horvath
  | Oana Horvath
Line 55: Line 55:
  | Nexus 6P (Android 8.1)
  | Nexus 6P (Android 8.1)
  | July 24th, 2020
  | July 24th, 2020
  | '''In Progress'''
  | '''Pass'''
  |-
  |-
  | Eliza Balazs
  | Eliza Balazs
Line 61: Line 61:
  | Samsung Galaxy Tab S3 (Android 8)
  | Samsung Galaxy Tab S3 (Android 8)
  | July 24th, 2020
  | July 24th, 2020
  | '''In Progress'''
  | '''Pass'''
  |-
  |-
  | Laurentiu Apahidean
  | Laurentiu Apahidean
Line 67: Line 67:
  | Huawei MediaPad M3 (Android 7.0)
  | Huawei MediaPad M3 (Android 7.0)
  | July 24th, 2020
  | July 24th, 2020
  | '''In Progress'''
  | '''Pass'''
  |-
  |-
  |}  
  |}  
Line 88: Line 88:
  | Everyone
  | Everyone
  | July 24th, 2020
  | July 24th, 2020
  | '''In Progress'''
  | '''Done'''
|}  
|}  
</onlyinclude>
</onlyinclude>
Line 94: Line 94:
Issues that need QA:
Issues that need QA:
* [https://github.com/mozilla-mobile/fenix/issues/12364 12364] - [Bug] Don't prompt to "Add to Homescreen" the first time you visit a PWA - '''❌ Partially fixed'''
* [https://github.com/mozilla-mobile/fenix/issues/12364 12364] - [Bug] Don't prompt to "Add to Homescreen" the first time you visit a PWA - '''❌ Partially fixed'''
* [https://github.com/mozilla-mobile/fenix/issues/11183 11183] - [Bug] The user is not redirected to home screen after the search widget is added (Discoverability Experiment) - '''❓ Can't trigger the search widget prompt'''
* [https://github.com/mozilla-mobile/fenix/issues/12433 12433] - [Bug] synced tab "pull to refresh" never gets re-enabled after encountering an account error - '''No confirmation if QA needed'''
* [https://github.com/mozilla-mobile/fenix/issues/12433 12433] - [Bug] synced tab "pull to refresh" never gets re-enabled after encountering an account error - '''❔ Confirmation if QA needed '''
* [https://github.com/mozilla-mobile/fenix/issues/12532 12532] - Align Settings -> Site permissions -> Sub-pages to 72dp keyline - '''❌ Not fixed yet'''
* [https://github.com/mozilla-mobile/fenix/issues/12532 12532] - Align Settings -> Site permissions -> Sub-pages to 72dp keyline - '''❔ Confirmation if QA needed '''
* [https://github.com/mozilla-mobile/fenix/issues/12600 12600] - [Bug] Leanplum event for installing addon gets tracked twice - '''❔ Confirmation if QA needed '''
* [https://github.com/mozilla-mobile/fenix/issues/10173 10173] - Edit logins - duplicates and save criteria - '''🕙 In progress'''


=== L10N ===
=== L10N ===
Line 105: Line 102:
{| class="wikitable" width=100%
{| class="wikitable" width=100%
  |-  
  |-  
  |  
  | Eliza Balazs
  | July 24th, 2020
  | July 24th, 2020
  | '''In Progress'''
  | '''Done'''
|}  
|}  
</onlyinclude>
</onlyinclude>
Line 123: Line 120:


Other:
Other:
* [https://github.com/mozilla-mobile/fenix/issues/9460 9460] - [Bug] "Firefox Search" not working in custom tabs
* [https://github.com/mozilla-mobile/fenix/issues/12498 12498]- [Bug] Some passwords are not auto-filling
* [https://github.com/mozilla-mobile/fenix/issues/12498 12498]- [Bug] Some passwords are not auto-filling
* [https://github.com/mozilla-mobile/fenix/issues/11903 11903] - [Bug] White almost invisible "close" and "share" icons in custom tabs when Fenix is always set to open tabs in a Private Browsing mode
* [https://github.com/mozilla-mobile/fenix/issues/11903 11903] - [Bug] White almost invisible "close" and "share" icons in custom tabs when Fenix is always set to open tabs in a Private Browsing mode
Line 179: Line 177:
* [https://github.com/mozilla-mobile/fenix/issues/7996 7996] - [Bug] Private mode doesn't play nicely with sites added to home screen
* [https://github.com/mozilla-mobile/fenix/issues/7996 7996] - [Bug] Private mode doesn't play nicely with sites added to home screen
* [https://github.com/mozilla-mobile/fenix/issues/7230 7230] - [Bug] Option to open external links with private Firefox missing in the new version
* [https://github.com/mozilla-mobile/fenix/issues/7230 7230] - [Bug] Option to open external links with private Firefox missing in the new version
* [https://github.com/mozilla-mobile/fenix/issues/3004 3004] - [Bug] Buggy behaviour on homescreen when expanding/collasping collections
* [https://github.com/mozilla-mobile/fenix/issues/2783 2783] - Add snackbar to collection deletion
* [https://github.com/mozilla-mobile/fenix/issues/2725 2725] - [Bug] Undo snackbar is not displayed when removing a tab from a collection
* [https://github.com/mozilla-mobile/fenix/issues/11646 11646] - [Bug] Synced tabs is not translated in all browser languages
* [https://github.com/mozilla-mobile/fenix/issues/9037 9037] - [Bug] Custom tab styling doesn't respect the "Open links in a private tab" setting
* [https://github.com/mozilla-mobile/fenix/issues/8582 8582] - [Bug] Sending tabs to multiple devices is not working without a forced sync
* [https://github.com/mozilla-mobile/fenix/issues/12197 12197] - [Bug][Synced tabs] Connected mobile devices aren't displayed if no tabs are opened
* [https://github.com/mozilla-mobile/fenix/issues/10319 10319] - [Bug] Tapping a media notification from a PWA should open the PWA
* [https://github.com/mozilla-mobile/fenix/issues/3511 3511] - [Bug] Website wykop.pl login page doesn't trigger Lockwise autofill
* [https://github.com/mozilla-mobile/fenix/issues/10922 10922] - [Bug] Avast is not working on Fenix for autofill
* [https://github.com/mozilla-mobile/fenix/issues/10628 10628] - [Bug] "mobile.twitter.com/login" is not loaded when opening it from Avast Password manager app
* [https://github.com/mozilla-mobile/fenix/issues/10621 10621] - [Bug] SafeInCloud is not working on Fenix for autofill
* [https://github.com/mozilla-mobile/fenix/issues/4205 4205] - [Bug] Lastpass showing mozilla credentials for website HTTP Basic Authentication box
* [https://github.com/mozilla-mobile/fenix/issues/10640 10640] - [Bug] Cannot autofill passwords using Enpass

Latest revision as of 08:00, 13 August 2020

«  Fenix 79.0.4 RC1 | Fenix 79.1.0 beta.1 | Fenix 80.0.0 beta.1»

Firefox Beta 79.1.0-beta.1 Test Plan

Full functional & UI tests

QA Task Person/Group
Softvision Alternating

QA Assignment

Assigned Build type Device Completed Results
Andrei Joltan ARM OnePlus A3 (Android 6.0.1) July 24th, 2020 Pass
Andrei Bodea ARM Google Pixel 4XL (Android 11) July 24th, 2020 Pass
Sorina Florean ARM Huawei MediaPad M2 (Android 5.1.1) July 24th, 2020 Pass
Mirabela Lobontiu ARM Samsung Galaxy Tab S6 (Android 9) July 24th, 2020 Pass
Oana Horvath x86 Nexus 6P (Android 8.1) July 24th, 2020 Pass
Eliza Balazs ARM Samsung Galaxy Tab S3 (Android 8) July 24th, 2020 Pass
Laurentiu Apahidean ARM Huawei MediaPad M3 (Android 7.0) July 24th, 2020 Pass


Results

Telemetry

Tablets

Phones

Bug verification

Everyone July 24th, 2020 Done


Issues that need QA:

  • 12364 - [Bug] Don't prompt to "Add to Homescreen" the first time you visit a PWA - ❌ Partially fixed
  • 12433 - [Bug] synced tab "pull to refresh" never gets re-enabled after encountering an account error - No confirmation if QA needed
  • 12532 - Align Settings -> Site permissions -> Sub-pages to 72dp keyline - ❌ Not fixed yet

L10N

Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.

Eliza Balazs July 24th, 2020 Done


Issues

New issues

Major:

Other:

  • 12850 - [Bug] "source": "UNKNOWN" for "name": "app_opened" and "name": "app_received_intent" event type pings
  • 12854 - [Bug] Blocking tracking content only in private tabs shows ETP off on normal tabs

Known issues

Major:

Other:

  • 9460 - [Bug] "Firefox Search" not working in custom tabs
  • 12498- [Bug] Some passwords are not auto-filling
  • 11903 - [Bug] White almost invisible "close" and "share" icons in custom tabs when Fenix is always set to open tabs in a Private Browsing mode
  • 7723 - [Bug] The account sync doesn't start automatically when the app is brought to the foreground
  • 10737 - [Bug] Searching a language/saved password displays a misplaced "x"
  • 9713 - [Bug] Find in page finds something even after erasing query
  • 7953 - [Bug] Error 0/0 displayed when double tapping on Find in page toolbar
  • 11367 - [Bug] "Report Site Issue" icon is black in dark theme
  • 10200 - [Bug] Dynamic toolbar not displayed while the page is loading
  • 1657 - [fxa-content-server] Canceled pairing from the mobile device should update automatically on the desktop side
  • 6521 - [Bug] Auto-sign in doesn't work on Beta
  • 11589 - [Bug] Force closing Fenix after disabling an Add-on uninstalls it
  • 12661 - [Bug]Add-ons sub-menu overlay disappears after rotation
  • 11367 - [Bug] "Report Site Issue" icon is black in dark theme
  • 6424 - [Bug] Add-on settings opened in a new tab everytime
  • 7417 - [Bug] “YouTube High Definition” misaligned and different size UI elements in settings page
  • 12079 - [Bug]Run in Private browsing toggle state lost after force closing Fenix
  • 10475 - [Bug] Delay in hiding the "Run in private browsing" for the HTTS Everywhere Add-on
  • 9196 - [Bug]uBlock install/uninstall confirmation snackbar covers the nav bar
  • 8729 - [Bug] Add-ons - Both main and detailed descriptions don't follow the selected language
  • 7531 - [Bug] downloads that require a user to be logged in to a website fail
  • 10428 - [Bug] Cannot open ZIP file after downloading from Fenix
  • 5010 - [Bug]Add undo option when deleting a bookmark from edit mode
  • 12083 - [Bug]Missing History and Bookmarks action bar after opening multiple items in new tabs
  • 9619 - [Bug][regression] Overflow menu is hidden just for the selected history item
  • 8567 - [Bug]Can't create new bookmarks folder due to #6974
  • 6975 - [Bug]Bookmarks folder can't be renamed (following #6974)
  • 6974 - [Bug]Current Bookmark folder shouldn't be displayed as a root folder option while editing
  • 6977 - [Bug]Deleted Bookmarks folder reappears after deleting it
  • 7866 - [Bug] Custom search engines do not provide search suggestions
  • 7491 - [Bug] adding startpage.com as a search engine does not show startpage favicon
  • 5298 - [Bug] The same page appears in the History section multiple times
  • 8571 - [Bug]History isn't sorted chronologically
  • 4178 - [Bug] Sharing multiple tabs to another browser, only opens 1 tab
  • 11819 - [Bug] Mic displayed on widget when Show voice search option is disabled
  • 9323 - [Bug]The microphone icon for widget is not displayed on 2x1 size
  • 11111 - [Bug] Tabs Tray New Tab + Button Back Navigation Feels Off
  • 11180 - [Bug]Tab Tray: Spot displayed on the "New tab" button
  • 11515 - [Bug] Open new tab via contextual menu after close - undo action deletes the re-opened tab
  • 11746 - [Bug] Inconsistent FAB entry/exit animation on tabs tray
  • 10986 - [Bug] [Tabs Tray] Undo close tab puts tab at the bottom of the list, rather than in-place
  • 10740 - [Bug]Tab Tray: Open Tabs media controls aren't displayed
  • 12155 - [Bug]System media notification and Tab view media state displayed on www.dailymotion.com/us without any media being actually played
  • 12585 - [Bug]Floating tabs tray overlay after rotation
  • 11860 - [Bug] Hide save tabs to collection when there is no tab
  • 12193 - [Bug]Close all tabs doesn't work properly
  • 10874 - [Bug] Tab tray "default" icon looks like a placeholder
  • 11733 - [Bug]Tabs Tray: Site preview are lost after resuming Fenix
  • 8716 - [Bug] Private custom tab opened when signing in to sync records history
  • 11851 - [Bug] Close last tab doesn't close tab tray
  • 12668 - [Bug] Close private tabs from lock-screen while media is playing leaves an empty notification
  • 12383 - [Bug]Deletion confirmation snackbar missing when closing all PB Open Tabs
  • 8480 - [Bug] Pocket Top Articles top site is present for locales different than EN
  • 12364 - [Bug] Don't prompt to "Add to Homescreen" the first time you visit a PWA
  • 12721 - [Bug] Tab counter is not updated when opening a tab from Custom tab
  • 7996 - [Bug] Private mode doesn't play nicely with sites added to home screen
  • 7230 - [Bug] Option to open external links with private Firefox missing in the new version
  • 3004 - [Bug] Buggy behaviour on homescreen when expanding/collasping collections
  • 2783 - Add snackbar to collection deletion
  • 2725 - [Bug] Undo snackbar is not displayed when removing a tab from a collection
  • 11646 - [Bug] Synced tabs is not translated in all browser languages
  • 9037 - [Bug] Custom tab styling doesn't respect the "Open links in a private tab" setting
  • 8582 - [Bug] Sending tabs to multiple devices is not working without a forced sync
  • 12197 - [Bug][Synced tabs] Connected mobile devices aren't displayed if no tabs are opened
  • 10319 - [Bug] Tapping a media notification from a PWA should open the PWA
  • 3511 - [Bug] Website wykop.pl login page doesn't trigger Lockwise autofill
  • 10922 - [Bug] Avast is not working on Fenix for autofill
  • 10628 - [Bug] "mobile.twitter.com/login" is not loaded when opening it from Avast Password manager app
  • 10621 - [Bug] SafeInCloud is not working on Fenix for autofill
  • 4205 - [Bug] Lastpass showing mozilla credentials for website HTTP Basic Authentication box
  • 10640 - [Bug] Cannot autofill passwords using Enpass