QA/Fenix/4/0.0/Beta.3/: Difference between revisions

From MozillaWiki
< QA
Jump to navigation Jump to search
No edit summary
 
(7 intermediate revisions by 3 users not shown)
Line 1: Line 1:
<small>« [[QA/Fenix/4/0.0/Beta.2/ | Fenix RC 4.0.0-beta.2]] | [[QA/Fenix/4/0.0/Beta.3/ | Fenix RC 4.0.0-beta.3]] »</small>
<small>« [[QA/Fenix/4/0.0/Beta.2/ | Fenix RC 4.0.0-beta.2]] | [[QA/Fenix/4/0.0/Beta.3/ | Fenix RC 4.0.0-beta.3]] | [[QA/Fenix/4/0.0/Beta.4/ | Fenix RC 4.0.0-beta.4]] »</small>


= Firefox Preview 4.0.0-beta.3 Test Plan =
= Firefox Preview 4.0.0-beta.3 Test Plan =
Line 57: Line 57:
  | Huawei P9 Lite (Android 7.0)
  | Huawei P9 Lite (Android 7.0)
  | March 4th, 2020
  | March 4th, 2020
  | '''in progress'''
  | '''PASS'''
  |}  
  |}  
</onlyinclude>
</onlyinclude>
Line 67: Line 67:
=== Phones ===
=== Phones ===
* https://testrail.stage.mozaws.net/index.php?/runs/view/26530 - OnePlus A3 (Android 6.0.1)
* https://testrail.stage.mozaws.net/index.php?/runs/view/26530 - OnePlus A3 (Android 6.0.1)
* https://testrail.stage.mozaws.net/index.php?/runs/view/26528 - Huawei P9 Lite (Android 7.0)
* https://testrail.stage.mozaws.net/index.php?/runs/view/26529 - Samsung Galaxy S10+ (Android 9)
* https://testrail.stage.mozaws.net/index.php?/runs/view/26529 - Samsung Galaxy S10+ (Android 9)


Line 78: Line 79:
  | Andrei Joltan
  | Andrei Joltan
  | March 4th, 2020
  | March 4th, 2020
  | '''in progress'''
  | '''Done'''
|}  
|}  
</onlyinclude>
</onlyinclude>
List of issues that needed QA:
List of issues that needed QA:
* [https://github.com/mozilla-mobile/fenix/issues/7344] - [Bug]Crash when trying to access Saved Logins for the second time while performing a Sync - Verified
* [https://github.com/mozilla-mobile/fenix/issues/7344 7344] - [Bug]Crash when trying to access Saved Logins for the second time while performing a Sync - Verified
* [https://github.com/mozilla-mobile/fenix/issues/8854 8854] - [Bug] LoginsStorageException: Using DatabaseLoginsStorage without unlocking first - Verified


=== L10N ===
=== L10N ===
Line 90: Line 92:
{| class="wikitable" width=100%
{| class="wikitable" width=100%
  |-  
  |-  
  |  
  | Oana Horvath
  | March 4th, 2020
  | March 4th, 2020
  | '''in progress'''
  | '''PASS'''
|}  
|}  
</onlyinclude>
</onlyinclude>
Line 102: Line 104:


Other:
Other:
* [https://github.com/mozilla-mobile/fenix/issues/8964 8964] - [Bug]Floating custom tabs ⋮ Main menu (3dot menu) overlay after rotation
* [https://github.com/mozilla-mobile/fenix/issues/8964 8964] - [Bug] Floating custom tabs ⋮ Main menu (3dot menu) overlay after rotation
* [https://github.com/mozilla-mobile/fenix/issues/8968 8968] - [Bug] Android 7 and lower: Keyboard doesn't hide when going to Settings
* [https://github.com/mozilla-mobile/fenix/issues/8970 8970] - [Bug]Distorted and zoomed in transition from Instagram to the home screen
* [https://github.com/mozilla-mobile/fenix/issues/8388 8388] - [Bug]Improperly displayed ⋮ Main menu (3dot menu) overlay in landscape mode
* [https://github.com/mozilla-mobile/fenix/issues/8965 8965] - [Bug]Broken test app color selection in both the browser and in custom tabs


=== Known issues ===
=== Known issues ===
Major:
Major:
 
* [https://github.com/mozilla-mobile/fenix/issues/8727 8727] - [Bug] Autofill options does not always show up when interactjni with login form


Other:
Other:
* [https://github.com/mozilla-mobile/fenix/issues/7996 7996] - [Bug] Private mode doesn't play nicely with sites added to home screen
* [https://github.com/mozilla-mobile/fenix/issues/8641 8641] - [Bug][Add-ons] Red buttons and icon's on Android 5 devices
* [https://github.com/mozilla-mobile/fenix/issues/8641 8641] - [Bug][Add-ons] Red buttons and icon's on Android 5 devices
* [https://github.com/mozilla-mobile/fenix/issues/2725 2725] - [Bug] Undo snackbar is not displayed when removing a tab from a collection
* [https://github.com/mozilla-mobile/fenix/issues/2725 2725] - [Bug] Undo snackbar is not displayed when removing a tab from a collection
Line 123: Line 130:
* [https://github.com/mozilla-mobile/fenix/issues/3900 3900] - Bug] After sharing a page from Fenix to Firefox Nightly the popup menu remains in the recent apps menu
* [https://github.com/mozilla-mobile/fenix/issues/3900 3900] - Bug] After sharing a page from Fenix to Firefox Nightly the popup menu remains in the recent apps menu
* [https://github.com/mozilla-mobile/fenix/issues/4178 4178] - [Bug] Sharing multiple tabs to another browser, only opens 1 tab
* [https://github.com/mozilla-mobile/fenix/issues/4178 4178] - [Bug] Sharing multiple tabs to another browser, only opens 1 tab
* [https://github.com/mozilla-mobile/fenix/issues/2725 2725] - [Bug] Undo snackbar is not displayed when removing a tab from a collection
* [https://github.com/mozilla-mobile/fenix/issues/8930 8930] - [Bug] Pause/resume don't work when downloading more files
* [https://github.com/mozilla-mobile/fenix/issues/4721 4721] - [Bug] Flicker when deleting tabs by swipe from a collection
* [https://github.com/mozilla-mobile/fenix/issues/4721 4721] - [Bug] Flicker when deleting tabs by swipe from a collection
* [https://github.com/mozilla-mobile/fenix/issues/8716 8716] - [Bug] Private custom tab opened when signing in to sync records history
* [https://github.com/mozilla-mobile/fenix/issues/8716 8716] - [Bug] Private custom tab opened when signing in to sync records history
Line 129: Line 136:
* [https://github.com/mozilla-mobile/fenix/issues/3108 3108] - Add new safe browsing policies for Malware in iframe and Billing warning
* [https://github.com/mozilla-mobile/fenix/issues/3108 3108] - Add new safe browsing policies for Malware in iframe and Billing warning
* [https://github.com/mozilla-mobile/fenix/issues/8927 8927] - [Bug] Logging out from Twitter is not working as the user remains logged in
* [https://github.com/mozilla-mobile/fenix/issues/8927 8927] - [Bug] Logging out from Twitter is not working as the user remains logged in
* [https://github.com/mozilla-mobile/fenix/issues/7242 7242] - [Bug] Collection size change after expand/compress them
* [https://github.com/mozilla-mobile/fenix/issues/8583 8583] - [Bug] Crash when accessing about:crashcontent
* [https://github.com/mozilla-mobile/fenix/issues/8773 8773] - [Bug]Snackbars are not displayed right above URL bar
* [https://github.com/mozilla-mobile/fenix/issues/5308 5308] - [Bug] Cannot access search engine selection when clicking URL bar from tab
* [https://github.com/mozilla-mobile/fenix/issues/7866 7866] - [Bug] Custom search engines do not provide search suggestions
* [https://github.com/mozilla-mobile/fenix/issues/8850 8850] - [Bug]Improperly displayed "Shortcuts" magnifying glass icon while using Light theme
* [https://github.com/mozilla-mobile/fenix/issues/4375 4375] - [Bug]Mute/Unmute a video displays a white/grey rectangle over the volume bar
* [https://github.com/mozilla-mobile/fenix/issues/4147 4147] - [Bug]Vimeo Cookie policy banner can't be dismissed
* [https://github.com/mozilla-mobile/fenix/issues/5133 5133] - [Bug] Phone goes to sleep while audio is playing
* [https://github.com/mozilla-mobile/fenix/issues/7369 7369] - [Bug]Soundcloud doesn't play in the background anymore
* [https://github.com/mozilla-mobile/fenix/issues/4793 4793] - [Bug] soundscloud: Audio plays without media notification showing
* [https://github.com/mozilla-mobile/fenix/issues/6213 6213] - [Bug]Facebook Stories playback issue
* [https://github.com/mozilla-mobile/fenix/issues/6211 6211] - [Bug]Instagram notification issue
* [https://github.com/mozilla-mobile/fenix/issues/8726 8726] - [Bug]Collections-Empty collection can be created
* [https://github.com/mozilla-mobile/fenix/issues/8848 8848] - [Bug]Fenix doesn't properly suggest the collections numbering order
* [https://github.com/mozilla-mobile/fenix/issues/4000 4000] - [Bug] QR code scan issues on OnePlus A3

Latest revision as of 09:44, 6 March 2020

«  Fenix RC 4.0.0-beta.2 | Fenix RC 4.0.0-beta.3 | Fenix RC 4.0.0-beta.4 »

Firefox Preview 4.0.0-beta.3 Test Plan

Features

Smoke and sanity tests

QA Task Person/Group
Softvision Alternating

Smoke and sanity tests

QA Assignment

Assigned Build type Device Completed Results
Mirabela Lobontiu x86 Xiaomi MiPad 2 (Android 5.1) March 4th, 2020 PASS
Andrei Joltan ARM OnePlus A3 (Android 6.0.1) March 4th, 2020 PASS
Andrei Bodea ARM Samsung Galaxy S10+ (Android 9) March 4th, 2020 PASS
Stefan Deiac ARM Samsung Galaxy Tab S3 (Android 8) March 4th, 2020 PASS
Oana Horvath ARM Huawei P9 Lite (Android 7.0) March 4th, 2020 PASS


Results

Telemetry

Phones

Tablet

Bug verification

Andrei Joltan March 4th, 2020 Done

List of issues that needed QA:

  • 7344 - [Bug]Crash when trying to access Saved Logins for the second time while performing a Sync - Verified
  • 8854 - [Bug] LoginsStorageException: Using DatabaseLoginsStorage without unlocking first - Verified

L10N

Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.

Oana Horvath March 4th, 2020 PASS


Issues

New isues

Major:

  • 8967 - [Bug] Crash when approving the password update

Other:

  • 8964 - [Bug] Floating custom tabs ⋮ Main menu (3dot menu) overlay after rotation
  • 8968 - [Bug] Android 7 and lower: Keyboard doesn't hide when going to Settings
  • 8970 - [Bug]Distorted and zoomed in transition from Instagram to the home screen
  • 8388 - [Bug]Improperly displayed ⋮ Main menu (3dot menu) overlay in landscape mode
  • 8965 - [Bug]Broken test app color selection in both the browser and in custom tabs

Known issues

Major:

  • 8727 - [Bug] Autofill options does not always show up when interactjni with login form

Other:

  • 7996 - [Bug] Private mode doesn't play nicely with sites added to home screen
  • 8641 - [Bug][Add-ons] Red buttons and icon's on Android 5 devices
  • 2725 - [Bug] Undo snackbar is not displayed when removing a tab from a collection
  • 7953 - [Bug] Error 0/0 displayed when double tapping on Find in page toolbar
  • 8575 - [Bug] Tablets keyboard doesn't hide, covering the save login prompt
  • 5072 - [Bug] x86 build doesn't crash (from about:crashcontent or about:crashparent)
  • 8859 - [Bug] The tab drawer number is not centered when open Top Sites pages
  • 8870 - [Bug] "Your library" text is indented too much in the three dot menu
  • 8428 - [Bug] [l10n] About Firefox Nightly page is not completely translated in some languages
  • 8116 - [Bug]uBlock confirmation snackbar isn't displayed is you exit the Add-ons Manager view
  • 8139 - [Bug]Improperly displayed uBlock icons using the Light theme
  • 8520 - [Bug] Add-ons Manager and add-on sub-pages have inconsistent style compared to the rest of Settings
  • 8593 - [Bug] Ublock origin "Add" button has wrong background color
  • 3900 - Bug] After sharing a page from Fenix to Firefox Nightly the popup menu remains in the recent apps menu
  • 4178 - [Bug] Sharing multiple tabs to another browser, only opens 1 tab
  • 8930 - [Bug] Pause/resume don't work when downloading more files
  • 4721 - [Bug] Flicker when deleting tabs by swipe from a collection
  • 8716 - [Bug] Private custom tab opened when signing in to sync records history
  • 8590 - [Bug] From PB shortcut, clearing tabs from notification returns to Normal mode
  • 3108 - Add new safe browsing policies for Malware in iframe and Billing warning
  • 8927 - [Bug] Logging out from Twitter is not working as the user remains logged in
  • 7242 - [Bug] Collection size change after expand/compress them
  • 8583 - [Bug] Crash when accessing about:crashcontent
  • 8773 - [Bug]Snackbars are not displayed right above URL bar
  • 5308 - [Bug] Cannot access search engine selection when clicking URL bar from tab
  • 7866 - [Bug] Custom search engines do not provide search suggestions
  • 8850 - [Bug]Improperly displayed "Shortcuts" magnifying glass icon while using Light theme
  • 4375 - [Bug]Mute/Unmute a video displays a white/grey rectangle over the volume bar
  • 4147 - [Bug]Vimeo Cookie policy banner can't be dismissed
  • 5133 - [Bug] Phone goes to sleep while audio is playing
  • 7369 - [Bug]Soundcloud doesn't play in the background anymore
  • 4793 - [Bug] soundscloud: Audio plays without media notification showing
  • 6213 - [Bug]Facebook Stories playback issue
  • 6211 - [Bug]Instagram notification issue
  • 8726 - [Bug]Collections-Empty collection can be created
  • 8848 - [Bug]Fenix doesn't properly suggest the collections numbering order
  • 4000 - [Bug] QR code scan issues on OnePlus A3
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Fenix/4/0.0/Beta.3/&oldid=1224717"