QA/Fenix/3/2/Beta.1/

From MozillaWiki
< QA
Jump to: navigation, search

«  Fenix RC 3.0.1-rc | Fenix RC 3.2-beta.1 »

Firefox Preview 3.2-beta.1 Test Plan

Features

Full functional Testing

QA Task Person/Group
Softvision Alternating

Full Functional Tests are a more comprehensive set of manually covered tests that cover functional testing of features that have landed.

QA Assignment

Assigned Build type Device Completed Results
Oana Horvath x86 Xiaomi MiPad 2 (Android 5.1) January 23rd, 2020 PASS
Mirabela Lobontiu ARM64 Google Pixel (Android 10) January 23rd, 2020 PASS
Stefan Deiac ARM Samsung Galaxy Tab S3 (Android 8) January 23nd, 2020 PASS
Laurentiu Apahidean ARM OnePlus 6T (Android 9) January 23rd, 2020 PASS


Results

Telemetry

Phone

Tablet

Bug verification

Oana Horvath January 23rd, 2020 Done
  • 7029 - [Bug] Ambiguous button name "Start browsing"
  • 3813 - Create a save button for bookmark editing
  • 7714 - [Bug]3dot menu from Default search engine list overlaps the search engine name
  • 7506 - Highlight `what's new` after each release
  • 4904 - [Bug] Pressing Back from External Links Opened In Fenix Doesn't Always Go Back to Other App
  • 6553 - [Bug] CWTS looks buggy when checkboxes are pressed quickly
  • 5884 - [Telemetry] Adding user-specified search engines
  • 1607 - [Telemetry] Handle custom search engines, do not leak user-added engines
  • 6396 - [Telemetry] Sync history and bookmarks
  • 7574 - [Bug] Metrics nav bar position is reported to telemetry in locale instead of english

Not verified yet, needs extra investigation

  • 6556 - Telemetry counts for Search Access Point #6556

L10N

Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.

Laurentiu Apahidean January 23rd, 2020 PASS


A11y

Light testing using the Accessibility scanner app to detect UI a11y issues.

Stefan Deiac January 23rd, 2020 In Progress


Issues

New issues

  • 7852 - [Bug] Beta 3.2.0-beta.1 froze while browsing
  • 7854 - [Bug] Bookmark's edited name is not saved after selecting in which folder to save
  • 7851 - [Bug][a11y] TalkBack doesn't announce the search bar being in focus when you tap Start browsing
  • 7853 - [Bug][a11y] Highlighted What's new menu item not announced by TalkBack
  • 7859 - [Bug][a11y] Play/pause button to small - consider making larger
  • 7887 - [Bug][a11y]Common myth hyperlink button to small - consider making larger

Known issues

  • 7240 - [Bug] "Privacy notice" opens in Russian on Google Pixel (Android Q)
  • 5298 - [Bug] The same page appears in the History section multiple times
  • 4178 - [Bug] Sharing multiple tabs to another browser, only opens 1 tab
  • 3869 - [Bug] Fenix not setting default search engine properly
  • 7715 - [Bug] (regression) Private search suggestions don't appear as soon as you tap Allow
  • 7331 - [Bug] Google images, maps and deezer fail with unknown protocol
  • 7684 - [Bug] The error messages have different colors in three-dot menu
  • 7723 - [Bug] The account sync doesn't start automatically when the app is brought to the foreground
  • 6521 - [Bug] Auto-sign in doesn't work on Beta
  • 6907 - [Bug] Changing Locale Does Not Update Search Engines
  • 7799 - [Bug] (regression) "tab closed" snackbar no longer disappears
  • 2725 - [Bug] Undo snackbar is not displayed when removing a tab from a collection
  • 2783 - Add snackbar to collection deletion
  • 7230 - [Bug] Option to open external links with private Firefox missing in the new version
  • 4432 - [Bug]Delete all history or individual history items snackbar missing
  • 7638 - Fenix not reporting correct web site to OS
  • 7676 - [Bug] Selecting the entire text in a page, displays an extra button overlapping some elements
  • 1657 - [fxa-content-server] Canceled pairing from the mobile device should update automatically on the desktop side
  • 7669 - [Bug] [a11y] Text contrast - consider increasing contrast ratio
  • 7672 - [Bug] [a11y] Accessibility Scanner suggests increasing the "x" button from Save to Collection page
  • 7710 - [Bug] [a11y] Security pop-up overlays password tool-tip pop-up when creating an account
  • 7716 - [Bug] [a11y] Consider making "Learn more" clickable item larger
  • 7718 - [Bug] [a11y] Consider making the "x" button from the ETP pop-up larger
  • 7720 - [Bug] [a11y] Consider increasing the ETP