QA/Fenix/3/1.0/Beta3

From MozillaWiki
< QA
Jump to: navigation, search

«  Fenix RC 3.0.0-beta.1 | Fenix RC 3.0.0-beta.2 | Fenix RC 3.0.1-rc »

Firefox Preview 3.1.0-beta.3 Test Plan

Features

Full functional Testing

QA Task Person/Group
Softvision Alternating

Full Functional Tests are a more comprehensive set of manually covered tests that cover functional testing of features that have landed.

QA Assignment

Assigned Build type Device Completed Results
Oana Horvath ARM Nexus 9 (Android 7.1.1) January 15th, 2020 PASS
Mirabela Lobontiu x86 Xiaomi Mi Pad 2 (Android 5.1) January 15th, 2020 PASS
Andrei Bodea ARM Google Pixel 3A XL(Android 10) January 15th, 2020 PASS
Stefan Deiac ARM OnePlus 5T (Android 9) January 15th, 2020 PASS


Results

Telemetry

Phone

Tablet

Bug verification

Oana Horvath January 15th, 2020 Done
  • 220 - Add ability to change Firefox Preview (browser UI) language

L10N

Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.

Stefan Deiac January 15th, 2020 PASS


A11y scanner

Light testing using the Accessibility scanner app to detect UI a11y issues.

Mirabela Lobontiu Samsung Galaxy Tab S3 (Android 8) January 15th, 2020 PASS


Issues

New isues

Major issues:

  • 7677 - [Bug] ANR on selecting language from the search bar
  • 7682 - [Bug] (regression) Can't download a new file after a canceled one

Other issues:

  • 7676 - [Bug] Selecting the entire text in a page, displays an extra button overlapping some elements
  • 7678 - [Bug] Accessibility Scanner crashes on Fenix Beta
  • 7684 - [Bug] The error messages have different colors in three-dot menu
  • 7709 - [Bug] Can't use the Navigation toolbar while the deleted bookmark pop-up is displayed
  • 7714 - [Bug] 3dot menu from Default search engine list overlaps the search engine name
  • 7723 - [Bug] The account sync doesn't start automatically when the app is brought to the foreground
  • 7726 - [Bug] Crash when tapping on "Retry" when the tab wasn't sent
  • [1] - [Bug] Selecting the current device language from the language list, moves the selection to Follow system language
  • [2] - [Bug] What's new page for 3.1 opens the 3.0 one
  • [3] - [Bug] Private search suggestions don't appear as soon as you tap Allow

Accessibility issues

  • 7669 - [Bug] [a11y] Text contrast - consider increasing contrast ratio
  • 7672 - [Bug] [a11y] Accessibility Scanner suggests increasing the "x" button from Save to Collection page
  • 7708 - [Bug] [a11y] Consider making the "Common myths" item from PB larger
  • 7710 - [Bug] [a11y] Security pop-up overlays password tool-tip pop-up when creating an account
  • 7711 - [Bug] [a11y] Show password is read, but cannot be accessed when creating an account
  • 7716 - [Bug] [a11y] Consider making "Learn more" clickable item larger
  • 7718 - [Bug] [a11y] Consider making the "x" button from the ETP pop-up larger
  • 7720 - [Bug] [a11y] Consider increasing the ETP
  • 7721 - [Bug] [a11y] Consider increasing some elements from the page's menu
  • 7722 - [Bug] [a11y] Increase some elements from the "Sign in" page
  • 7724 - [Bug] [a11y] Text contrast - consider increasing contrast ratio on "Add search engine" elements
  • 7725 - [Bug] [a11y] Consider increasing the "Info" icon items from the ETP page

Known issues

Major issues:

  • 220 - Add ability to change Firefox Preview (browser UI) language

Other issues:

  • 5298 - [Bug] The same page appears in the History section multiple times
  • 6935 - [Bug] Awesomebar suggests only for every other typed character (highlight)
  • 3869 - [Bug] Fenix not setting default search engine properly
  • 6907 - [Bug] Changing Locale Does Not Update Search Engines
  • 6521 - [Bug] Auto-sign in doesn't work on Beta
  • 2725 - [Bug] Undo snackbar is not displayed when removing a tab from a collection
  • 3900 - [Bug] After sharing a page from Fenix to Firefox Nightly the popup menu remains in the recent apps menu
  • 7370 - [Bug]No media playback notifiction displayed for Hot97 FM radio station
  • 6304 - [Private Browsing Mode] Hitting back button in PBM shortcut takes you to non-PBM homescreen
  • 6965 - [Bug] "Try again" button from "Unable to connect" page is not centered on tablets
  • 6713 - [Bug] History doesn't sync
  • 7638 - Fenix not reporting correct web site to OS
  • 1657 - [fxa-content-server] Canceled pairing from the mobile device should update automatically on the desktop side
  • 4432 - [Bug]Delete all history or individual history items snackbar missing