Releases/Firefox 51/Test Plan/Beta/14

From MozillaWiki
Jump to: navigation, search

«  Firefox 51 Beta 11 | Firefox 51 Beta 12 | Firefox 51 Beta 13 »

Firefox 51.0 Beta 13 Test Plan

QE recommendation regarding the quality of the build

  • Recommendation based on results from manual testing:
Build 1 SHIP IT, CONDITIONALLY (1330979)

Manual Testing summary - Platform Coverage and Areas Tested

  • Testing performed around Sync and Firefox Account.
    • [DONE] Part of our efforts were also focused on making sure that Windows stub installers work as intended.
  • Test Cases executed and results: report

Build 1

Platform GPU Build architecture Assignee Results: report
Windows 7 x86 AMD Radeon R7 200 32-bit Paul Silaghi [DONE]
Windows 10 x64 Intel HD Graphics 5500 32-bit Camelia Badau [DONE]
macOS 10.12 AMD Radeon HD 6750M (512 MB) 64-bit Bogdan Maris [DONE]
Ubuntu 12.04 x86 Intel HD 2500 32-bit Mihai Boldan [DONE]
Tested Area Testing Type Results
Web compatibility Exploratory Testing FAILED
Downloads Smoke and Exploratory Testing PASS

Features

See the [1] gdoc for a general overview

Feature Owner Testing Sign off Details Test Plan
WebGL2 Bogdan Maris [ON TRACK] IN PROGRESS Feature set to release with Firefox 51, pre-Release sign off underway. Test Plan
Indicator for Streaming or Permissions Cornel Ionce [DONE] GREEN Feature set to release with Firefox 51, pre-Release sign off completed. Test Plan
Support for FLAC Ciprian Georgiu [DONE] GREEN Feature set to release with Firefox 51, pre-Release sign off completed. Test Plan
Zoom Indicator Iulia Cristescu [ON TRACK] IN PROGRESS Feature set to release with Firefox 51, pre-Release sign off underway. Test Plan
ICE candidate generation control and user authorization Iulia Cristescu [ON TRACK] IN PROGRESS Feature set to release with Firefox 51, pre-Release sign off underway. Test Plan
Support VP9 for WebRTC Iulia Cristescu --- --- Feature set to release with Firefox 51, but won't be tracked by our team. ---

Results

New bugs

Bugzilla query error

error, http-bad-status, Array


Known Issues - also seen in previous builds

Major issues also seen in previous builds

Full Query
ID Summary Status Resolution
1330979 Drag & drop files no longer works on onedrive.com VERIFIED FIXED

1 Total; 0 Open (0%); 0 Resolved (0%); 1 Verified (100%);


Low impact issues also seen in previous builds

Full Query
ID Summary Status Resolution
616629 "Remember Password?" dialog shows too early RESOLVED DUPLICATE
1059343 Downloads that are dragged and dropped into the downloads icon are having the 'Pause' contextual menu disabled NEW
1069134 "Open Containing Folder" icon displayed in the Library even if the download has been moved to another folder NEW
1126762 Open containing folder not working on paused downloads. RESOLVED WORKSFORME
1191290 Glitches after opening images in tumblr RESOLVED WORKSFORME
1194214 [HTML5] Several side effects using the context menu options on Youtube NEW
1195053 Cancelling a retried download gives NS_BASE_STREAM_CLOSED: Component returned failure code: 0x80470002 NEW
1210769 Glitches after opening images via flickr RESOLVED WORKSFORME
1233359 Glitches after opening images in facebook NEW
1287823 [Linux] Dragging & dropping a download from the downloads panel on desktop saves a txt file VERIFIED FIXED
1305744 Twitter profile picture glitches when the page is scrolled in maximized window RESOLVED WORKSFORME
1309534 Glitches when zoom in .jpg files from Wikipedia NEW
1311671 Download panel glitches after clearing downloads from Library VERIFIED FIXED
1312013 Download Panel glitches when a download is paused and resumed RESOLVED WONTFIX
1312020 Download Panel Glitches when removing an item from History VERIFIED FIXED
1312024 Visual notifications that indicate Pause / Resume are slow as download progress advances RESOLVED WORKSFORME
1330963 Amazon videos can't be played if opened in background tab RESOLVED WORKSFORME
1330979 Drag & drop files no longer works on onedrive.com VERIFIED FIXED

18 Total; 6 Open (33.33%); 8 Resolved (44.44%); 4 Verified (22.22%);


Branch Bug Fix Verifications

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed