Releases/Firefox 51/Test Plan/Beta/RC1

From MozillaWiki
Jump to: navigation, search

«  Firefox 51 Beta 13 | Firefox 51 Beta 14 | Firefox 51 RC1 »

Firefox 51.0 RC1 Test Plan

QE recommendation regarding the quality of the build

  • Recommendation based on results from manual testing:
Build 1 SHIP IT

Manual Testing summary - Platform Coverage and Areas Tested

  • Testing performed around Web compatibility.
  • Test Cases executed and results: report

Build 1

Platform GPU Build architecture Assignee Results: report
Windows 7 x64 Intel HD Graphics 4600 32-bit Iulia Cristescu [DONE]
Windows 10 x64 Intel HD Graphics 2500 64-bit Petruta Rasa [DONE]
Mac OS X 10.11.6 Intel Iris Pro (1536 MB) 64-bit Camelia Badau [DONE]
Ubuntu 16.04 x64 ATI Radeon HD 3000 64-bit Ciprian Georgiu [DONE]
Tested Area Testing Type Results
Web compatibility Exploratory Testing FAILED

Features

See the [1] gdoc for a general overview

Feature Owner Testing Sign off Details Test Plan
WebGL2 Bogdan Maris [DONE] YELLOW Feature set to release with Firefox 51, pre-Release sign off completed. Yellow because of the new bugs encountered during sign off (13303331330334) and the large number of conformance test failures (test runner). Test Plan
Indicator for Streaming or Permissions Cornel Ionce [DONE] GREEN Feature set to release with Firefox 51, pre-Release sign off completed. Test Plan
Support for FLAC Ciprian Georgiu [DONE] GREEN Feature set to release with Firefox 51, pre-Release sign off completed. Test Plan
Zoom Indicator Iulia Cristescu [DONE] YELLOW Feature set to release with Firefox 51, pre-Release sign off completed. Yellow because of 1310758 and 1300376. Test Plan
ICE candidate generation control and user authorization Iulia Cristescu [AT RISK] AT RISK Feature set to release with Firefox 51, pre-Release sign off currently blocked. At risk because we're still waiting for clarifications from engineering on a few of our test results. Test Plan
Support VP9 for WebRTC Iulia Cristescu --- --- Feature set to release with Firefox 51, but won't be tracked by our team. ---

Results

New bugs

Full Query
ID Summary Status Resolution
1331637 DnD uploads empty folders on onedrive.com RESOLVED DUPLICATE

1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);


Known Issues - also seen in previous builds

Major issues also seen in previous builds

Bugzilla query error

error, http-bad-status, Array


Low impact issues also seen in previous builds

Full Query
ID Summary Status Resolution
616629 "Remember Password?" dialog shows too early RESOLVED DUPLICATE
1191290 Glitches after opening images in tumblr RESOLVED WORKSFORME
1210769 Glitches after opening images via flickr RESOLVED WORKSFORME
1233359 Glitches after opening images in facebook NEW
1305744 Twitter profile picture glitches when the page is scrolled in maximized window RESOLVED WORKSFORME
1309534 Glitches when zoom in .jpg files from Wikipedia NEW
1320598 Crash in mozilla::ipc::FatalError | mozilla::dom::PContentParent::OnMessageReceived RESOLVED WORKSFORME

7 Total; 2 Open (28.57%); 5 Resolved (71.43%); 0 Verified (0%);


Branch Bug Fix Verifications

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed