Releases/Firefox 51/Test Plan/Beta/RC2

From MozillaWiki
Jump to: navigation, search

«  Firefox 51 RC1 | Firefox 51 RC2 | Firefox 51.0.1 »

Firefox 51.0 RC2 Test Plan

QE recommendation regarding the quality of the build

  • Recommendation based on results from manual testing:
Build 1 SHIP IT

Manual Testing summary - Platform Coverage and Areas Tested

  • Testing performed around Web compatibility.
  • Test Cases executed and results: report

Build 1

Platform GPU Build architecture Assignee Results: report
Windows 7 x64 NVIDIA GeForce 210 32-bit Camelia Badau [DONE]
Windows 10 x64 Intel HD Graphics 530 64-bit Alexandru Simonca [DONE]
Mac OS X 10.11.6 Intel Iris Pro (1536 MB) 64-bit Timea Zsoldos [DONE]
Ubuntu 16.04 x64 Intel HD 520 64-bit Andrei Vaida [DONE]
Tested Area Testing Type Results
Web compatibility Exploratory Testing PASSED

Features

See the [1] gdoc for a general overview

Feature Owner Testing Sign off Details Test Plan
WebGL2 Bogdan Maris [DONE] YELLOW Feature set to release with Firefox 51, pre-Release sign off completed. Yellow because of the new bugs encountered during sign off (13303331330334) and the large number of conformance test failures (test runner). Test Plan
Indicator for Streaming or Permissions Cornel Ionce [DONE] GREEN Feature set to release with Firefox 51, pre-Release sign off completed. Test Plan
Support for FLAC Ciprian Georgiu [DONE] GREEN Feature set to release with Firefox 51, pre-Release sign off completed. Test Plan
Zoom Indicator Iulia Cristescu [DONE] YELLOW Feature set to release with Firefox 51, pre-Release sign off completed. Yellow because of 1310758 and 1300376. Test Plan
ICE candidate generation control and user authorization Iulia Cristescu [ON TRACK] ON TRACK Feature set to release with Firefox 51, pre-Release sign off underway. Test Plan
Support VP9 for WebRTC Iulia Cristescu --- --- Feature set to release with Firefox 51, but won't be tracked by our team. ---

Results

New bugs

Full Query
ID Summary Status Resolution
1332302 Reader View's first-run infopanel is resizable and causes visual artifacts RESOLVED DUPLICATE

1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);


Known Issues - also seen in previous builds

Major issues also seen in previous builds

Bugzilla query error

error, http-bad-status, Array


Low impact issues also seen in previous builds

Full Query
ID Summary Status Resolution
616629 "Remember Password?" dialog shows too early RESOLVED DUPLICATE
1233359 Glitches after opening images in facebook NEW
1305744 Twitter profile picture glitches when the page is scrolled in maximized window NEW
1309534 Glitches when zoom in .jpg files from Wikipedia NEW

4 Total; 3 Open (75%); 1 Resolved (25%); 0 Verified (0%);


Branch Bug Fix Verifications

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed