Releases/Firefox 52/Test Plan/Beta/RC2

From MozillaWiki
Jump to: navigation, search

«  Firefox 52.0 RC1 | Firefox 52,0 RC2 »

Firefox 52.0 RC2 Test Plan

QE recommendation regarding the quality of the build

  • Recommendation based on results from manual testing:
Build 2 SHIP IT

Manual Testing summary - Platform Coverage and Areas Tested

  • Testing performed around Add-on Compatibility and Web Compatibility.
  • Test Cases executed and results: report

Build 2

Platform GPU Build architecture Assignee Results: report
Windows 10 x64 Intel HD 530 64-bit Emil Ghitta [DONE]
Windows 7 x64 NVIDIA GeForce 210 32-bit Camelia Badau [DONE]
Mac OS X 10.11 Intel Iris Pro (1536 MB) 64-bit Timea Zsoldos [DONE]
Ubuntu 16.04 x86 AMD Radeon R7 200 64-bit Paul Silaghi [DONE]
Tested Area Testing Type Results
Web compatibility Exploratory Testing PASSED

Features

See the [1] gdoc for a general overview

Feature Owner Testing Sign off Details Test Plan
Touch events in APZ Petruta Rasa [DONE] [DONE] Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is YELLOW. Test Plan
New Responsive Design Mode Mihai Boldan [AT RISK] [DONE] Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is RED because there are 26 open bugs still affecting it Test Plan
Partner Search Paul Silaghi [DONE] [DONE] Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. Test Plan
Device Permissions (Screen Sharing) Cornel Ionce [DONE] [DONE] Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. Test Plan
Skia Content for Windows (Compositor Process) Mihai Boldan [DONE] [DONE] Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. Test Plan
Ship DTMF support in Firefox Cornel Ionce [DONE] [DONE] Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. Test Plan
Restartless System Add-ons Alexandru Simonca, Cristian Comorasu [DONE] [DONE] Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. Test Plan
CSS Grid, CSS Grid Inspector Bogdan Maris, Paul Silaghi [AT RISK] [DONE] Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is RED because there are 2 bugs severely affecting it and several high impact issues were encountered during sign-off. ---
mediaDevices.ondevicechange in MediaStream Alexandru Simonca [DONE] [DONE] Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. Test Plan
Improvements to <select> element Petruta Rasa [DONE] [DONE] Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. ---
First-party isolation (Tor) Bogdan Maris (assisting only) [DONE] --- Feature set to release with Firefox 52. Will not be signed off by our team but a pre-Release test report for the parts our team tested was sent on Feb 27. ---
Automatic Captive Portal detection Camelia Badau [DONE] [DONE] Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is YELLOW. Test Plan
Insecure Password Manager Iulia Cristescu [DONE] [DONE] Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. Test Plan
Introduce word (and sentence?) tracking in Narrate Camelia Badau [DONE] --- Feature set to release with Firefox 52. Release QA will not be signing off on this, as we've only got notice of it at the end of the cycle. We did make sure that the most basic functionality associated to it is intact, though (see results). ---

Results

New bugs

Full Query
ID Summary Status Resolution
1344157 Wikipedia media viewer close needs about 3 seconds delay RESOLVED DUPLICATE

1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);


Known Issues - also seen in previous builds

Major issues also seen in previous builds

Bugzilla query error

error, http-bad-status, Array


Low impact issues also seen in previous builds

Full Query
ID Summary Status Resolution
616629 "Remember Password?" dialog shows too early RESOLVED DUPLICATE
1191290 Glitches after opening images in tumblr RESOLVED WORKSFORME
1192204 Scrollbar is overlapping the Quality entries via Youtube high resolution videos RESOLVED WORKSFORME
1194214 [HTML5] Several side effects using the context menu options on Youtube NEW
1210769 Glitches after opening images via flickr RESOLVED WORKSFORME
1233359 Glitches after opening images in facebook NEW
1305744 Twitter profile picture glitches when the page is scrolled in maximized window RESOLVED WORKSFORME
1309534 Glitches when zoom in .jpg files from Wikipedia NEW

8 Total; 3 Open (37.5%); 5 Resolved (62.5%); 0 Verified (0%);


Branch Bug Fix Verifications

Full Query
ID Summary Status Resolution
1336350 Some PDF crashes Firefox when using internal PDF Viewer VERIFIED FIXED
1342051 Grid highlighter can no longer be activated after Inspector close and page refresh VERIFIED FIXED

2 Total; 0 Open (0%); 0 Resolved (0%); 2 Verified (100%);

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed