Releases/Firefox 52/Test Plan/Beta/RC1

From MozillaWiki
Jump to: navigation, search

«  Firefox 52 Beta 9 | Firefox 52 RC 1 »

Firefox 52.0 Beta RC Test Plan

QE recommendation regarding the quality of the build

  • Recommendation based on results from manual testing:
Build 1 SHIP IT

Manual Testing summary - Platform Coverage and Areas Tested

  • Testing performed around Add-on Compatibility and Web Compatibility.
  • Test Cases executed and results: report

Build 1

Platform GPU Build architecture Assignee Results: report
Windows 10 x64 ATI Radeon HD 3000 64-bit Andrei Vaida [DONE]
Windows 7 x64 NVIDIA GeForce 210 32-bit Camelia Badau [DONE]
Mac OS X 10.11 Intel Iris Pro 64-bit Emil Ghitta [DONE]
Ubuntu 14.04 x64 AMD Radeon R7 200 64-bit Paul Silaghi [DONE]
Tested Area Testing Type Results
Add-on compatibility Smoke and Exploratory Testing PASSED
Web compatibility Exploratory Testing PASSED

Features

See the [1] gdoc for a general overview

Feature Owner Testing Sign off Details Test Plan
Touch events in APZ Petruta Rasa [DONE] [DONE] Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is YELLOW. Test Plan
New Responsive Design Mode Mihai Boldan [AT RISK] [DONE] Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is RED because there are 26 open bugs still affecting it Test Plan
Partner Search Paul Silaghi [DONE] [DONE] Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. Test Plan
Device Permissions (Screen Sharing) Cornel Ionce [DONE] [DONE] Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. Test Plan
Skia Content for Windows (Compositor Process) Mihai Boldan [DONE] [DONE] Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. Test Plan
Ship DTMF support in Firefox Cornel Ionce [DONE] [DONE] Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. Test Plan
Restartless System Add-ons Alexandru Simonca, Cristian Comorasu [DONE] [DONE] Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. Test Plan
CSS Grid, CSS Grid Inspector Bogdan Maris, Paul Silaghi [AT RISK] [DONE] Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is RED because there are 2 bugs severely affecting it and several high impact issues were encountered during sign-off. ---
mediaDevices.ondevicechange in MediaStream Alexandru Simonca [DONE] [DONE] Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. Test Plan
Improvements to <select> element Petruta Rasa [DONE] [DONE] Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. ---
First-party isolation (Tor) Bogdan Maris (assisting only) [DONE] --- Feature set to release with Firefox 52. Will not be signed off by our team but a pre-Release test report for the parts our team tested was sent on Feb 27. ---
Automatic Captive Portal detection Camelia Badau [DONE] [DONE] Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is YELLOW. Test Plan
Insecure Password Manager Iulia Cristescu [DONE] [DONE] Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. Test Plan
Introduce word (and sentence?) tracking in Narrate Camelia Badau [DONE] --- Feature set to release with Firefox 52. Release QA will not be signing off on this, as we've only got notice of it at the end of the cycle. We did make sure that the most basic functionality associated to it is intact, though (see results). ---

Results

New bugs

Bugzilla query error

Server returned unexpected HTTP status: 400 Bad Request


Known Issues - also seen in previous builds

Major issues also seen in previous builds

ID Summary Status Resolution

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


Low impact issues also seen in previous builds

ID Summary Status Resolution
616629 "Remember Password?" dialog shows too early RESOLVED DUPLICATE
1096357 "Unable to run script because scripts are blocked internally" JS error appear in browser console while browsing google plus NEW
1171636 Allow displaying multiple simultaneous add-on installs RESOLVED DUPLICATE
1191290 Glitches after opening images in tumblr NEW
1194214 [HTML5] Several side effects using the context menu options on Youtube NEW
1210769 Glitches after opening images via flickr NEW
1212515 Add-on doorhanger UI is broken with more than one add-on RESOLVED WORKSFORME
1233359 Glitches after opening images in facebook NEW
1305028 gaming.youtube.com - The vertical scrollbar displayed for the main pane is partially overlapped by the video itself ASSIGNED
1305744 Twitter profile picture glitches when the page is scrolled in maximized window NEW
1309534 Glitches when zoom in .jpg files from Wikipedia NEW
1319732 Side by side add-on installation pop-ups VERIFIED FIXED

12 Total; 8 Open (66.67%); 3 Resolved (25%); 1 Verified (8.33%);


Branch Bug Fix Verifications

ID Summary Status Resolution
1341521 Smearing with canvas VERIFIED FIXED

1 Total; 0 Open (0%); 0 Resolved (0%); 1 Verified (100%);

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed