Releases/Firefox 52/Test Plan/Beta/9

From MozillaWiki
Jump to: navigation, search

«  Firefox 52 Beta 8 | Firefox 52 Beta 9 | Firefox 52 RC1 »

Firefox 52.0 Beta 9 Test Plan

QE recommendation regarding the quality of the build

  • Recommendation based on results from manual testing:
Build 2 SHIP IT

Manual Testing summary - Platform Coverage and Areas Tested

  • Testing performed around Image Support, Plug-in Compatibility and Web Compatibility.
  • Test Cases executed and results: report

Build 1

Platform GPU Build architecture Assignee Results: report
Windows 10 x86 Intel(R) HD Graphics 515 32-bit Timea Zsoldos [DONE]
Windows 8.1 x86 ATI Radeon HD 3000 32-bit Ciprian Georgiu [DONE]
macOS 10.12.3 AMD Radeon HD 6750M (512 MB) 64-bit Bogdan Maris [DONE]
Ubuntu 16.04 x64 Intel HD 520 / AMD Radeon R7 M340 64-bit Emil Ghitta [DONE]
Tested Area Testing Type Results
Image support Smoke and Exploratory Testing PASSED
Plug-in compatibility Smoke and Exploratory Testing PASSED
Web compatibility Exploratory Testing PASSED

Features

See the [1] gdoc for a general overview

Feature Owner Testing Sign off Details Test Plan
Touch events in APZ Petruta Rasa [ON TRACK] [IN PROGRESS] Feature set to release with Firefox 52. Pre-Release sign off in progress. Test Plan
New Responsive Design Mode Mihai Boldan [AT RISK] [DONE] Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is RED because there are 26 open bugs still affecting it Test Plan
Partner Search Paul Silaghi [DONE] [DONE] Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. Test Plan
Device Permissions (Screen Sharing) Cornel Ionce [ON TRACK] [IN PROGRESS] Feature set to release with Firefox 52. Pre-Release sign off in progress. Test Plan
Skia Content for Windows (Compositor Process) Mihai Boldan [DONE] [DONE] Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. Test Plan
Ship DTMF support in Firefox Cornel Ionce [DONE] [DONE] Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. Test Plan
Restartless System Add-ons Alexandru Simonca, Cristian Comorasu [ON TRACK] [IN PROGRESS] Feature set to release with Firefox 52. Pre-Release sign off in progress. ---
CSS Grid, CSS Grid Inspector Bogdan Maris, Paul Silaghi [ON TRACK] [IN PROGRESS] Feature set to release with Firefox 52. Pre-Release sign off in progress. ---
mediaDevices.ondevicechange in MediaStream Alexandru Simonca [ON TRACK] [IN PROGRESS] Feature set to release with Firefox 52. Pre-Release sign off in progress. ---
Improvements to <select> element Petruta Rasa [ON TRACK] [IN PROGRESS] Feature set to release with Firefox 52. Pre-Release sign off in progress. ---
First-party isolation (Tor) Bogdan Maris (assisting only) [ON TRACK] --- Feature set to release with Firefox 52. Will not be signed off by our team but a pre-Release test report for the parts our team tested will be sent. ---
Automatic Captive Portal detection Camelia Badau [ON TRACK] [ON TRACK] Feature set to release with Firefox 52. Pre-Release sign off in progress. ---
Insecure Password Manager Iulia Cristescu [ON TRACK] [IN PROGRESS] Feature set to release with Firefox 52. Pre-Release sign off in progress. Test Plan
Introduce word (and sentence?) tracking in Narrate Camelia Badau [AT RISK] [NOT STARTED] Feature set to release with Firefox 52. Release QA will not be signing off on this, as we've only got notice of it at the end of the cycle. We did make sure that the most basic functionality associated to it is intact, though (see results). ---

Results

New bugs

Bugzilla query error

error, http-bad-status, Array


Known Issues - also seen in previous builds

Major issues also seen in previous builds

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


Low impact issues also seen in previous builds

Full Query
ID Summary Status Resolution
616629 "Remember Password?" dialog shows too early RESOLVED DUPLICATE
1191290 Glitches after opening images in tumblr NEW
1210769 Glitches after opening images via flickr NEW
1224550 Glitches when resizing firefox width on unsplash.com NEW
1233359 Glitches after opening images in facebook NEW
1305744 Twitter profile picture glitches when the page is scrolled in maximized window NEW
1306590 percent "text-indent" values resolve against the wrong container box, for overflow:hidden elements (causing stray character to be visible at reddit) NEW
1309534 Glitches when zoom in .jpg files from Wikipedia NEW
1321739 Copy Image crash (dead beef, it's what's for dinner) NEW

9 Total; 8 Open (88.89%); 1 Resolved (11.11%); 0 Verified (0%);


Branch Bug Fix Verifications

Full Query
ID Summary Status Resolution
791597 Dragging and dropping URLs leads to address bar spoofing VERIFIED FIXED
1313568 Handle captive portal notification bar per-window VERIFIED FIXED
1313711 Same-Origin-Policy violation via Text Track VERIFIED FIXED
1325511 libGLES - Use After Free in Buffer11::updateBufferStorage() RESOLVED FIXED
1326245 Handling safe mode is completely broken in the child process VERIFIED FIXED
1333075 [Captive Portal] Captive Portal Notification bar is not added to all opened windows VERIFIED FIXED
1334102 Mozilla Firefox Int Overflow/Unchecked Address Addition Out of Bound Read (ASLR Bypass) VERIFIED FIXED
1334520 Trigger captive portal recheck recheck for NS_NETWORK_LINK_DATA_CHANGED events VERIFIED FIXED
1334876 heap-use-after-free in mozilla::dom::FontFaceSet::DispatchLoadingFinishedEvent VERIFIED FIXED
1335149 Slow drawing on this canvas example RESOLVED FIXED
1339509 Shift + Tab yields key === 'Unidentified' on Linux VERIFIED FIXED
1341409 Advanced constraints stopped working in FF50 VERIFIED FIXED
1342082 Disable TLS 1.3 for FF52 Release VERIFIED FIXED

13 Total; 0 Open (0%); 2 Resolved (15.38%); 11 Verified (84.62%);

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed