Releases/Firefox 56/Test Plan/Beta/RC2

From MozillaWiki
Jump to: navigation, search

«  Firefox 56 Release Candidate | Firefox 56 Release Candidate 2 | Firefox 56.0.1»

Firefox 56 Release Candidate 2 Test Plan

Build information

Manual QA's recommendation for this build

Note: Recommendation based on results from manual testing.
BUILD TESTING STATUS RECOMMENDATION REASON(S)
56.0-build4 COMPLETED (100%) SHIP IT
  • One new bug uncovered: 1402827 - not a blocker.
  • Known (old) bugs encountered are low-impact.
56.0-build6 COMPLETED (100%) SHIP IT
  • No new bugs uncovered.
  • Known (old) bugs encountered are low-impact.

Manual testing summary

56.0-build4

PLATFORM ASSIGNEE BUILD GPU STATUS PER TEST SUITE
Web compatibility
Windows 7 x64 Emil Ghitta 32-bit AMD 760G GREEN
Windows 10 x64 Ciprian Georgiu 64-bit ATI Radeon 3000 GREEN
macOS 10.12 Timea Zsoldos 64-bit NVIDIA GeForce GT 640M GREEN
Ubuntu 16.04 x64 Iulia Cristescu 64-bit Intel HD 520 GREEN

56.0-build6

PLATFORM ASSIGNEE BUILD GPU STATUS PER TEST SUITE
Web compatibility Video compatibility
Windows 7 x64 Emil Ghitta 32-bit AMD 760G GREEN GREEN
Windows 10 x64 Gabi Cheta 64-bit ATI Radeon 3000 GREEN GREEN
macOS 10.12 Timea Zsoldos 64-bit NVIDIA GeForce GT 640M GREEN GREEN
Ubuntu 16.04 x64 Iulia Cristescu 64-bit Intel HD 520 GREEN GREEN

Features in Firefox 56

Note: Pre-Release feature sign offs are scheduled to be completed by September 8th, with preliminary reports sent by September 1st.
Note: See https://goo.gl/U1w1cp for a general overview.
FEATURE NAME PRIORITY TRACKING QA CONTACTS TESTING STATUS PRELIMINARY REPORTING STATUS SIGN OFF STATUS ADDITIONAL NOTES
Type Level Bugzilla Wiki Trello
Form Autofill MVP + Sync bug 990176 Test Plan Card Gabi Cheta (Asofie) (RelQA) [DONE] [DONE] [DONE] Feature signed-off as YELLOW.
Form auto fill with credit card support (MVP) + Sync bug 990176 Test Plan Card Gabi Cheta (Asofie) (RelQA) [NOT APPLICABLE] [NOT APPLICABLE] [NOT APPLICABLE] Target release changed to Fx57.
App Updater Improvements (LZMA) bug 641212 Test Plan Card Petruta Horea (Rasa) (RelQA) [DONE] [DONE] [DONE] Feature signed-off as GREEN.
App Updater Improvements (SHA384) bug 1324498 Test Plan Card Petruta Horea (Rasa) (RelQA) [DONE] [DONE] [DONE] Feature signed-off as GREEN.
CSS Grid Inspector Layout View bug 1181227 Test Plan Card Bogdan Maris (RelQA) [DONE] [DONE] [DONE] Feature signed-off as GREEN.
Netmonitor Phase II (Launchpad) bug 1348737 Test Plan Card Ciprian Georgiu (RelQA) [DONE] [DONE] [DONE] Feature signed-off as GREEN.
New DevTools Debugger panel bug 1294139 Test Plan Card Emil Ghitta (RelQA) [DONE] [DONE] [DONE] Feature signed-off as YELLOW.
Media Block Autoplay bug 1308154 Test Plan Card Emil Ghitta (RelQA) [DONE] [DONE] [DONE] Feature signed-off as GREEN.
File read access restrictions n/a Test Plan Card Mihai Boldan (RelQA) [DONE] [DONE] [DONE] Feature signed-off as GREEN.
Expose Sync Tab / send tab bug 1359894 Test Plan n/a Alexandru Simonca (RelQA) [DONE] [DONE] [DONE] Feature signed-off as GREEN.
Photon Onboarding Tour Overlay bug 1354046 Test Plan Card Cristian Comorasu (RelQA) [DONE] [DONE] [DONE] Feature signed-off as GREEN.
Photon Onboarding Tour Notifications bug 1357008 Test Plan Card Cristian Comorasu (RelQA) [DONE] [DONE] [DONE] Feature signed-off as GREEN.
Photon Preferences Reorg v2 bug 1365133 Test Plan Card Camelia Badau (RelQA) [DONE] [DONE] [DONE] Feature signed-off as GREEN.
Photon Search Preferences bug 1357285 Test Plan Card Camelia Badau (RelQA) [DONE] [DONE] [DONE] Feature signed-off as YELLOW.
Keyboard APZ & Autoscrolling bug 1351783,1376525,1105109 Test Plan Card Petruta Horea (Rasa) (RelQA) [NOT APPLICABLE] [NOT APPLICABLE] [NOT APPLICABLE] Target release changed to Fx57.
Advanced Layers bug 1365879 n/a n/a Ovidiu Boca (EngQA) [NOT APPLICABLE] [NOT APPLICABLE] [NOT APPLICABLE] Target release changed to Fx57.
Safe Browsing v4 bug 1359337 Test Plan n/a Timea Zsoldos (RelQA) [DONE] [DONE] [DONE] Feature signed-off as GREEN.

Detailed test results

Note: New and known bugs for 56.0-build4 are listed in https://testrail.stage.mozaws.net/index.php?/plans/defects/6398
Note: New and known bugs for 56.0-build6 are listed in https://testrail.stage.mozaws.net/index.php?/plans/defects/6440


New bugs

ID Summary Status Resolution Keywords
1402827 Video freezes after interacting with the seekbar RESOLVED WONTFIX regression

1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);


Known bugs

High-impact bugs also encountered in previous builds

Bugzilla query error

Server returned unexpected HTTP status: 400 Bad Request


Low-impact bugs also encountered in previous builds

ID Summary Status Resolution
558178 Only show password capture dialog if we're reasonably sure the password was correct and the login was successful NEW
616629 "Remember Password?" dialog shows too early RESOLVED DUPLICATE
1182606 Context menu for video elements should check .mozHasAudio property NEW
1191290 Glitches after opening images in tumblr NEW
1194214 [HTML5] Several side effects using the context menu options on Youtube NEW
1230678 youtube shows black line 720p & 1080p videos in normal view mode RESOLVED FIXED
1233359 Glitches after opening images in facebook NEW
1305744 Twitter profile picture glitches when the page is scrolled in maximized window NEW
1309534 Glitches when zoom in .jpg files from Wikipedia NEW
1402827 Video freezes after interacting with the seekbar RESOLVED WONTFIX
1403118 The lowest pixel of certain characters is cut off on Outlook Tasks NEW

11 Total; 8 Open (72.73%); 3 Resolved (27.27%); 0 Verified (0%);


Bug fix verification

Note: All verified Firefox 56 bug fixes are listed in https://goo.gl/CDJvYv.

Bugzilla query error

Server returned unexpected HTTP status: 400 Bad Request


Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed