Releases/Firefox 54/Test Plan/Beta/54.0.1

From MozillaWiki
Jump to navigation Jump to search

«  Firefox 54 RC2 | Firefox 54.0.1 »

Firefox 54.0.1 Test Plan

Build information

Manual QA's recommendation for this build

Note: Recommendation based on results from manual testing.
BUILD TESTING STATUS RECOMMENDATION REASON(S)
54.0.1-build1 COMPLETED 100% SHIP IT
  • One new issue uncovered, but older regression.
  • The encountered known bugs are low-impact and have been shipped with earlier releases as well.

Manual testing summary

Note: Test Plan available at https://testrail.stage.mozaws.net/index.php?/plans/view/4852
PLATFORM ASSIGNEE BUILD GPU STATUS PER TEST SUITE
Printing Downloads Video compatibility (spot-check) New Tab Page
Windows 7 x64 Camelia Badau 32-bit NVIDIA GeForce 210 GREEN GREEN GREEN GREEN
Windows 10 x64 Gabi Cheta 64-bit ATI Radeon 3000 Graphics GREEN GREEN GREEN GREEN
macOS 10.12 Bogdan Maris 64-bit AMD Radeon HD 6750M 512 MB YELLOW (new bug) GREEN GREEN GREEN
Ubuntu 16.04 x64 Iulia Cristescu 64-bit Intel® HD Graphics 530 GREEN GREEN GREEN GREEN

Features in Firefox 54

Note: Pre-Release feature sign offs are scheduled to be completed by May 26th.
Note: See https://goo.gl/I6hq5C for a general overview.
FEATURE NAME TRACKING QA CONTACTS TESTING STATUS SIGN OFF STATUS ADDITIONAL NOTES
Bugzilla Wiki Trello
client-side stackwalking: ping sender 1310703 Test Plan Petruta Rasa [DONE] [DONE] Signed off on 2017-05-26 as GREEN, full test report here.
Firefox Screenshots system add-on Test Plan Card Iulia Cristescu [AT RISK] [AT RISK] Will ride Firefox 55 instead, per Trello.
Download Panel UX Redesign 1269956 Test Plan Card Cristian Comorasu [DONE] [DONE] Signed off on 2017-05-25 as GREEN, full test report here.
Net Monitor MVP 1307743 Test Plan Card Ciprian Georgiu [DONE] [DONE] Conditionally signed off on 2017-05-24 as YELLOW, because of bug 1350969, full test report here.
ICE TCP 1176382 Card Iulia Cristescu [DONE] [DONE] Signed off on 2017-05-25 as GREEN, full test report here.
Flash async drawing 1229961 Test Plan Card Stefan Georgiev (Engineering QA) [AT RISK] [AT RISK] Will ride Firefox 55 instead for 32-bit users, per Trello.
Mobile bookmarks 1295237 Test Plan Kanchan Kumari (Engineering QA) [DONE] [DONE] Signed off on 2017-06-01 as GREEN, full test report here.

Detailed test results

Note: New and known bugs are listed in https://testrail.stage.mozaws.net/index.php?/plans/defects/4852

New bugs

Full Query
ID Summary Status Resolution Keywords
1377112 Go to download page option active in Library for some downloaded files RESOLVED WORKSFORME regression

1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);


Known bugs

High-impact bugs also encountered in previous builds

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1


Low-impact bugs also encountered in previous builds

Full Query
ID Summary Status Resolution
1126762 Open containing folder not working on paused downloads. RESOLVED WORKSFORME
1161952 [Ubuntu] Low quality when printing a pdf file RESOLVED WORKSFORME
1176218 [Youtube][HTML5] 8K videos do not work at all, or Audio only VERIFIED FIXED
1194214 [HTML5] Several side effects using the context menu options on Youtube NEW
1230678 youtube shows black line 720p & 1080p videos in normal view mode VERIFIED FIXED
1277327 Video on gaming.youtube.com lags behind while scrolling RESOLVED INCOMPLETE
1348290 Pause contextual menu option is grayed out after cancelling and resuming a download RESOLVED INVALID

7 Total; 1 Open (14.29%); 4 Resolved (57.14%); 2 Verified (28.57%);


Bug fix verification

Note: All verified Firefox 54 bug fixes are listed in https://goo.gl/vCGKG3.
Full Query
ID Summary Status Resolution Keywords
1366744 Printing (including save to PDF) mostly results in empty pages since bug 675709 has been fixed VERIFIED FIXED regression
1371962 Misplaced tab separators near hovered/focused tabs whose titles are faded out to the opposite of the browser's UI direction VERIFIED FIXED regression
1371995 "New Tab" is cut off / doesn't fade out in loading tabs VERIFIED FIXED regression
1373109 [e10s] downloads in a new window or tab launched from a tab that itself was opened by a previous page automatically close the wrong tab VERIFIED FIXED dev-doc-complete, multiprocess, regression, site-compat
1375708 Netflix broken on Linux in Firefox 54 VERIFIED FIXED

5 Total; 0 Open (0%); 0 Resolved (0%); 5 Verified (100%);


Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed
Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_54/Test_Plan/Beta/54.0.1&oldid=1174757"