Releases/Firefox 54/Test Plan/Beta/RC2

From MozillaWiki
Jump to: navigation, search

«  Firefox 54 RC1 | Firefox 54 RC2 | Firefox 54 RC3 »

Firefox 54 RC2 Test Plan

Build information

Manual QA's recommendation for this build

Note: Recommendation based on results from manual testing.
BUILD TESTING STATUS RECOMMENDATION REASON(S)
54.0-build3 COMPLETED 100% SHIP IT
  • No new issues uncovered.
  • The encountered known bugs are low-impact and have been shipped with earlier releases as well.

Manual testing summary

PLATFORM ASSIGNEE BUILD GPU STATUS PER TEST SUITE
Web compatibility (spot-check) Add-on compatibility (spot-check)
Windows 7 x64 Ciprian Georgiu 64-bit ATI Radeon HD 3000 GREEN GREEN
Windows 10 x64 Gabi Cheta 64-bit Intel HD 5500 GREEN GREEN
macOS 10.12 Cornel Ionce 64-bit Intel Iris Pro (1536 MB) GREEN GREEN
Ubuntu 16.04 x64 Mihai Boldan 64-bit Intel HD Graphics 520 GREEN GREEN

Features in Firefox 54

Note: Pre-Release feature sign offs are scheduled to be completed by May 26th.
Note: See https://goo.gl/I6hq5C for a general overview.
FEATURE NAME TRACKING QA CONTACTS TESTING STATUS SIGN OFF STATUS ADDITIONAL NOTES
Bugzilla Wiki Trello
client-side stackwalking: ping sender 1310703 Test Plan Petruta Rasa [DONE] [DONE] Signed off on 2017-05-26 as GREEN, full test report here.
Firefox Screenshots system add-on Test Plan Card Iulia Cristescu [AT RISK] [AT RISK] Will ride Firefox 55 instead, per Trello.
Download Panel UX Redesign 1269956 Test Plan Card Cristian Comorasu [DONE] [DONE] Signed off on 2017-05-25 as GREEN, full test report here.
Net Monitor MVP 1307743 Test Plan Card Ciprian Georgiu [DONE] [DONE] Conditionally signed off on 2017-05-24 as YELLOW, because of bug 1350969, full test report here.
ICE TCP 1176382 Card Iulia Cristescu [DONE] [DONE] Signed off on 2017-05-25 as GREEN, full test report here.
Flash async drawing 1229961 Test Plan Card Stefan Georgiev (Engineering QA) [AT RISK] [AT RISK] Will ride Firefox 55 instead for 32-bit users, per Trello.
Mobile bookmarks 1295237 Test Plan Kanchan Kumari (Engineering QA) [DONE] [DONE] Signed off on 2017-06-01 as GREEN, full test report here.

Detailed test results

New bugs

Bugzilla query error

error, http-bad-status, Array


Known bugs

High-impact bugs also encountered in previous builds

Bugzilla query error

error, http-bad-status, Array


Low-impact bugs also encountered in previous builds

Full Query
ID Summary Status Resolution
616629 "Remember Password?" dialog shows too early RESOLVED DUPLICATE
1194214 [HTML5] Several side effects using the context menu options on Youtube NEW
1233359 Glitches after opening images in facebook NEW
1329884 Handle notifications for simultaneous installs better NEW
1362380 The Home page is scrolled to the top when opening a photo on LinkedIn RESOLVED WORKSFORME

5 Total; 3 Open (60%); 2 Resolved (40%); 0 Verified (0%);


Bug fix verification

Note: All verified Firefox 54 bug fixes are listed in https://goo.gl/vCGKG3.
Full Query
ID Summary Status Resolution Keywords
1357090 Out-of-bounds array access in WebGLTexture::ImageInfoAtFace VERIFIED FIXED csectype-bounds, sec-high, testcase
1363396 heap-use-after-free in nsDocViewerSelectionListener::NotifySelectionChanged VERIFIED FIXED csectype-uaf, sec-high
1365602 heap-use-after-free in nsQuoteList::RecalcAll VERIFIED FIXED csectype-uaf, sec-critical
1366595 Stack-use-after-scope in NS_strlen while logging errors in XHR RESOLVED FIXED csectype-uaf, regression, sec-high, testcase
1366875 SVG image element flickers when updating the value of the xlink:href attribute VERIFIED FIXED regression
1368599 Disable TLS 1.3 by default for FF 54 VERIFIED FIXED
1369367 Crash in mozilla::dom::WindowBinding::get_onunload RESOLVED FIXED crash

7 Total; 0 Open (0%); 2 Resolved (28.57%); 5 Verified (71.43%);




Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed