Releases/Firefox 55/Test Plan/Beta/3

From MozillaWiki
Jump to: navigation, search

«  Firefox 55 Beta 2 | Firefox 55 Beta 3 | Firefox 55 Beta 4 »

Firefox 55 Beta 3 Test Plan

Build information

Manual QA'S recommendation for this build

Note: Recommendation based on results from manual testing.
BUILD TESTING STATUS RECOMMENDATION REASON(S)
55.0b3-build1 COMPLETED 100% SHIP IT One new bug bug 1374662 was found, but it has a low impact and we don't consider a blocker.

Manual testing summary

PLATFORM ASSIGNEE BUILD GPU STATUS PER TEST SUITE
New Tab Page PDF Viewer Printing
Windows 10 x86 Alex Simonca 32-bit Intel HD 530 RED (bug 1374662) GREEN GREEN
Windows 7 x64 Ciprian Georgiu 64-bit ATI Radeon HD 3000 GREEN GREEN GREEN
Mac OS X 10.10 Mihai Boldan 64-bit Intel Iris Pro 1536 MB GREEN GREEN GREEN
Ubuntu 14.04 x64 Camelia Badau 64-bit Intel HD 5500 GREEN GREEN GREEN

Features in Firefox 55

Note: Pre-Release feature sign offs are scheduled to be completed by July 21st.
Note: See https://goo.gl/lRb7yH for a general overview.
FEATURE NAME TRACKING QA CONTACTS TESTING STATUS SIGN OFF STATUS ADDITIONAL NOTES
Bugzilla Wiki Trello
One-off Searches from Awesomebar 1180944 Test Plan Card Petruta Rasa (Release QA) [ON TRACK] [NOT STARTED] The feature is currently being assessed post merge to Beta.
Shutdown Video Decoder 1293963 Test Plan Card Bogdan Maris (Release QA) [ON TRACK] [NOT STARTED] The feature is currently being assessed post merge to Beta.
Application Update UI 893505 Test Plan Roxana Leitan (Engineering QA) [ON TRACK] [NOT STARTED] The feature is currently being assessed post merge to Beta.
Enable async scrolling via scrollbar dragging 1333965 Test Plan Ovidiu Boca (Engineering QA) [ON TRACK] [NOT STARTED] The feature is currently being assessed post merge to Beta.
Shutdown ping 1336360 Test Plan Petruta Rasa (Release QA) [ON TRACK] [NOT STARTED] The feature is currently being assessed post merge to Beta.
Deny plugins from non-HTTP/HTTPS protocols 1335475 Stefan Georgiev (Engineering QA) [ON TRACK] [NOT STARTED] The feature is currently being assessed post merge to Beta.
Windows Stub Installer 797208 Test Plan Card Camelia Badau (Release QA) [ON TRACK] [NOT STARTED] The feature is currently being assessed post merge to Beta.
Separate Content Process for loading file:// URI pages 1147911 Test Plan Card Cristian Comorasu (Release QA) [ON TRACK] [NOT STARTED] The feature is currently being assessed post merge to Beta.
Graphics Stability 1303736 Test Plan Card Roxana Leitan (Engineering QA) [ON TRACK] [NOT STARTED] The feature is currently being assessed post merge to Beta.
Flash click-to-play enabled by default 1365714 Test Plan Card Stefan Georgiev (Engineering QA) [ON TRACK] [NOT STARTED] The feature is currently being assessed post merge to Beta.
Turning on Search Suggestions 1344919 Test Plan Card Simona Badau (Engineering QA) [ON TRACK] [NOT STARTED] The feature is currently being assessed post merge to Beta.
client-side stackwalking: client_crash_ID 1322611 Test Plan Card Petruta Rasa (Release QA) [ON TRACK] [NOT STARTED] The feature is currently being assessed post merge to Beta.
Flash SHIELD Experiment 1277346 Test Plan Stefan Georgiev (Engineering QA) [ON TRACK] [NOT STARTED] The feature is currently being assessed post merge to Beta, it may not ride 55.
New Editor work 1297414 Bogdan Maris (Release QA) [ON TRACK] [NOT STARTED] The feature is currently being assessed post merge to Beta.
Direct3D v11 DirectX video acceleration 1352442, 1352163 Card Timea Zsoldos (Release QA) [ON TRACK] [NOT STARTED] The feature is currently being assessed post merge to Beta.
Simplify Page (print preview) 1362526 Test Plan Ciprian Georgiu (Release QA) [ON TRACK] [NOT STARTED] The feature is currently being assessed post merge to Beta.
[Quantum] Compositor Process for unaccelerated Windows 1356091 Test Plan Card Anthony Hughes, Alexandru Simonca (Release QA) [ON TRACK] [NOT STARTED] The feature is currently being assessed post merge to Beta.
Streamlined Stub Installer Test Plan Card Camelia Badau (Release QA) [ON TRACK] [NOT STARTED] The feature is currently being assessed post merge to Beta.
Preferences Performance 1364070 Card Hani Yacoub (Engineering QA) [ON TRACK] [NOT STARTED] The feature is currently being assessed post merge to Beta.
Flash Async Drawing 32bit 1340934 Test Plan Card Stefan Georgiev (Engineering QA) [ON TRACK] [NOT STARTED] The feature is currently being assessed post merge to Beta.
Firefox Screenshots system add-on Test Plan Card Iulia Cristescu (Release QA) [ON TRACK] [NOT STARTED] The feature is currently being assessed post merge to Beta.

Detailed test results

New bugs

Full Query
ID Summary Status Resolution Keywords
1374662 Thumbnails disappear from "about:newtab" when adding a new thumbnail RESOLVED INVALID

1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);


Known bugs

High-impact bugs also encountered in previous builds

Bugzilla query error

error, http-bad-status, Array


Low-impact bugs also encountered in previous builds

Full Query
ID Summary Status Resolution
839074 Selected text doesn't stay selected after zoom RESOLVED FIXED
1037792 Cannot scroll by dragging the scrollbar thumb after doing Ctrl+A (Select All) NEW
1144124 Select all in PDFs also selects text in the pdf.js UI NEW
1161952 [Ubuntu] Low quality when printing a pdf file RESOLVED WORKSFORME
1267592 "Select all" context menu option doesn't work in presentation mode using pdf.js RESOLVED WONTFIX
1300525 After selecting a zoom level, navigation keys scroll through zoom levels, not through pages RESOLVED FIXED

6 Total; 2 Open (33.33%); 4 Resolved (66.67%); 0 Verified (0%);


Bug fix verification

Note: All verified Firefox 55 bug fixes are listed in https://goo.gl/P4fVbx.
Full Query
ID Summary Status Resolution Keywords
1227630 Crashed background tabs lose their favicons VERIFIED FIXED
1292051 Show box model properties under the box model VERIFIED FIXED dev-doc-needed
1328070 [e10s] Zooming with Ctrl+Mouse wheel scroll doesn't work if I drag tab in another window VERIFIED FIXED regression
1330814 [e10s APZ] flickering black overflow while scrolling VERIFIED FIXED regression, testcase
1350251 HTML5 video.mp4 does not play properly when e10s is disabled under the condition that hardware H 264 decoding is blocked VERIFIED FIXED regression, singleprocess
1367581 Downloaded in private browsing mode files from mega.nz showing in main window's downloads list VERIFIED FIXED regression
1372242 The search suggestions hint is not smooth enough when animating VERIFIED FIXED

7 Total; 0 Open (0%); 0 Resolved (0%); 7 Verified (100%);


Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed