Releases/Firefox 55/Test Plan/Beta/RC3
From MozillaWiki
« Firefox 55 RC build 2 | Firefox 55 RC build 3 | Firefox 55.0.1»
Firefox 55 Release Candidate Test Plan
Build information
- Release week: August 7th, 2017. Plan is to ship this build on Tuesday, August 8th, 2017 — Release Calendar.
- Build: 55.0-build3 | 9e30e915f132 | 20170803103124 | bugs since previous changeset.
- QA contacts: Florin Mezei (:FlorinMezei), Andrei Vaida (:avaida), Cornel Ionce (:cornel_ionce) — online on #qa and #release-drivers, ⌚️UTC+02:00.
Manual QA'S recommendation for this build
Note: Recommendation based on results from manual testing.
BUILD | TESTING STATUS | RECOMMENDATION | REASON(S) |
---|---|---|---|
55.0-build2 | COMPLETED (100%) | SHIP IT |
|
Manual testing summary
Note: Test Plan available at https://testrail.stage.mozaws.net/index.php?/plans/view/5523
PLATFORM | ASSIGNEE | BUILD | GPU | STATUS PER TEST SUITE | |||
---|---|---|---|---|---|---|---|
Web Compatibility | |||||||
Windows 7 x64 | Camelia Badau | 32-bit | NVIDIA GeForce 210 | PASSED | |||
Windows 10 x64 | Iulia Cristescu | 64-bit | Intel HD 4600 | PASSED | |||
macOS 10.12 | Cristian Comorasu | 64-bit | Intel Iris Pro | PASSED | |||
Ubuntu 14.04 x64 | Timea Zsoldos | 64-bit | AMD RS780 | PASSED |
Features in Firefox 55
Note: Pre-Release feature sign offs are scheduled to be completed by July 21st.
Note: See https://goo.gl/lRb7yH for a general overview.
FEATURE NAME | TRACKING | QA CONTACTS | TESTING STATUS | PRELIMINARY REPORTING STATUS | SIGN OFF STATUS | ADDITIONAL NOTES | ||
---|---|---|---|---|---|---|---|---|
Bugzilla | Wiki | Trello | ||||||
One-off Searches from Awesomebar | 1180944 | Test Plan | Card | Petruta Rasa (Release QA) | [DONE] | [INVESTIGATION NEEDED] | [INVESTIGATION NEEDED] | Pre-Release sign off is YELLOW. |
Shutdown Video Decoder | 1293963 | Test Plan | Card | Bogdan Maris (Release QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREEN. |
Application Update UI | 893505 | Test Plan | Roxana Leitan (Engineering QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREEN. | |
Enable async scrolling via scrollbar dragging | 1333965 | Test Plan | Ovidiu Boca (Engineering QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREEN. | |
Shutdown ping | 1336360 | Test Plan | Petruta Rasa (Release QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREEN. | |
Deny plugins from non-HTTP/HTTPS protocols | 1335475 | Stefan Georgiev (Engineering QA) | [DONE] | [MISSED] | [DONE] | Pre-Release sign off is GREEN. | ||
Windows Stub Installer | 797208 | Test Plan | Card | Camelia Badau (Release QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREEN. |
Separate Content Process for loading file:// URI pages | 1147911 | Test Plan | Card | Cristian Comorasu (Release QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREENS. |
Graphics Stability | 1303736 | Test Plan | Card | Roxana Leitan (Engineering QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREEN. |
Flash click-to-play enabled by default | 1365714 | Test Plan | Card | Stefan Georgiev (Engineering QA) | [DONE] | [MISSED] | [INVESTIGATION NEEDED] | Pre-Release sign off is YELLOW. |
Turning on Search Suggestions | 1344919 | Test Plan | Card | Simona Badau (Engineering QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREEN. |
client-side stackwalking: client_crash_ID | 1322611 | Test Plan | Card | Petruta Rasa (Release QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREEN. |
Flash SHIELD Experiment | 1277346 | Test Plan | Stefan Georgiev (Engineering QA) | [ON TRACK] | [MISSED] | [NOT STARTED] | Pending assessment. | |
New Editor work | 1297414 | Bogdan Maris (Release QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREEN. | ||
Direct3D v11 DirectX video acceleration | 1352442, 1352163 | Card | Timea Zsoldos (Release QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREEN. | |
Simplify Print | 1362526 | Test Plan | Ciprian Georgiu (Release QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREEN. | |
[Quantum] Compositor Process for unaccelerated Windows | 1356091 | Test Plan | Card | Anthony Hughes, Alexandru Simonca (Release QA) | [ON TRACK] | [MISSED] | [IN PROGRESS] | Pre-Release sign off is IN PROGRESS. |
Streamlined Stub Installer | Test Plan | Card | Camelia Badau (Release QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREEN. | |
Preferences Performance | 1364070 | Card | Hani Yacoub (Engineering QA) | [AT RISK] | [DONE] | [AT RISK] | Pre-Release sign off is RED. | |
Flash Async Drawing 32bit | 1340934 | Test Plan | Card | Stefan Georgiev (Engineering QA) | [ON TRACK] | [MISSED] | [NOT STARTED] | Pending assessment. |
Firefox Screenshots system add-on | Test Plan | Card | Iulia Cristescu (Release QA) | [AT RISK] | [INVESTIGATION NEEDED] | [INVESTIGATION NEEDED] | Pre-Release sign off is YELLOW. | |
WebVR | 1250244 | Test Plan | Card | Cristian Comorasu (Release QA) | [AT RISK] | [AT RISK] | [INVESTIGATION NEEDED] | Pre-Release sign off is YELLOW. |
Detailed test results
Note: New and known bugs are listed in https://testrail.stage.mozaws.net/index.php?/plans/defects/5523
New bugs
Bugzilla query error
error, http-bad-status, Array
Known bugs
High-impact bugs also encountered in previous builds
Bugzilla query error
error, http-bad-status, Array
Low-impact bugs also encountered in previous builds
12 Total; 2 Open (16.67%); 9 Resolved (75%); 1 Verified (8.33%);
Bug fix verification
Note: All verified Firefox 55 bug fixes are listed in https://goo.gl/P4fVbx.
ID | Summary | Status | Resolution | Keywords |
---|---|---|---|---|
1386759 | Disable network.http.throttle.enable in FF55 release | VERIFIED | FIXED |
1 Total; 0 Open (0%); 0 Resolved (0%); 1 Verified (100%);
Status tags
- [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
- [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
- [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
- [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
- [IN PROGRESS] - {{mprog}} - actively being tested on
- [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed