Releases/Firefox 55/Test Plan/Beta/12
Jump to navigation
Jump to search
Full Query
« Firefox 55 Beta 11 | Firefox 55 Beta 12 | Firefox 55 Beta 13 »
Firefox 55 Beta 12 Test Plan
Build information
- Release week: July 25th, 2017. Plan is to ship this build on Tuesday, July 25th, 2017 — Release Calendar.
- Build: 55.0b12-build1 | 5ff8131b5512 | 20170724055319 | bugs since previous changeset.
- QA contacts: Florin Mezei (:FlorinMezei), Andrei Vaida (:avaida), Cornel Ionce (:cornel_ionce) — online on #qa and #release-drivers, ⌚️UTC+02:00.
Manual QA'S recommendation for this build
Note: Recommendation based on results from manual testing.
| BUILD | TESTING STATUS | RECOMMENDATION | REASON(S) |
|---|---|---|---|
| 55.0b12-build1 | COMPLETED (100%) | SHIP IT | Several known issues encountered, but none of them severe enough to block. Build status is YELLOW. |
Manual testing summary
Note: Test Plan available at https://testrail.stage.mozaws.net/index.php?/plans/view/5298
| PLATFORM | ASSIGNEE | BUILD | GPU | STATUS PER TEST SUITE | |||
|---|---|---|---|---|---|---|---|
| Firefox Screenshots | Downloads | ||||||
| Windows 7 x86 | Camelia Badau | 32-bit | NVIDIA GeForce 210 | YELLOW | GREEN | ||
| Windows 8.1 x64 | Timea Zsoldos | 64-bit | AMD Radeon HD 3000 | YELLOW | GREEN | ||
| Mac OS X 10.10 | Alexandru Simonca | 64-bit | NVIDIA GeForce GT 640M | YELLOW | GREEN | ||
| Ubuntu 14.04 x64 | Mihai Boldan | 64-bit | Intel HD 2500 | YELLOW | GREEN | ||
Features in Firefox 55
Note: Pre-Release feature sign offs are scheduled to be completed by July 21st.
Note: See https://goo.gl/lRb7yH for a general overview.
| FEATURE NAME | TRACKING | QA CONTACTS | TESTING STATUS | PRELIMINARY REPORTING STATUS | SIGN OFF STATUS | ADDITIONAL NOTES | ||
|---|---|---|---|---|---|---|---|---|
| Bugzilla | Wiki | Trello | ||||||
| One-off Searches from Awesomebar | 1180944 | Test Plan | Card | Petruta Rasa (Release QA) | [DONE] | [INVESTIGATION NEEDED] | [INVESTIGATION NEEDED] | Pre-Release sign off is YELLOW. |
| Shutdown Video Decoder | 1293963 | Test Plan | Card | Bogdan Maris (Release QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREEN. |
| Application Update UI | 893505 | Test Plan | Roxana Leitan (Engineering QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREEN. | |
| Enable async scrolling via scrollbar dragging | 1333965 | Test Plan | Ovidiu Boca (Engineering QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREEN. | |
| Shutdown ping | 1336360 | Test Plan | Petruta Rasa (Release QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREEN. | |
| Deny plugins from non-HTTP/HTTPS protocols | 1335475 | Stefan Georgiev (Engineering QA) | [DONE] | [MISSED] | [DONE] | Pre-Release sign off is GREEN. | ||
| Windows Stub Installer | 797208 | Test Plan | Card | Camelia Badau (Release QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREEN. |
| Separate Content Process for loading file:// URI pages | 1147911 | Test Plan | Card | Cristian Comorasu (Release QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREENS. |
| Graphics Stability | 1303736 | Test Plan | Card | Roxana Leitan (Engineering QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREEN. |
| Flash click-to-play enabled by default | 1365714 | Test Plan | Card | Stefan Georgiev (Engineering QA) | [DONE] | [MISSED] | [INVESTIGATION NEEDED] | Pre-Release sign off is YELLOW. |
| Turning on Search Suggestions | 1344919 | Test Plan | Card | Simona Badau (Engineering QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREEN. |
| client-side stackwalking: client_crash_ID | 1322611 | Test Plan | Card | Petruta Rasa (Release QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREEN. |
| Flash SHIELD Experiment | 1277346 | Test Plan | Stefan Georgiev (Engineering QA) | [ON TRACK] | [MISSED] | [NOT STARTED] | Pending assessment. | |
| New Editor work | 1297414 | Bogdan Maris (Release QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREEN. | ||
| Direct3D v11 DirectX video acceleration | 1352442, 1352163 | Card | Timea Zsoldos (Release QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREEN. | |
| Simplify Print | 1362526 | Test Plan | Ciprian Georgiu (Release QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREEN. | |
| [Quantum] Compositor Process for unaccelerated Windows | 1356091 | Test Plan | Card | Anthony Hughes, Alexandru Simonca (Release QA) | [ON TRACK] | [MISSED] | [IN PROGRESS] | Pre-Release sign off is IN PROGRESS. |
| Streamlined Stub Installer | Test Plan | Card | Camelia Badau (Release QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREEN. | |
| Preferences Performance | 1364070 | Card | Hani Yacoub (Engineering QA) | [AT RISK] | [DONE] | [AT RISK] | Pre-Release sign off is RED. | |
| Flash Async Drawing 32bit | 1340934 | Test Plan | Card | Stefan Georgiev (Engineering QA) | [ON TRACK] | [MISSED] | [NOT STARTED] | Pending assessment. |
| Firefox Screenshots system add-on | Test Plan | Card | Iulia Cristescu (Release QA) | [AT RISK] | [INVESTIGATION NEEDED] | [AT RISK] | Pre-Release sign off is RED. | |
| WebVR | 1250244 | Test Plan | Card | Cristian Comorasu (Release QA) | [AT RISK] | [AT RISK] | [AT RISK] | Pre-Release sign off is RED. |
Detailed test results
Note: New and known bugs are listed in https://testrail.stage.mozaws.net/index.php?/plans/defects/5298
New bugs
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1
Known bugs
High-impact bugs also encountered in previous builds
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1
Low-impact bugs also encountered in previous builds
| ID | Summary | Status | Resolution |
|---|---|---|---|
| 1195053 | Cancelling a retried download gives NS_BASE_STREAM_CLOSED: Component returned failure code: 0x80470002 | NEW | |
| 1348290 | Pause contextual menu option is grayed out after cancelling and resuming a download | RESOLVED | INVALID |
2 Total; 1 Open (50%); 1 Resolved (50%); 0 Verified (0%);
- Other known issues: #2912, #2939, #2698, #2895, #2007, #3085, #3179, #3097, #3174, #3172, #2903, #3155, #3182, #2818.
Bug fix verification
Note: All verified Firefox 55 bug fixes are listed in https://goo.gl/P4fVbx.
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1
Status tags
- [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
- [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
- [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
- [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
- [IN PROGRESS] - {{mprog}} - actively being tested on
- [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed