Releases/Firefox 56/Test Plan/Beta/RC1
Firefox 56 Release Candidate Test Plan
Build information
- Release week: September 18th, 2017. Plan is to ship this build on Tue, Sep 19th, 2017 — Release Calendar.
- Build: 56.0-build1 | 3d2edf73fb90 | 20170918210324 | bugs since previous changeset | https://goo.gl/7yhZzz.
- QA contacts: Florin Mezei (:FlorinMezei), Andrei Vaida (:avaida), Cornel Ionce (:cornel_ionce) — online on #qa and #release-drivers, ⌚️UTC+02:00.
Manual QA's recommendation for this build
Note: Recommendation based on results from manual testing.
| BUILD | TESTING STATUS | RECOMMENDATION | REASON(S) |
|---|---|---|---|
| 56.0b12-build1 | IN PROGRESS (2%) | TBD |
|
Manual testing summary
Note: Test Plan available at https://testrail.stage.mozaws.net/index.php?/plans/view/6277
| PLATFORM | ASSIGNEE | BUILD | GPU | STATUS PER TEST SUITE | |||
|---|---|---|---|---|---|---|---|
| Web compatibility | |||||||
| Windows 7 x64 | Gabi Cheta | 32-bit | AMD 760G | TBD | |||
| Windows 10 x64 | Mihai Boldan | 32-bit | TBD | ||||
| macOS 10.12 | Andrei Vaida | 64-bit | Intel Iris Pro (1536 MB) | TBD | |||
| Ubuntu 16.04 x64 | Cristian Comorasu | 64-bit | TBD | ||||
Features in Firefox 56
Note: Pre-Release feature sign offs are scheduled to be completed by September 8th, with preliminary reports sent by September 1st.
Note: See https://goo.gl/U1w1cp for a general overview.
| FEATURE NAME | PRIORITY | TRACKING | QA CONTACTS | TESTING STATUS | PRELIMINARY REPORTING STATUS | SIGN OFF STATUS | ADDITIONAL NOTES | |||
|---|---|---|---|---|---|---|---|---|---|---|
| Type | Level | Bugzilla | Wiki | Trello | ||||||
| Form Autofill MVP + Sync | bug 990176 | Test Plan | Card | Gabi Cheta (Asofie) (RelQA) | [DONE] | [DONE] | [DONE] | Feature signed-off as YELLOW. | ||
| Form auto fill with credit card support (MVP) + Sync | bug 990176 | Test Plan | Card | Gabi Cheta (Asofie) (RelQA) | [NOT APPLICABLE] | [NOT APPLICABLE] | [NOT APPLICABLE] | Target release changed to Fx57. | ||
| App Updater Improvements (LZMA) | bug 641212 | Test Plan | Card | Petruta Horea (Rasa) (RelQA) | [DONE] | [DONE] | [DONE] | Feature signed-off as GREEN. | ||
| App Updater Improvements (SHA384) | bug 1324498 | Test Plan | Card | Petruta Horea (Rasa) (RelQA) | [DONE] | [DONE] | [DONE] | Feature signed-off as GREEN. | ||
| CSS Grid Inspector Layout View | bug 1181227 | Test Plan | Card | Bogdan Maris (RelQA) | [DONE] | [DONE] | [DONE] | Feature signed-off as GREEN. | ||
| Netmonitor Phase II (Launchpad) | bug 1348737 | Test Plan | Card | Ciprian Georgiu (RelQA) | [DONE] | [DONE] | [DONE] | Feature signed-off as GREEN. | ||
| New DevTools Debugger panel | bug 1294139 | Test Plan | Card | Emil Ghitta (RelQA) | [DONE] | [DONE] | [DONE] | Feature signed-off as YELLOW. | ||
| Media Block Autoplay | bug 1308154 | Test Plan | Card | Emil Ghitta (RelQA) | [DONE] | [DONE] | [DONE] | Feature signed-off as GREEN. | ||
| File read access restrictions | n/a | Test Plan | Card | Mihai Boldan (RelQA) | [DONE] | [DONE] | [DONE] | Feature signed-off as GREEN. | ||
| Expose Sync Tab / send tab | bug 1359894 | Test Plan | n/a | Alexandru Simonca (RelQA) | [DONE] | [DONE] | [DONE] | Feature signed-off as GREEN. | ||
| Photon Onboarding Tour Overlay | bug 1354046 | Test Plan | Card | Cristian Comorasu (RelQA) | [DONE] | [DONE] | [DONE] | Feature signed-off as GREEN. | ||
| Photon Onboarding Tour Notifications | bug 1357008 | Test Plan | Card | Cristian Comorasu (RelQA) | [DONE] | [DONE] | [DONE] | Feature signed-off as GREEN. | ||
| Photon Preferences Reorg v2 | bug 1365133 | Test Plan | Card | Camelia Badau (RelQA) | [DONE] | [DONE] | [DONE] | Feature signed-off as GREEN. | ||
| Photon Search Preferences | bug 1357285 | Test Plan | Card | Camelia Badau (RelQA) | [DONE] | [DONE] | [DONE] | Feature signed-off as YELLOW. | ||
| Keyboard APZ & Autoscrolling | bug 1351783,1376525,1105109 | Test Plan | Card | Petruta Horea (Rasa) (RelQA) | [NOT APPLICABLE] | [NOT APPLICABLE] | [NOT APPLICABLE] | Target release changed to Fx57. | ||
| Advanced Layers | bug 1365879 | n/a | n/a | Ovidiu Boca (EngQA) | [NOT APPLICABLE] | [NOT APPLICABLE] | [NOT APPLICABLE] | Target release changed to Fx57. | ||
| Safe Browsing v4 | bug 1359337 | Test Plan | n/a | Timea Zsoldos (RelQA) | [DONE] | [DONE] | [DONE] | Feature signed-off as GREEN. | ||
Detailed test results
Note: New and known bugs are listed in https://testrail.stage.mozaws.net/index.php?/plans/defects/6277
New bugs
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1
Known bugs
High-impact bugs also encountered in previous builds
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1
Low-impact bugs also encountered in previous builds
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1
Bug fix verification
Note: All verified Firefox 56 bug fixes are listed in https://goo.gl/CDJvYv.
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1
Status tags
- [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
- [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
- [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
- [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
- [IN PROGRESS] - {{mprog}} - actively being tested on
- [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed