Releases/Firefox 56/Test Plan/Beta/RC2
From MozillaWiki
« Firefox 56 Release Candidate | Firefox 56 Release Candidate 2 | Firefox 56.0.1»
Firefox 56 Release Candidate 2 Test Plan
Build information
- Release week: September 25th, 2017. Plan is to ship this build on Tue, Sep 28th, 2017 — Release Calendar.
- Build: 56.0-build4 | f8e1f3cada56 | 20170922200134 | bugs since previous changeset | https://mzl.la/2fFRy7B.
- Build: 56.0-build6 | 8fbf05f4b921 | 20170926190823 | bugs since previous changeset | https://goo.gl/1dFZns.
- QA contacts: Florin Mezei (:FlorinMezei), Andrei Vaida (:avaida), Cornel Ionce (:cornel_ionce) — online on #qa and #release-drivers, ⌚️UTC+02:00.
Manual QA's recommendation for this build
Note: Recommendation based on results from manual testing.
BUILD | TESTING STATUS | RECOMMENDATION | REASON(S) |
---|---|---|---|
56.0-build4 | COMPLETED (100%) | SHIP IT |
|
56.0-build6 | COMPLETED (100%) | SHIP IT |
|
Manual testing summary
56.0-build4
Note: Test Plan available at https://testrail.stage.mozaws.net/index.php?/plans/view/6398
PLATFORM | ASSIGNEE | BUILD | GPU | STATUS PER TEST SUITE | |||
---|---|---|---|---|---|---|---|
Web compatibility | |||||||
Windows 7 x64 | Emil Ghitta | 32-bit | AMD 760G | GREEN | |||
Windows 10 x64 | Ciprian Georgiu | 64-bit | ATI Radeon 3000 | GREEN | |||
macOS 10.12 | Timea Zsoldos | 64-bit | NVIDIA GeForce GT 640M | GREEN | |||
Ubuntu 16.04 x64 | Iulia Cristescu | 64-bit | Intel HD 520 | GREEN |
56.0-build6
Note: Test Plan available at https://testrail.stage.mozaws.net/index.php?/plans/view/6440
PLATFORM | ASSIGNEE | BUILD | GPU | STATUS PER TEST SUITE | |||
---|---|---|---|---|---|---|---|
Web compatibility | Video compatibility | ||||||
Windows 7 x64 | Emil Ghitta | 32-bit | AMD 760G | GREEN | GREEN | ||
Windows 10 x64 | Gabi Cheta | 64-bit | ATI Radeon 3000 | GREEN | GREEN | ||
macOS 10.12 | Timea Zsoldos | 64-bit | NVIDIA GeForce GT 640M | GREEN | GREEN | ||
Ubuntu 16.04 x64 | Iulia Cristescu | 64-bit | Intel HD 520 | GREEN | GREEN |
Features in Firefox 56
Note: Pre-Release feature sign offs are scheduled to be completed by September 8th, with preliminary reports sent by September 1st.
Note: See https://goo.gl/U1w1cp for a general overview.
FEATURE NAME | PRIORITY | TRACKING | QA CONTACTS | TESTING STATUS | PRELIMINARY REPORTING STATUS | SIGN OFF STATUS | ADDITIONAL NOTES | |||
---|---|---|---|---|---|---|---|---|---|---|
Type | Level | Bugzilla | Wiki | Trello | ||||||
Form Autofill MVP + Sync | bug 990176 | Test Plan | Card | Gabi Cheta (Asofie) (RelQA) | [DONE] | [DONE] | [DONE] | Feature signed-off as YELLOW. | ||
Form auto fill with credit card support (MVP) + Sync | bug 990176 | Test Plan | Card | Gabi Cheta (Asofie) (RelQA) | [NOT APPLICABLE] | [NOT APPLICABLE] | [NOT APPLICABLE] | Target release changed to Fx57. | ||
App Updater Improvements (LZMA) | bug 641212 | Test Plan | Card | Petruta Horea (Rasa) (RelQA) | [DONE] | [DONE] | [DONE] | Feature signed-off as GREEN. | ||
App Updater Improvements (SHA384) | bug 1324498 | Test Plan | Card | Petruta Horea (Rasa) (RelQA) | [DONE] | [DONE] | [DONE] | Feature signed-off as GREEN. | ||
CSS Grid Inspector Layout View | bug 1181227 | Test Plan | Card | Bogdan Maris (RelQA) | [DONE] | [DONE] | [DONE] | Feature signed-off as GREEN. | ||
Netmonitor Phase II (Launchpad) | bug 1348737 | Test Plan | Card | Ciprian Georgiu (RelQA) | [DONE] | [DONE] | [DONE] | Feature signed-off as GREEN. | ||
New DevTools Debugger panel | bug 1294139 | Test Plan | Card | Emil Ghitta (RelQA) | [DONE] | [DONE] | [DONE] | Feature signed-off as YELLOW. | ||
Media Block Autoplay | bug 1308154 | Test Plan | Card | Emil Ghitta (RelQA) | [DONE] | [DONE] | [DONE] | Feature signed-off as GREEN. | ||
File read access restrictions | n/a | Test Plan | Card | Mihai Boldan (RelQA) | [DONE] | [DONE] | [DONE] | Feature signed-off as GREEN. | ||
Expose Sync Tab / send tab | bug 1359894 | Test Plan | n/a | Alexandru Simonca (RelQA) | [DONE] | [DONE] | [DONE] | Feature signed-off as GREEN. | ||
Photon Onboarding Tour Overlay | bug 1354046 | Test Plan | Card | Cristian Comorasu (RelQA) | [DONE] | [DONE] | [DONE] | Feature signed-off as GREEN. | ||
Photon Onboarding Tour Notifications | bug 1357008 | Test Plan | Card | Cristian Comorasu (RelQA) | [DONE] | [DONE] | [DONE] | Feature signed-off as GREEN. | ||
Photon Preferences Reorg v2 | bug 1365133 | Test Plan | Card | Camelia Badau (RelQA) | [DONE] | [DONE] | [DONE] | Feature signed-off as GREEN. | ||
Photon Search Preferences | bug 1357285 | Test Plan | Card | Camelia Badau (RelQA) | [DONE] | [DONE] | [DONE] | Feature signed-off as YELLOW. | ||
Keyboard APZ & Autoscrolling | bug 1351783,1376525,1105109 | Test Plan | Card | Petruta Horea (Rasa) (RelQA) | [NOT APPLICABLE] | [NOT APPLICABLE] | [NOT APPLICABLE] | Target release changed to Fx57. | ||
Advanced Layers | bug 1365879 | n/a | n/a | Ovidiu Boca (EngQA) | [NOT APPLICABLE] | [NOT APPLICABLE] | [NOT APPLICABLE] | Target release changed to Fx57. | ||
Safe Browsing v4 | bug 1359337 | Test Plan | n/a | Timea Zsoldos (RelQA) | [DONE] | [DONE] | [DONE] | Feature signed-off as GREEN. |
Detailed test results
Note: New and known bugs for 56.0-build4 are listed in https://testrail.stage.mozaws.net/index.php?/plans/defects/6398
Note: New and known bugs for 56.0-build6 are listed in https://testrail.stage.mozaws.net/index.php?/plans/defects/6440
New bugs
ID | Summary | Status | Resolution | Keywords |
---|---|---|---|---|
1402827 | Video freezes after interacting with the seekbar | RESOLVED | WONTFIX | regression |
1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);
Known bugs
High-impact bugs also encountered in previous builds
No results.
0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);
Low-impact bugs also encountered in previous builds
ID | Summary | Status | Resolution |
---|---|---|---|
558178 | Only show password capture dialog if we're reasonably sure the password was correct and the login was successful | RESOLVED | WONTFIX |
616629 | "Remember Password?" dialog shows too early | RESOLVED | DUPLICATE |
1182606 | Context menu for video elements should check .mozHasAudio property | NEW | |
1191290 | Glitches after opening images in tumblr | RESOLVED | WORKSFORME |
1194214 | [HTML5] Several side effects using the context menu options on Youtube | NEW | |
1230678 | youtube shows black line 720p & 1080p videos in normal view mode | VERIFIED | FIXED |
1233359 | Glitches after opening images in facebook | NEW | |
1305744 | Twitter profile picture glitches when the page is scrolled in maximized window | RESOLVED | WORKSFORME |
1309534 | Glitches when zoom in .jpg files from Wikipedia | NEW | |
1402827 | Video freezes after interacting with the seekbar | RESOLVED | WONTFIX |
1403118 | The lowest pixel of certain characters is cut off on Outlook Tasks | RESOLVED | FIXED |
11 Total; 4 Open (36.36%); 6 Resolved (54.55%); 1 Verified (9.09%);
Bug fix verification
Note: All verified Firefox 56 bug fixes are listed in https://goo.gl/CDJvYv.
Bugzilla query error
error, http-bad-status, Array
Status tags
- [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
- [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
- [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
- [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
- [IN PROGRESS] - {{mprog}} - actively being tested on
- [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed