Releases/Firefox 56/Test Plan/Beta/12

From MozillaWiki
Jump to navigation Jump to search

«  Firefox 56 Beta 11 | Firefox 56 Beta 12 | Firefox 56 RC1 »

Firefox 56 Beta 12 Test Plan

Build information

Manual QA's recommendation for this build

Note: Recommendation based on results from manual testing.
BUILD TESTING STATUS RECOMMENDATION REASON(S)
56.0b12-build1 COMPLETED (100%) SHIP IT
  • No new bugs uncovered.
  • Known (old) bugs encountered are low-impact.

Manual testing summary

Note: Test Plan available at https://testrail.stage.mozaws.net/index.php?/plans/view/6204
PLATFORM ASSIGNEE BUILD GPU STATUS PER TEST SUITE
Add-on compatibility about:preferences revamp
Windows 7 x64 Mihai Boldan 32-bit Intel HD 2500 GREEN GREEN
Windows 10 x64 Camelia Badau 32-bit NVIDIA GeForce 210 GREEN GREEN
Mac OS X 10.9 Iulia Cristescu 64-bit Intel Iris Pro (1536 MB) GREEN GREEN
Ubuntu 14.04 x86 Gabi Cheta 32-bit AMD RS780 GREEN GREEN

Features in Firefox 56

Note: Pre-Release feature sign offs are scheduled to be completed by September 8th, with preliminary reports sent by September 1st.
Note: See https://goo.gl/U1w1cp for a general overview.
FEATURE NAME PRIORITY TRACKING QA CONTACTS TESTING STATUS PRELIMINARY REPORTING STATUS SIGN OFF STATUS ADDITIONAL NOTES
Type Level Bugzilla Wiki Trello
Form Autofill MVP + Sync bug 990176 Test Plan Card Gabi Cheta (Asofie) (RelQA) [DONE] [DONE] [DONE] Feature signed-off as YELLOW.
Form auto fill with credit card support (MVP) + Sync bug 990176 Test Plan Card Gabi Cheta (Asofie) (RelQA) [NOT APPLICABLE] [NOT APPLICABLE] [NOT APPLICABLE] Target release changed to Fx57.
App Updater Improvements (LZMA) bug 641212 Test Plan Card Petruta Horea (Rasa) (RelQA) [DONE] [DONE] [DONE] Feature signed-off as GREEN.
App Updater Improvements (SHA384) bug 1324498 Test Plan Card Petruta Horea (Rasa) (RelQA) [DONE] [DONE] [DONE] Feature signed-off as GREEN.
CSS Grid Inspector Layout View bug 1181227 Test Plan Card Bogdan Maris (RelQA) [DONE] [DONE] [DONE] Feature signed-off as GREEN.
Netmonitor Phase II (Launchpad) bug 1348737 Test Plan Card Ciprian Georgiu (RelQA) [DONE] [DONE] [DONE] Feature signed-off as GREEN.
New DevTools Debugger panel bug 1294139 Test Plan Card Emil Ghitta (RelQA) [DONE] [DONE] [DONE] Feature signed-off as YELLOW.
Media Block Autoplay bug 1308154 Test Plan Card Emil Ghitta (RelQA) [DONE] [DONE] [DONE] Feature signed-off as GREEN.
File read access restrictions n/a Test Plan Card Mihai Boldan (RelQA) [DONE] [DONE] [DONE] Feature signed-off as GREEN.
Expose Sync Tab / send tab bug 1359894 Test Plan n/a Alexandru Simonca (RelQA) [DONE] [DONE] [DONE] Feature signed-off as GREEN.
Photon Onboarding Tour Overlay bug 1354046 Test Plan Card Cristian Comorasu (RelQA) [DONE] [DONE] [DONE] Feature signed-off as GREEN.
Photon Onboarding Tour Notifications bug 1357008 Test Plan Card Cristian Comorasu (RelQA) [DONE] [DONE] [DONE] Feature signed-off as GREEN.
Photon Preferences Reorg v2 bug 1365133 Test Plan Card Camelia Badau (RelQA) [DONE] [DONE] [DONE] Feature signed-off as GREEN.
Photon Search Preferences bug 1357285 Test Plan Card Camelia Badau (RelQA) [DONE] [DONE] [DONE] Feature signed-off as YELLOW.
Keyboard APZ & Autoscrolling bug 1351783,1376525,1105109 Test Plan Card Petruta Horea (Rasa) (RelQA) [NOT APPLICABLE] [NOT APPLICABLE] [NOT APPLICABLE] Target release changed to Fx57.
Advanced Layers bug 1365879 n/a n/a Ovidiu Boca (EngQA) [NOT APPLICABLE] [NOT APPLICABLE] [NOT APPLICABLE] Target release changed to Fx57.
Safe Browsing v4 bug 1359337 Test Plan n/a Timea Zsoldos (RelQA) [DONE] [DONE] [DONE] Feature signed-off as GREEN.

Detailed test results

Note: New and known bugs are listed in https://testrail.stage.mozaws.net/index.php?/plans/defects/6204

New bugs

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1


Known bugs

High-impact bugs also encountered in previous builds

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1


Low-impact bugs also encountered in previous builds

Full Query
ID Summary Status Resolution
1329884 Handle notifications for simultaneous installs better NEW
1396583 Wrong Tooltip position after searching for "firefox"/"nightly" VERIFIED FIXED
1396585 Glitch on Default Search Engine drop-down each time you search an engine RESOLVED WORKSFORME
1396592 Selected area restricted due to search tooltip NEW
1396593 Unusual design for Tooltip when using High Contrast theme RESOLVED WORKSFORME
1399856 No highlighter displayed when searching for strings inside Use custom settings from History RESOLVED WONTFIX

6 Total; 2 Open (33.33%); 3 Resolved (50%); 1 Verified (16.67%);


Bug fix verification

Note: All verified Firefox 56 bug fixes are listed in https://goo.gl/CDJvYv.
Full Query
ID Summary Status Resolution Keywords
1385666 phpBB(BBcode/HTML view) show wrong position conversion candidates Japanese IME. VERIFIED FIXED inputmethod, multiprocess
1391186 Thunderbird loses setting as default email client when "mailto" triggered by Firefox 56/57 VERIFIED FIXED regression
1392570 Firefox fails to launch on Windows 7 when already running in a job. VERIFIED FIXED

3 Total; 0 Open (0%); 0 Resolved (0%); 3 Verified (100%);


Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed
Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_56/Test_Plan/Beta/12&oldid=1180525"