Releases/Firefox 56/Test Plan/Beta/8

From MozillaWiki
Jump to: navigation, search

«  Firefox 56 Beta 7 | Firefox 56 Beta 8 | Firefox 56 Beta 9 »

Firefox 56 Beta 8 Test Plan

Build information

Manual QA's recommendation for this build

Note: Recommendation based on results from manual testing.
BUILD TESTING STATUS RECOMMENDATION REASON(S)
56.0b8-build1 COMPLETED (100%) SHIP IT
  • 2 new bug uncovered, both of them low-impact.
  • Known (old) bugs encountered are also low-impact.

Manual testing summary

PLATFORM ASSIGNEE BUILD GPU STATUS PER TEST SUITE
Plug-in compatibility Customization Photon Onboarding Tour Notifications
Windows 7 x86 Timea Zsoldos 32-bit AMD 760G GREEN GREEN GREEN
Windows 10 x64 Bogdan Maris 64-bit ATI Radeon 3000 GREEN GREEN GREEN
Mac OS X 10.9 Petruta Rasa 64-bit NVIDIA GeForce GT 640M 512 MB GREEN GREEN GREEN
Ubuntu LTS x86 Cristian Comorasu 32-bit Intel HD 530 GREEN GREEN GREEN

Features in Firefox 56

Note: Pre-Release feature sign offs are scheduled to be completed by September 8th, with preliminary reports sent by September 1st.
Note: See https://goo.gl/U1w1cp for a general overview.
FEATURE NAME PRIORITY TRACKING QA CONTACTS TESTING STATUS PRELIMINARY REPORTING STATUS SIGN OFF STATUS ADDITIONAL NOTES
Type Level Bugzilla Wiki Trello
Form Autofill MVP + Sync bug 990176 Test Plan Card Gabi Cheta (Asofie) (RelQA) [NOT STARTED] [IN PROGRESS] [NOT STARTED] Preliminary manual testing report is underway.
Form auto fill with credit card support (MVP) + Sync bug 990176 Test Plan Card Gabi Cheta (Asofie) (RelQA) [NOT STARTED] [IN PROGRESS] [NOT STARTED] Preliminary manual testing report is underway.
App Updater Improvements (LZMA) bug 641212 Test Plan Card Petruta Horea (Rasa) (RelQA) [NOT STARTED] [IN PROGRESS] [NOT STARTED] Preliminary manual testing report is underway.
App Updater Improvements (SHA384) bug 1324498 Test Plan Card Petruta Horea (Rasa) (RelQA) [NOT STARTED] [IN PROGRESS] [NOT STARTED] Preliminary manual testing report is underway.
CSS Grid Inspector Layout View bug 1181227 Test Plan Card Bogdan Maris (RelQA) [NOT STARTED] [IN PROGRESS] [NOT STARTED] Preliminary manual testing report is underway.
Netmonitor Phase II (Launchpad) bug 1348737 Test Plan Card Ciprian Georgiu (RelQA) [NOT STARTED] [IN PROGRESS] [NOT STARTED] Preliminary manual testing report is underway.
New DevTools Debugger panel bug 1294139 Test Plan Card Emil Ghitta (RelQA) [NOT STARTED] [IN PROGRESS] [NOT STARTED] Preliminary manual testing report is underway.
Media Block Autoplay bug 1308154 Test Plan Card Emil Ghitta (RelQA) [NOT STARTED] [IN PROGRESS] [NOT STARTED] Preliminary manual testing report is underway.
File read access restrictions n/a Test Plan Card Mihai Boldan (RelQA) [NOT STARTED] [IN PROGRESS] [NOT STARTED] Preliminary manual testing report is underway.
Expose Sync Tab / send tab bug 1359894 Test Plan n/a Alexandru Simonca (RelQA) [NOT STARTED] [IN PROGRESS] [NOT STARTED] Preliminary manual testing report is underway.
Photon Onboarding Tour Overlay bug 1354046 Test Plan Card Cristian Comorasu (RelQA) [NOT STARTED] [IN PROGRESS] [NOT STARTED] Preliminary manual testing report is underway.
Photon Onboarding Tour Notifications bug 1357008 Test Plan Card Cristian Comorasu (RelQA) [NOT STARTED] [IN PROGRESS] [NOT STARTED] Preliminary manual testing report is underway.
Photon Preferences Reorg v2 bug 1365133 Test Plan Card Camelia Badau (RelQA) [NOT STARTED] [IN PROGRESS] [NOT STARTED] Preliminary manual testing report is underway.
Photon Search Preferences bug 1357285 Test Plan Card Camelia Badau (RelQA) [NOT STARTED] [IN PROGRESS] [NOT STARTED] Preliminary manual testing report is underway.
Keyboard APZ & Autoscrolling bug 1351783,1376525,1105109 Test Plan Card Petruta Horea (Rasa) (RelQA) [NOT APPLICABLE] [NOT APPLICABLE] [NOT APPLICABLE] Target release changed to Fx57.
Advanced Layers bug 1365879 n/a n/a Ovidiu Boca (EngQA) [NOT STARTED] [IN PROGRESS] [NOT STARTED] Preliminary manual testing report is underway.
Safe Browsing v4 bug 1359337 Test Plan n/a Timea Zsoldos (RelQA) [NOT STARTED] [IN PROGRESS] [NOT STARTED] Preliminary manual testing report is underway.

Detailed test results

New bugs

ID Summary Status Resolution Keywords
1395946 Tour overlay may be accidentally dismissed if visiting some of the sections RESOLVED DUPLICATE
1395953 Search panel is not displayed correctly when the panel moved to the menu NEW

2 Total; 1 Open (50%); 1 Resolved (50%); 0 Verified (0%);


Known bugs

High-impact bugs also encountered in previous builds

Bugzilla query error

Server returned unexpected HTTP status: 400 Bad Request


Low-impact bugs also encountered in previous builds

ID Summary Status Resolution
972658 Australis: Undo 'restore defaults' does not restore toolbar visibility NEW
1202654 “Restart now” and “Undo” buttons should not appear for Default theme in about:addons NEW
1253624 When you want to cut and paste a bookmark from Bookmarks Toolbar, it will remain selected NEW
1339754 Compact themes are not applied after restart if you try to enable them with a complete theme installed NEW
1373760 Onboarding flow's "Hide the tour" checkbox has no (immediate) effect, and its effect is hard to predict RESOLVED DUPLICATE
1389558 In the tour overlay "Open Default Browser Settings" is not clickable again if it is clicked once NEW
1392931 The bookmark toolbar's dimensions get smaller when you remove the Bookmarks toolbar icon, and bigger when putting it back RESOLVED DUPLICATE

7 Total; 5 Open (71.43%); 2 Resolved (28.57%); 0 Verified (0%);


Bug fix verification

Note: All verified Firefox 56 bug fixes are listed in https://goo.gl/CDJvYv.

Bugzilla query error

Server returned unexpected HTTP status: 400 Bad Request


Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed