Releases/Firefox 56/Test Plan/Beta/1

From MozillaWiki
Jump to navigation Jump to search

«  Firefox 56 Beta 1 | Firefox 56 Beta 2 »

Firefox 56 Beta 1 Test Plan

Build information

Manual QA's recommendation for this build

Note: Recommendation based on results from manual testing.
BUILD TESTING STATUS RECOMMENDATION REASON(S)
56.0b1-build3 COMPLETED (100%) SHIP IT
  • 0 new bugs uncovered.
  • Known (old) bugs encountered are low-impact.
56.0b1-build5 COMPLETED (100%) SHIP IT
  • 1 new bug uncovered: bug 1388745, which is not a high-impact regression in Fx56.
  • Known (old) bugs encountered are low-impact.

Manual testing summary

Note: Beta 56.0b1-build3 Test Plan available at https://testrail.stage.mozaws.net/index.php?/plans/view/5538
Note: Beta 56.0b1-build5 Test Plan available at https://testrail.stage.mozaws.net/index.php?/plans/view/5569

56.0b1-build3

PLATFORM ASSIGNEE BUILD GPU STATUS PER TEST SUITE
Media Block Autoplay CSS Grid Inspector Layout View [Photon] Preferences Search
Windows 7 x64 Camelia Badau 32-bit NVIDIA GeForce 210 GREEN GREEN GREEN
Windows 10 x64 Timea Zsoldos 64-bit ATI Radeon HD 3000 GREEN GREEN GREEN
macOS 10.12 Iulia Cristescu 64-bit Intel Iris Pro (1536 MB) GREEN GREEN GREEN
Ubuntu 16.04 x64 Cristian Comorasu 64-bit Intel HD Graphics 530 GREEN GREEN GREEN

56.0b1-build5

PLATFORM ASSIGNEE BUILD GPU STATUS PER TEST SUITE
Media Block Autoplay CSS Grid Inspector Layout View [Photon] Preferences Search
Windows 7 x64 Camelia Badau 32-bit NVIDIA GeForce 210 GREEN GREEN GREEN
Windows 10 x64 Petruta Rasa 64-bit Intel HD 2500 GREEN GREEN GREEN
macOS 10.12 Alexandru Simonca 64-bit Intel Iris Graphics 650 GREEN GREEN GREEN
Ubuntu 16.04 x64 Iulia Cristescu 64-bit ATI Radeon HD 3000 GREEN GREEN GREEN


Features in Firefox 56

Warning signWarning: This section is a work in progress.
Note: Pre-Release feature sign offs are scheduled to be completed by September 15th, with preliminary reports sent by September 1st.
Note: See https://goo.gl/U1w1cp for a general overview.
FEATURE NAME TRACKING QA CONTACTS TESTING STATUS PRELIMINARY REPORTING STATUS SIGN OFF STATUS ADDITIONAL NOTES
Bugzilla Wiki Trello
Feature Name xx Test Plan [trello link Card] owner (team) [NOT STARTED] [NOT STARTED] [NOT STARTED] notes

Detailed test results

Note: New and known bugs are listed in https://testrail.stage.mozaws.net/index.php?/plans/defects/5538

New bugs

56.0b1-build3

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1


56.0b1-build5

Full Query
ID Summary Status Resolution Keywords
1388745 Some search results are not highlighted VERIFIED FIXED regression

1 Total; 0 Open (0%); 0 Resolved (0%); 1 Verified (100%);


Known bugs

56.0b1-build3

High-impact bugs also encountered in previous builds

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1


Low-impact bugs also encountered in previous builds

Full Query
ID Summary Status Resolution
1376775 Colorpicker remains behind when an overlay grid is active and the color is changed multiple times thus any action on overlays is ignored RESOLVED WORKSFORME
1377879 Highlighters can remain behind if Fx is slowly resized RESOLVED FIXED
1378105 Media is not blocked for previously unfocused closed tabs after restoring them from the History menu RESOLVED WORKSFORME
1383327 Display the grid line number box shape as a directional pointer RESOLVED FIXED

4 Total; 0 Open (0%); 4 Resolved (100%); 0 Verified (0%);


56.0b1-build5

High-impact bugs also encountered in previous builds

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1


Low-impact bugs also encountered in previous builds

Full Query
ID Summary Status Resolution
1376775 Colorpicker remains behind when an overlay grid is active and the color is changed multiple times thus any action on overlays is ignored RESOLVED WORKSFORME
1377879 Highlighters can remain behind if Fx is slowly resized RESOLVED FIXED
1378105 Media is not blocked for previously unfocused closed tabs after restoring them from the History menu RESOLVED WORKSFORME

3 Total; 0 Open (0%); 3 Resolved (100%); 0 Verified (0%);


Bug fix verification

Note: All verified Firefox 56 bug fixes are listed in https://goo.gl/CDJvYv.

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1


Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed
Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_56/Test_Plan/Beta/1&oldid=1177778"