Releases/Firefox 60/Test Plan/Beta/11

«  Firefox 60 Beta 10 | Firefox 60 Beta 11 | Firefox 60 Beta 12 »

Firefox 60 Beta 11 Test Plan

Build information

• Release week: Apr 9th, 2018. Plan is to ship this build on Thu, Apr 10th, 2018 — Release Calendar.
• Build: 60.0b11-build1 | 5b9ee6a707a0 | 20180409184545 | bugs since previous changeset | bug list.
• QA contacts: Andrei Vaida (:avaida), Cornel Ionce (:cornel_ionce), Bogdan Maris (:bogdan_maris) — online on #qa and #release-drivers, ⌚️UTC+02:00.

Manual QA's recommendation for this build

Note: Recommendation based on results from manual testing.

BUILD	TESTING STATUS	RECOMMENDATION	REASON(S)
60.0b11-build1	COMPLETED (100%)	SHIP IT	No new bugs uncovered for the covered areas. Known (old) issues are of low impact.

Manual testing summary

Note: Test Plan available at https://testrail.stage.mozaws.net/index.php?/plans/view/9226

PLATFORM	ASSIGNEE	BUILD	GPU	STATUS PER TEST SUITE
				Plugin compatibility & support	Crash reporting	Private Browsing
Windows 7 x64	Camelia Badau	32-bit	NVIDIA GeForce 210	GREEN	GREEN	GREEN
Windows 8.1 x64	Timea Szoldos	64-bit	Intel HD Graphics	GREEN	GREEN	GREEN
macOS 10.13	Anca Soncutean	64-bit	Intel Iris Pro 1536	GREEN	GREEN	GREEN
Ubuntu 16.04 x64	Iulia Cristescu	64-bit	Intel HD 520	GREEN	GREEN	GREEN

Features in Firefox 60

Note: See https://docs.google.com/document/u/1/d/1jLrir7BEF7nerypyqbbtdu_uL2IDRLjZqigSOeUMFho/edit for a general overview.

Detailed test results

Note: New and known bugs are listed in https://testrail.stage.mozaws.net/index.php?/plans/defects/9226

New bugs

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1

Known bugs

High-impact bugs also encountered in previous builds

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1

Low-impact bugs also encountered in previous builds

Full Query

ID	Summary	Status	Resolution
515181	Pending unsubmitted crash reports don't retain user comments	NEW
1273604	Bookmarks created in Private Browsing are missing favicon	RESOLVED	DUPLICATE
1294933	‘New Window’ and ‘New Private Window’ options disappear from macOS dock context menu when switching to non-tabbrowser top-level window	VERIFIED	FIXED
1314935	Flash game would not respond with key / mouse	RESOLVED	FIXED
1316512	Application shortcut keys (keyboard commands such as f11, ctrl+t, ctrl+r) fail to operate when plug-in (flash, acrobat, quicktime) has focus	RESOLVED	WONTFIX
1316595	Clicks don't register and wrong context menu position when Flash components are translated using CSS transform	RESOLVED	WONTFIX

6 Total; 1 Open (16.67%); 4 Resolved (66.67%); 1 Verified (16.67%);

Bug fix verification

Note: All verified Firefox 60 bug fixes are listed in https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=585635158.

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1

Status tags

• [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
• [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
• [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
• [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
• [IN PROGRESS] - {{mprog}} - actively being tested on
• [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed