Latest revision as of 15:06, 9 April 2019

« Firefox 67 Beta 8 | Firefox 67 Beta 9 | Firefox 67 Beta 10 »

Firefox 67 Beta 9 Test Plan [WIP]

Build information

Release week: Apr 9th, 2019. Plan is to ship this build on Tue 26th, 2019 — Release Calendar.
Build: 67.0b9-build1 | b6fdd2540f52 | 20190408123043 | bug list.
QA contacts: Andrei Vaida (:avaida), Cornel Ionce (:cornel_ionce), Bogdan Maris (:bogdan_maris), — online on #qa and #release-drivers, ⌚️UTC+02:00.

Manual QA's recommendation for this build

Note: Recommendation based on results from manual testing.

BUILD	TESTING STATUS	RECOMMENDATION	REASON(S)
67.0b9-build1	COMPLETED (100%)	SHIP IT	4 new issues uncovered during testing bug 1543036, bug 1543061, bug 1543124 and bug 1543129 Known issues are low-impact.

Manual testing summary

Note: Test Plan available at https://testrail.stage.mozaws.net/index.php?/plans/view/16395

PLATFORM	ASSIGNEE	BUILD	GPU	STATUS PER TEST SUITE
PLATFORM	ASSIGNEE	BUILD	GPU	Search	GeoLocation	Default & custom theme support
Windows 10 x64	Oana Botisan	64-bit	ATI Radeon 3000 Graphics	GREEN	GREEN	GREEN
Windows 7 x64	Bogdan Maris	64-bit	AMD Radeon HD5450	GREEN	GREEN	GREEN
macOS 10.13	Maria Berlinger	64-bit	Intel Iris Pro	GREEN	GREEN	GREEN
Ubuntu 18.04 x64	Anca Soncutean	64-bit	AMD RS 780	GREEN	GREEN	GREEN

Features in Firefox 67

See the following gdoc for a general overview.

Detailed test results

Note: New and known bugs are listed in https://testrail.stage.mozaws.net/index.php?/plans/defects/16770

New bugs

Full Query

ID	Summary	Status	Resolution
1543036	Keyword input-field overlaps the scrollbar inside One-Click Search Engines section	RESOLVED	FIXED
1543061	[Geolocation] The permission prompt has an inconsistent behaviour for when the user allows or doesn't allow to share the location	RESOLVED	INVALID
1543124	Strings written in search bar are deleted if one opens customize mode	RESOLVED	DUPLICATE
1543129	Most customizable items (looks like all API-based widgets) go AWOL after using Forget button	VERIFIED	FIXED

4 Total; 0 Open (0%); 3 Resolved (75%); 1 Verified (25%);

Known bugs

High-impact bugs also encountered in previous builds

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1

Low-impact bugs also encountered in previous builds

Full Query

ID	Summary	Status	Resolution
972658	Undo 'restore defaults' does not restore toolbar visibility (bookmarks / menu toolbar )	NEW
1022572	Hovering over button in window title lacks contrast when using High Contrast mode	NEW
1240695	Flicker in Default Search Engine drop-down on deleting engines from about:preferences#search	RESOLVED	WORKSFORME
1451402	Display static WebExtension themes in customization mode	RESOLVED	INVALID
1459211	Search bar doesn’t keep the search input if resizing the browser	RESOLVED	DUPLICATE
1488384	Bright white flashes on opening new tabs and page reload when using Dark Mode or Firefox Dark theme	RESOLVED	FIXED
1498567	Suggestions inside the search bar dropdown don't re-adjust after resize	NEW
1503269	The bookmark vertical separators are very difficult to select on Mac platform	RESOLVED	DUPLICATE
1513593	Dark-theme Firefox flashes white on new tab open of Firefox Home.	RESOLVED	DUPLICATE
1515624	[Customize] The theme changes if the cursor falls on another theme than the one selected	NEW
1515666	Pinned tabs overlap other tabs	NEW
1537738	Keyboard navigation selection is not working inside Customize	NEW
1541057	Permanently allowing/blocking the location can't be changed from Site Information panel	RESOLVED	DUPLICATE

13 Total; 6 Open (46.15%); 7 Resolved (53.85%); 0 Verified (0%);

Bug fix verification

All verified Firefox 67 bug fixes are listed in the following gdoc

Status tags

[NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
[ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
[DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
[AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
[IN PROGRESS] - {{mprog}} - actively being tested on
[INVESTIGATION NEEDED] - {{minvest}} - more investigation needed

@@ Line 3: / Line 3: @@
 = Firefox 67 Beta 9 Test Plan [WIP] =
 == Build information ==
-* Release week: Mar 25th, 2019. Plan is to ship this build on Tue 26th, 2019 — [https://www.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Calendar].
+* Release week: Apr 9th, 2019. Plan is to ship this build on Tue 26th, 2019 — [https://www.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Calendar].
-* Build: [https://archive.mozilla.org/pub/firefox/candidates/67.0b5-candidates/build1/ 67.0b5-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/a89261364728 a89261364728] | 20190325125126 | [https://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=FIREFOX_67_0b4_RELEASE&tochange=a89261364728dbfe37351e0de812e906c436a5d4&full=1 bug list].
+* Build: [https://archive.mozilla.org/pub/firefox/candidates/67.0b9-candidates/build1/ 67.0b9-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/b6fdd2540f52 b6fdd2540f52] | 20190408123043 | [https://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=FIREFOX_67_0b8_RELEASE&tochange=b6fdd2540f52de0279a2bd14e7e52736530c987b&full=1 bug list].
 * QA contacts: [mailto:andrei.vaida@softvision.ro Andrei Vaida] (:avaida), [mailto:cornel.ionce@softvision.ro Cornel Ionce] (:cornel_ionce), [mailto:bogdan.maris@softvision.ro Bogdan Maris] (:bogdan_maris), — online on [irc://irc.mozilla.org#qa #qa] and [irc://irc.mozilla.org#release-drivers #release-drivers], ⌚️UTC+02:00.
@@ Line 15: / Line 15: @@
   ! REASON(S)
   |-
-  | style="text-align:center;" | 67.0b5-build1
+  | style="text-align:center;" | 67.0b9-build1
   | style="background:green; color: white;" | COMPLETED (100%)
   | style="background:green; color: white;" | SHIP IT
   | style="text-align: left;" |
-* 2 new issues uncovered during testing {{Bug|1539098}} and {{Bug|1539182}}
+* 4 new issues uncovered during testing {{Bug|1543036}}, {{Bug|1543061}}, {{Bug|1543124}} and {{Bug|1543129}}
 * Known issues are low-impact.
 |}
@@ Line 33: / Line 33: @@
 ! colspan="4" | STATUS PER TEST SUITE
 |-
-! Media playback & support
+! Search
-! Printing
+! GeoLocation
+! Default & custom theme support
 |-
-| Windows 8.1 x64
+| Windows 10 x64
-| Anca Soncutean
+| Oana Botisan
 | 64-bit
-| AMD 760G
+| ATI Radeon 3000 Graphics
+| style="background-color: green; color: white" | GREEN
 | style="background-color: green; color: white" | GREEN
 | style="background-color: green; color: white" | GREEN
 |-
-| Windows 10 x64
+| Windows 7 x64
-| Cristian Comorasu
+| Bogdan Maris
 | 64-bit
-| Intel HD 530
+| AMD Radeon HD5450
+| style="background-color: green; color: white" | GREEN
 | style="background-color: green; color: white" | GREEN
 | style="background-color: green; color: white" | GREEN
 |-
-| macOS 10.12
+| macOS 10.13
-| Emil Ghitta
+| Maria Berlinger
 | 64-bit
-| Intel Iris Pro 1536
+| Intel Iris Pro
+| style="background-color: green; color: white" | GREEN
 | style="background-color: green; color: white" | GREEN
 | style="background-color: green; color: white" | GREEN
 |-
 | Ubuntu 18.04 x64
-| Daniel Cicas
+| Anca Soncutean
 | 64-bit
-| Nvidia GeForce 210
+| AMD RS 780
+| style="background-color: green; color: white" | GREEN
 | style="background-color: green; color: white" | GREEN
 | style="background-color: green; color: white" | GREEN
@@ Line 69: / Line 74: @@
 = Detailed test results =
-{{note| New and known bugs are listed in https://testrail.stage.mozaws.net/index.php?/plans/defects/16395}}
+{{note| New and known bugs are listed in https://testrail.stage.mozaws.net/index.php?/plans/defects/16770}}
 == New bugs ==
 <bugzilla>
 {
-  "id":"1539098, 1539182",
+  "id":"1543036, 1543061, 1543124, 1543129",
   "include_fields":"id,summary,status,resolution"
 }
@@ Line 91: / Line 96: @@
 <bugzilla>
 {
-  "id":"545940, 866574, 1194214, 1282075, 1360545, 1368158, 1378105, 1392028, 1427280, 1430114, 1481496, 1491256, 1504197, 1515289, 1521769",
+  "id":"972658, 1022572, 1240695, 1451402, 1459211, 1488384, 1498567, 1503269, 1513593, 1515624, 1515666, 1537738, 1541057",
   "include_fields":"id,summary,status,resolution"
 }

Releases/Firefox 67/Test Plan/Beta/9: Difference between revisions