Releases/Firefox 60/Test Plan/Beta/11: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(Created page with "<small> « Firefox 60 Beta 10 | Firefox 60 Beta 11 | Releases/Firefox 60/Test Plan/Be...")
 
 
(6 intermediate revisions by the same user not shown)
Line 4: Line 4:
== Build information ==
== Build information ==
* Release week: Apr 9th, 2018. Plan is to ship this build on Thu, Apr 10th, 2018 — [https://www.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Calendar].
* Release week: Apr 9th, 2018. Plan is to ship this build on Thu, Apr 10th, 2018 — [https://www.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Calendar].
* Build: [https://archive.mozilla.org/pub/firefox/candidates/60.0b10-candidates/build1/ 60.0b10-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/5b9ee6a707a0 5b9ee6a707a0] | 20180409184545 | [https://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=FIREFOX_60_0b10_RELEASE&tochange=5b9ee6a707a0&full=1 bugs since previous changeset] | [https://mzl.la/2HkMVMZ bug list].
* Build: [https://archive.mozilla.org/pub/firefox/candidates/60.0b11-candidates/build1/ 60.0b11-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/5b9ee6a707a0 5b9ee6a707a0] | 20180409184545 | [https://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=FIREFOX_60_0b10_RELEASE&tochange=5b9ee6a707a0&full=1 bugs since previous changeset] | [https://mzl.la/2HkMVMZ bug list].
* QA contacts: [mailto:andrei.vaida@softvision.ro Andrei Vaida] (:avaida), [mailto:cornel.ionce@softvision.ro Cornel Ionce] (:cornel_ionce), [mailto:bogdan.maris@softvision.ro Bogdan Maris] (:bogdan_maris) — online on [irc://irc.mozilla.org#qa #qa] and [irc://irc.mozilla.org#release-drivers #release-drivers], ⌚️UTC+02:00.
* QA contacts: [mailto:andrei.vaida@softvision.ro Andrei Vaida] (:avaida), [mailto:cornel.ionce@softvision.ro Cornel Ionce] (:cornel_ionce), [mailto:bogdan.maris@softvision.ro Bogdan Maris] (:bogdan_maris) — online on [irc://irc.mozilla.org#qa #qa] and [irc://irc.mozilla.org#release-drivers #release-drivers], ⌚️UTC+02:00.


Line 16: Line 16:
  |-
  |-
  | style="text-align:center;" | 60.0b11-build1
  | style="text-align:center;" | 60.0b11-build1
  | style="background:xgreen; color: white;" | COMPLETED (100%)
  | style="background:green; color: white;" | COMPLETED (100%)
  | style="background:xgreen; color: white;" | SHIP IT
  | style="background:green; color: white;" | SHIP IT
  | style="text-align: left;" |  
  | style="text-align: left;" |  
* No new bugs uncovered for the covered areas.
* No new bugs uncovered for the covered areas.
* Known (old) bug encountered - {{bug|1363570}} - is of low impact.
* Known (old) issues are of low impact.
|}
|}


== Manual testing summary ==
== Manual testing summary ==
{{note | Test Plan available at https://testrail.stage.mozaws.net/index.php?/plans/view/9170}}
{{note | Test Plan available at https://testrail.stage.mozaws.net/index.php?/plans/view/9226}}


{| class="wikitable" style="width:100%; text-align: center;"
{| class="wikitable" style="width:100%; text-align: center;"
Line 41: Line 41:
| 32-bit
| 32-bit
| NVIDIA GeForce 210
| NVIDIA GeForce 210
| style="background-color:xgreen; color: white" | GREEN
| style="background-color:green; color: white" | GREEN
| style="background-color:xgreen; color: white" | GREEN
| style="background-color:green; color: white" | GREEN
| style="background-color:xgreen; color: white" | GREEN
| style="background-color:green; color: white" | GREEN
|-
|-
| Windows 8.1 x64
| Windows 8.1 x64
Line 49: Line 49:
| 64-bit
| 64-bit
| Intel HD Graphics
| Intel HD Graphics
| style="background-color:xgreen; color: white" | GREEN
| style="background-color:green; color: white" | GREEN
| style="background-color:xgreen; color: white" | GREEN
| style="background-color:green; color: white" | GREEN
| style="background-color:xgreen; color: white" | GREEN
| style="background-color:green; color: white" | GREEN
|-
|-
| macOS 10.13
| macOS 10.13
Line 57: Line 57:
| 64-bit
| 64-bit
| Intel Iris Pro 1536
| Intel Iris Pro 1536
| style="background-color:xgreen; color: white" | GREEN
| style="background-color:green; color: white" | GREEN
| style="background-color:xgreen; color: white" | GREEN
| style="background-color:green; color: white" | GREEN
| style="background-color:xgreen; color: white" | GREEN
| style="background-color:green; color: white" | GREEN
|-
|-
| Ubuntu 16.04 x64
| Ubuntu 16.04 x64
Line 65: Line 65:
| 64-bit
| 64-bit
| Intel HD 520
| Intel HD 520
| style="background-color:xgreen; color: white" | GREEN
| style="background-color:green; color: white" | GREEN
| style="background-color:xgreen; color: white" | GREEN
| style="background-color:green; color: white" | GREEN
| style="background-color:xgreen; color: white" | GREEN
| style="background-color:green; color: white" | GREEN
|}
|}


Line 74: Line 74:


= Detailed test results =
= Detailed test results =
{{note| New and known bugs are listed in https://testrail.stage.mozaws.net/index.php?/plans/defects/9170}}
{{note| New and known bugs are listed in https://testrail.stage.mozaws.net/index.php?/plans/defects/9226}}


== New bugs ==  
== New bugs ==  
Line 96: Line 96:
<bugzilla>
<bugzilla>
{
{
  "id":"",
  "id":"515181,1273604,1294933,1314935,1316512,1316595",
  "include_fields":"id,summary,status,resolution"
  "include_fields":"id,summary,status,resolution"
}
}

Latest revision as of 15:13, 10 April 2018

«  Firefox 60 Beta 10 | Firefox 60 Beta 11 | Firefox 60 Beta 12 »

Firefox 60 Beta 11 Test Plan

Build information

Manual QA's recommendation for this build

Note: Recommendation based on results from manual testing.
BUILD TESTING STATUS RECOMMENDATION REASON(S)
60.0b11-build1 COMPLETED (100%) SHIP IT
  • No new bugs uncovered for the covered areas.
  • Known (old) issues are of low impact.

Manual testing summary

Note: Test Plan available at https://testrail.stage.mozaws.net/index.php?/plans/view/9226
PLATFORM ASSIGNEE BUILD GPU STATUS PER TEST SUITE
Plugin compatibility & support Crash reporting Private Browsing
Windows 7 x64 Camelia Badau 32-bit NVIDIA GeForce 210 GREEN GREEN GREEN
Windows 8.1 x64 Timea Szoldos 64-bit Intel HD Graphics GREEN GREEN GREEN
macOS 10.13 Anca Soncutean 64-bit Intel Iris Pro 1536 GREEN GREEN GREEN
Ubuntu 16.04 x64 Iulia Cristescu 64-bit Intel HD 520 GREEN GREEN GREEN

Features in Firefox 60

Note: See https://docs.google.com/document/u/1/d/1jLrir7BEF7nerypyqbbtdu_uL2IDRLjZqigSOeUMFho/edit for a general overview.

Detailed test results

Note: New and known bugs are listed in https://testrail.stage.mozaws.net/index.php?/plans/defects/9226

New bugs

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1


Known bugs

High-impact bugs also encountered in previous builds

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1


Low-impact bugs also encountered in previous builds

Full Query
ID Summary Status Resolution
515181 Pending unsubmitted crash reports don't retain user comments NEW
1273604 Bookmarks created in Private Browsing are missing favicon RESOLVED DUPLICATE
1294933 ‘New Window’ and ‘New Private Window’ options disappear from macOS dock context menu when switching to non-tabbrowser top-level window VERIFIED FIXED
1314935 Flash game would not respond with key / mouse RESOLVED FIXED
1316512 Application shortcut keys (keyboard commands such as f11, ctrl+t, ctrl+r) fail to operate when plug-in (flash, acrobat, quicktime) has focus RESOLVED WONTFIX
1316595 Clicks don't register and wrong context menu position when Flash components are translated using CSS transform RESOLVED WONTFIX

6 Total; 1 Open (16.67%); 4 Resolved (66.67%); 1 Verified (16.67%);


Bug fix verification

Note: All verified Firefox 60 bug fixes are listed in https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=585635158.

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1


Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed
Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_60/Test_Plan/Beta/11&oldid=1192094"