Releases/Firefox 60/Test Plan/Beta/10: Difference between revisions
Bogdan.maris (talk | contribs) (Created page with "<small> « Firefox 60 Beta 9 | Firefox 60 Beta 10 | Releases/Firefox 60/Test Plan/Beta...") |
Andrei.vaida (talk | contribs) m (-) |
||
| (4 intermediate revisions by 2 users not shown) | |||
| Line 4: | Line 4: | ||
== Build information == | == Build information == | ||
* Release week: Apr 4th, 2018. Plan is to ship this build on Thu, Apr 5th, 2018 — [https://www.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Calendar]. | * Release week: Apr 4th, 2018. Plan is to ship this build on Thu, Apr 5th, 2018 — [https://www.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Calendar]. | ||
* Build: [https://archive.mozilla.org/pub/firefox/candidates/60.0b10-candidates/build1/ 60.0b10-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/ | * Build: [https://archive.mozilla.org/pub/firefox/candidates/60.0b10-candidates/build1/ 60.0b10-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/8bf7d4cef4c3 8bf7d4cef4c3] | 20180404171943 | [https://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=FIREFOX_60_0b9_RELEASE&tochange=8bf7d4cef4c3&full=1 bugs since previous changeset] | [https://mzl.la/2GVbdPS bug list]. | ||
* QA contacts: [mailto:andrei.vaida@softvision.ro Andrei Vaida] (:avaida), [mailto:cornel.ionce@softvision.ro Cornel Ionce] (:cornel_ionce), [mailto:bogdan.maris@softvision.ro Bogdan Maris] (:bogdan_maris) — online on [irc://irc.mozilla.org#qa #qa] and [irc://irc.mozilla.org#release-drivers #release-drivers], ⌚️UTC+02:00. | * QA contacts: [mailto:andrei.vaida@softvision.ro Andrei Vaida] (:avaida), [mailto:cornel.ionce@softvision.ro Cornel Ionce] (:cornel_ionce), [mailto:bogdan.maris@softvision.ro Bogdan Maris] (:bogdan_maris) — online on [irc://irc.mozilla.org#qa #qa] and [irc://irc.mozilla.org#release-drivers #release-drivers], ⌚️UTC+02:00. | ||
| Line 15: | Line 15: | ||
! REASON(S) | ! REASON(S) | ||
|- | |- | ||
| style="text-align:center;" | 60. | | style="text-align:center;" | 60.0b10-build1 | ||
| style="background: | | style="background:green; color: white;" | COMPLETED (100%) | ||
| style="background: | | style="background:green; color: white;" | SHIP IT | ||
| style="text-align: left;" | | | style="text-align: left;" | | ||
* | * No new bugs uncovered for the covered areas. | ||
* | * Known (old) bug encountered - {{bug|1363570}} - is of low impact. | ||
|} | |} | ||
== Manual testing summary == | == Manual testing summary == | ||
{{note | Test Plan available at https://testrail.stage.mozaws.net/index.php?/plans/view/ | {{note | Test Plan available at https://testrail.stage.mozaws.net/index.php?/plans/view/9170}} | ||
{| class="wikitable" style="width:100%; text-align: center;" | {| class="wikitable" style="width:100%; text-align: center;" | ||
| Line 33: | Line 33: | ||
! colspan="4" | STATUS PER TEST SUITE | ! colspan="4" | STATUS PER TEST SUITE | ||
|- | |- | ||
! | ! Search | ||
! | ! Awesomebar & indicators | ||
|- | |- | ||
| Windows 7 x32 | | Windows 7 x32 | ||
| Camelia Badau | | Camelia Badau | ||
| 32-bit | | 32-bit | ||
| | | NVIDIA GeForce 210 | ||
| style="background-color: | | style="background-color:green; color: white" | GREEN | ||
| style="background-color: | | style="background-color:green; color: white" | GREEN | ||
|- | |- | ||
| Windows 10 x64 | | Windows 10 x64 | ||
| Alex Simonca | | Alex Simonca | ||
| 64-bit | | 64-bit | ||
| | | Intel HD Graphics | ||
| style="background-color: | | style="background-color:green; color: white" | GREEN | ||
| style="background-color: | | style="background-color:green; color: white" | GREEN | ||
|- | |- | ||
| Mac OS X 10.10 | | Mac OS X 10.10 | ||
| Catalin Sasca | | Catalin Sasca | ||
| 64-bit | | 64-bit | ||
| | | Intel Iris Pro | ||
| style="background-color: | | style="background-color:green; color: white" | GREEN | ||
| style="background-color: | | style="background-color:green; color: white" | GREEN | ||
|- | |- | ||
| Ubuntu 14.04 x64 | | Ubuntu 14.04 x64 | ||
| Timea Zsoldos | | Timea Zsoldos | ||
| 64-bit | | 64-bit | ||
| | | AMD RS780 | ||
| style="background-color: | | style="background-color:green; color: white" | GREEN | ||
| style="background-color: | | style="background-color:green; color: white" | GREEN | ||
|} | |} | ||
| Line 74: | Line 69: | ||
= Detailed test results = | = Detailed test results = | ||
{{note| New and known bugs are listed in https://testrail.stage.mozaws.net/index.php?/plans/defects/ | {{note| New and known bugs are listed in https://testrail.stage.mozaws.net/index.php?/plans/defects/9170}} | ||
== New bugs == | == New bugs == | ||
| Line 96: | Line 91: | ||
<bugzilla> | <bugzilla> | ||
{ | { | ||
"id":"", | "id":"1363570", | ||
"include_fields":"id,summary,status,resolution" | "include_fields":"id,summary,status,resolution" | ||
} | } | ||
Latest revision as of 11:51, 5 April 2018
« Firefox 60 Beta 9 | Firefox 60 Beta 10 | Firefox 60 Beta 11 »
Firefox 60 Beta 10 Test Plan
Build information
- Release week: Apr 4th, 2018. Plan is to ship this build on Thu, Apr 5th, 2018 — Release Calendar.
- Build: 60.0b10-build1 | 8bf7d4cef4c3 | 20180404171943 | bugs since previous changeset | bug list.
- QA contacts: Andrei Vaida (:avaida), Cornel Ionce (:cornel_ionce), Bogdan Maris (:bogdan_maris) — online on #qa and #release-drivers, ⌚️UTC+02:00.
Manual QA's recommendation for this build
Note: Recommendation based on results from manual testing.
| BUILD | TESTING STATUS | RECOMMENDATION | REASON(S) |
|---|---|---|---|
| 60.0b10-build1 | COMPLETED (100%) | SHIP IT |
|
Manual testing summary
Note: Test Plan available at https://testrail.stage.mozaws.net/index.php?/plans/view/9170
| PLATFORM | ASSIGNEE | BUILD | GPU | STATUS PER TEST SUITE | |||
|---|---|---|---|---|---|---|---|
| Search | Awesomebar & indicators | ||||||
| Windows 7 x32 | Camelia Badau | 32-bit | NVIDIA GeForce 210 | GREEN | GREEN | ||
| Windows 10 x64 | Alex Simonca | 64-bit | Intel HD Graphics | GREEN | GREEN | ||
| Mac OS X 10.10 | Catalin Sasca | 64-bit | Intel Iris Pro | GREEN | GREEN | ||
| Ubuntu 14.04 x64 | Timea Zsoldos | 64-bit | AMD RS780 | GREEN | GREEN | ||
Features in Firefox 60
Note: See https://docs.google.com/document/u/1/d/1jLrir7BEF7nerypyqbbtdu_uL2IDRLjZqigSOeUMFho/edit for a general overview.
Detailed test results
Note: New and known bugs are listed in https://testrail.stage.mozaws.net/index.php?/plans/defects/9170
New bugs
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1
Known bugs
High-impact bugs also encountered in previous builds
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1
Low-impact bugs also encountered in previous builds
| ID | Summary | Status | Resolution |
|---|---|---|---|
| 1363570 | One-off search buttons: Alt-Up/Down isn't working on Linux | RESOLVED | WORKSFORME |
1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);
Bug fix verification
Note: All verified Firefox 60 bug fixes are listed in https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=585635158.
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1
Status tags
- [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
- [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
- [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
- [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
- [IN PROGRESS] - {{mprog}} - actively being tested on
- [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed