Releases/Firefox 54/Test Plan/Beta/12: Difference between revisions
Jump to navigation
Jump to search
Full Query
Full Query
Andrei.vaida (talk | contribs) |
Andrei.vaida (talk | contribs) m (-) |
||
| Line 16: | Line 16: | ||
|- | |- | ||
| style="text-align:center;" | 54.0b12-build1 | | style="text-align:center;" | 54.0b12-build1 | ||
| style="background: | | style="background:green; color: white;" | COMPLETED 100% | ||
| style="background: | | style="background:green; color: white;" | SHIP IT | ||
| style="text-align: left;" | | | style="text-align: left;" | No new or blocking issues uncovered, just a few already known bugs of low impact. We've already shipped several releases with them. | ||
|} | |} | ||
| Line 38: | Line 38: | ||
| 32-bit | | 32-bit | ||
| Intel HD 530 | | Intel HD 530 | ||
| style="background-color: | | style="background-color: geen; color: white" | GREEN | ||
| style="background-color: | | style="background-color: geen; color: white" | GREEN | ||
|- | |- | ||
| Windows 8.1 x64 | | Windows 8.1 x64 | ||
| Timea Zsoldos | | Timea Zsoldos | ||
| 64-bit | | 64-bit | ||
| | | ATI Radeon HD 3000 | ||
| style="background-color: | | style="background-color: geen; color: white" | GREEN | ||
| style="background-color: | | style="background-color: geen; color: white" | GREEN | ||
|- | |- | ||
| Mac OS X 10.10 | | Mac OS X 10.10 | ||
| Line 52: | Line 52: | ||
| 64-bit | | 64-bit | ||
| Intel Iris Pro (1536 MB) | | Intel Iris Pro (1536 MB) | ||
| style="background-color: | | style="background-color: geen; color: white" | GREEN | ||
| style="background-color: | | style="background-color: geen; color: white" | GREEN | ||
|- | |- | ||
| Ubuntu 12.04 x86 | | Ubuntu 12.04 x86 | ||
| Line 59: | Line 59: | ||
| 32-bit | | 32-bit | ||
| NVIDIA GeForce 620 | | NVIDIA GeForce 620 | ||
| style="background-color: | | style="background-color: geen; color: white" | GREEN | ||
| style="background-color: | | style="background-color: geen; color: white" | GREEN | ||
|} | |} | ||
| Line 164: | Line 164: | ||
<bugzilla> | <bugzilla> | ||
{ | { | ||
"id":"", | "id":"616629, 1243385, 1277327", | ||
"include_fields":"id,summary,status,resolution" | "include_fields":"id,summary,status,resolution" | ||
} | } | ||
| Line 173: | Line 173: | ||
<bugzilla> | <bugzilla> | ||
{ | { | ||
"id":"", | "id":"1358964, 1364870, 1363671, 1341992", | ||
"include_fields":"id,summary,status,resolution,keywords" | "include_fields":"id,summary,status,resolution,keywords" | ||
} | } | ||
Latest revision as of 12:30, 30 May 2017
« Firefox 54 Beta 11 | Firefox 54 Beta 12 | Firefox 54 Beta 13 »
Firefox 54 Beta 12 Test Plan
Build information
- Release week: May 29th, 2017. Plan is to ship this build on Tuesday, May 30th, 2017 — Release Calendar.
- Build: 54.0b12-build1 | 715d88d0bd82 | 20170529025116 | bugs since previous changeset.
- QA contacts: Florin Mezei (:FlorinMezei), Andrei Vaida (:avaida), Cornel Ionce (:cornel_ionce) — online on #qa and #release-drivers, ⌚️UTC+02:00.
Manual QA'S recommendation for this build
Note: Recommendation based on results from manual testing.
| BUILD | TESTING STATUS | RECOMMENDATION | REASON(S) |
|---|---|---|---|
| 54.0b12-build1 | COMPLETED 100% | SHIP IT | No new or blocking issues uncovered, just a few already known bugs of low impact. We've already shipped several releases with them. |
Manual testing summary
Note: Test Plan available at https://testrail.stage.mozaws.net/index.php?/plans/view/4397.
| PLATFORM | ASSIGNEE | BUILD | GPU | STATUS PER TEST SUITE | |||
|---|---|---|---|---|---|---|---|
| Scroll and Zoom | Password Manager | ||||||
| Windows 7 x86 | Cristian Comorasu | 32-bit | Intel HD 530 | GREEN | GREEN | ||
| Windows 8.1 x64 | Timea Zsoldos | 64-bit | ATI Radeon HD 3000 | GREEN | GREEN | ||
| Mac OS X 10.10 | Iulia Cristescu | 64-bit | Intel Iris Pro (1536 MB) | GREEN | GREEN | ||
| Ubuntu 12.04 x86 | Cornel Ionce | 32-bit | NVIDIA GeForce 620 | GREEN | GREEN | ||
Features in Firefox 54
Note: Pre-Release feature sign offs are scheduled to be completed by May 26th.
Note: See https://goo.gl/I6hq5C for a general overview.
| FEATURE NAME | TRACKING | QA CONTACTS | TESTING STATUS | SIGN OFF STATUS | ADDITIONAL NOTES | ||
|---|---|---|---|---|---|---|---|
| Bugzilla | Wiki | Trello | |||||
| client-side stackwalking: ping sender | 1310703 | Test Plan | Petruta Rasa | [DONE] | [DONE] | Signed off on 2017-05-26 as GREEN, full test report here. | |
| Firefox Screenshots system add-on | Test Plan | Card | Iulia Cristescu | [AT RISK] | [AT RISK] | Will ride Firefox 55 instead, per Trello. | |
| Download Panel UX Redesign | 1269956 | Test Plan | Card | Cristian Comorasu | [DONE] | [DONE] | Signed off on 2017-05-25 as GREEN, full test report here. |
| Net Monitor MVP | 1307743 | Test Plan | Card | Ciprian Georgiu | [DONE] | [DONE] | Conditionally signed off on 2017-05-24 as YELLOW, because of bug 1350969, full test report here. |
| ICE TCP | 1176382 | Card | Iulia Cristescu | [DONE] | [DONE] | Signed off on 2017-05-25 as GREEN, full test report here. | |
| Flash async drawing | 1229961 | Test Plan | Card | Stefan Georgiev (Engineering QA) | [AT RISK] | [AT RISK] | Will ride Firefox 55 instead for 32-bit users, per Trello. |
| Mobile bookmarks | 1295237 | Test Plan | Kanchan Kumari (Engineering QA) | [ON TRACK] | [IN PROGRESS] | ||
Detailed test results
Note: New and known bugs are listed in https://testrail.stage.mozaws.net/index.php?/plans/defects/4397.
New bugs
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1
Known bugs
High-impact bugs also encountered in previous builds
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1
Low-impact bugs also encountered in previous builds
| ID | Summary | Status | Resolution |
|---|---|---|---|
| 616629 | "Remember Password?" dialog shows too early | RESOLVED | DUPLICATE |
| 1243385 | Bad repainting while scrolling on gaming.youtube.com | RESOLVED | INCOMPLETE |
| 1277327 | Video on gaming.youtube.com lags behind while scrolling | RESOLVED | INCOMPLETE |
3 Total; 0 Open (0%); 3 Resolved (100%); 0 Verified (0%);
Bug fix verification
Note: All verified Firefox 54 bug fixes are listed in https://goo.gl/vCGKG3.
| ID | Summary | Status | Resolution | Keywords |
|---|---|---|---|---|
| 1341992 | On Windows, it's not possible to scroll using the scrollbar with touch gestures | VERIFIED | FIXED | regression |
| 1358964 | Temp folder is not deleted on exit | RESOLVED | FIXED | regression |
| 1363671 | No favicon on about:addons | VERIFIED | FIXED | regression |
| 1364870 | ffmpeg decoder returning errors if no frame decoded. | VERIFIED | FIXED | regression |
4 Total; 0 Open (0%); 1 Resolved (25%); 3 Verified (75%);
Status tags
- [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
- [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
- [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
- [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
- [IN PROGRESS] - {{mprog}} - actively being tested on
- [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed