Releases/Firefox 60 ESR/Test Plan: Difference between revisions
No edit summary |
Cornel.ionce (talk | contribs) No edit summary |
||
| Line 543: | Line 543: | ||
{ | { | ||
"id":"558178, 1089326, 1194214, 1230678, 1305744, 1309534, 1393460, 1402827, 1409673, 1429790, 1436015, 1436334, 1441690, 1458471, 1460860, 1462334, 1470154", | "id":"558178, 1089326, 1194214, 1230678, 1305744, 1309534, 1393460, 1402827, 1409673, 1429790, 1436015, 1436334, 1441690, 1458471, 1460860, 1462334, 1470154", | ||
"include_fields":"id,summary,status,resolution" | |||
} | |||
</bugzilla> | |||
= Firefox 60.2.0 ESR == | |||
=== Build 2 === | |||
{| class="wikitable" style="width:30%" | |||
|- | |||
| '''Builds''' | |||
| [https://archive.mozilla.org/pub/firefox/candidates/60.2.0esr-candidates/build2/ 60.2.0esr-build2] | |||
|- | |||
| '''ID''' | |||
| 20180903060751 | |||
|- | |||
| '''Changeset''' | |||
| [https://hg.mozilla.org/releases/mozilla-esr52/rev/a87efaac5c06 a87efaac5c06], ([https://hg.mozilla.org/releases/mozilla-esr60/pushloghtml pushlog]) | |||
|} | |||
{|class="wikitable" style="width:80%" | |||
|- | |||
| class="header" style="text-align:center;" | Platform | |||
| class="header" style="text-align:center;" | Build architecture | |||
| class="header" style="text-align:center;" | Assignee | |||
| class="header" style="text-align:center;" | Results: [https://testrail.stage.mozaws.net/index.php?/plans/view/9700 report] | |||
|- | |||
| Windows 7 x64 (gpu) | |||
| 32-bit | |||
| | |||
| style="text-align:center;" | {{mprog|}} | |||
|- | |||
| Windows 10 x64 (gpu) | |||
| 64-bit | |||
| Camelia Badau | |||
| style="text-align:center;" | {{mprog|}} | |||
|- | |||
| Mac OS X 10.13 (Intel Iris Pro) | |||
| 64-bit | |||
| Catalin Sasca | |||
| style="text-align:center;" | {{mprog|}} | |||
|- | |||
| Ubuntu 16.04 x86 (AMD RS780) | |||
| 32-bit | |||
| Anca Soncutean | |||
| style="text-align:center;" | {{mprog|}} | |||
|} | |||
{|class="wikitable" style="width:60%" | |||
|- | |||
| class="header" style="width:20%; text-align:center;" | Area | |||
| class="header" style="width:20%; text-align:center;" | Results ([https://testrail.stage.mozaws.net/index.php?/plans/view/12051 report]) | |||
|- | |||
| FIREFOX BRANDING | |||
| style="background: blue; color: black; text-align:center;" | TBD | |||
|- | |||
| CRASH REPORTER | |||
| style="background: blue; color: black; text-align:center;" | TBD | |||
|- | |||
| SESSION RESTORE | |||
| style="background: blue; color: black; text-align:center;" | TBD | |||
|- | |||
| WEB COMPATIBILITY | |||
| style="background: blue; color: black; text-align:center;" | TBD | |||
|- | |||
| MEDIA PLAYBACK & SUPPORT | |||
| style="background: blue; color: black; text-align:center;" | TBD | |||
|- | |||
| PLUGIN COMPATIBILITY | |||
| style="background: blue; color: black; text-align:center;" | TBD | |||
|- | |||
| GRAPHICS | |||
| style="background: blue; color: black; text-align:center;" | TBD | |||
|- | |||
| PDF VIEWER | |||
| style="background: blue; color: black; text-align:center;" | TBD | |||
|- | |||
| GEOLOCATION | |||
| style="background: blue; color: black; text-align:center;" | TBD | |||
|- | |||
| DOWNLOADS | |||
| style="background: blue; color: black; text-align:center;" | TBD | |||
|- | |||
| PRINTING | |||
| style="background: blue; color: black; text-align:center;" | TBD | |||
|- | |||
| BOOKMARKS | |||
| style="background: blue; color: black; text-align:center;" | TBD | |||
|- | |||
| SCROLL & ZOOM | |||
| style="background: blue; color: black; text-align:center;" | TBD | |||
|- | |||
| SEARCH | |||
| style="background: blue; color: black; text-align:center;" | TBD | |||
|- | |||
| AWESOMEBAR & INDICATORS | |||
| style="background: blue; color: black; text-align:center;" | TBD | |||
|- | |||
| POLICY ENGINE AND API | |||
| style="background: blue; color: black; text-align:center;" | TBD | |||
|- | |||
|} | |||
=== Checklist === | |||
* {{mdone|}} Functional automation | |||
** {{mdone|}} [https://treeherder.mozilla.org/#/jobs?repo=mozilla-esr52&revision=15d9d940341f Treeherder] | |||
* {{mprog|}} [https://testrail.stage.mozaws.net/index.php?/plans/view/12051 Manual Smoke Testing] | |||
* {{mdone|}} [https://docs.google.com/spreadsheets/d/1dPCAIZvCXXsW-efi7o66Yx5fP8jfj5oJxK8k48BTsjw/edit#gid=1391305042 Bug fix verifications] | |||
* Manual update testing: | |||
** {{mdone|}} Updates on esr-localtest channel ([https://docs.google.com/document/u/1/d/1k57W4dgeNH7ZGCmS6d-Z3DubPw50Gjt9HAW7GPyl-Js/edit report]) | |||
** {{mnotstarted|}} Updates on esr-cdntest channel ([https://docs.google.com/document/u/1/d/1k57W4dgeNH7ZGCmS6d-Z3DubPw50Gjt9HAW7GPyl-Js/edit report]) | |||
** {{mnotstarted|}} Updates on esr channel ([https://docs.google.com/document/u/1/d/1k57W4dgeNH7ZGCmS6d-Z3DubPw50Gjt9HAW7GPyl-Js/edit report]) | |||
=== Bug Fix Verifications === | |||
* Bug fixes triaged in terms of testability/priority: [https://docs.google.com/spreadsheets/d/1dPCAIZvCXXsW-efi7o66Yx5fP8jfj5oJxK8k48BTsjw/edit#gid=1218858724 list]. | |||
* Verified fixes: | |||
** Security fixes: none | |||
** Other fixes: | |||
<bugzilla> | |||
{ | |||
"id":"", | |||
"include_fields":"id,summary,status,resolution" | |||
} | |||
</bugzilla> | |||
=== Issues === | |||
==== New ==== | |||
<bugzilla> | |||
{ | |||
"id":"", | |||
"include_fields":"id,summary,status,resolution" | |||
} | |||
</bugzilla> | |||
==== Known ==== | |||
<bugzilla> | |||
{ | |||
"id":"", | |||
"include_fields":"id,summary,status,resolution" | "include_fields":"id,summary,status,resolution" | ||
} | } | ||
</bugzilla> | </bugzilla> | ||
Revision as of 10:55, 4 September 2018
Firefox 60.0 ESR
Build 6
| Builds | 60.0esr-build6 |
| ID | 20180503164101 |
| Changeset | e1c89bf28365, (pushlog) |
| Platform | Build architecture | Assignee | Results: report |
| Windows 7 x64 (NVIDIA GeForce 210) | 32-bit | Camelia Badau | [IN PROGRESS] |
| Windows 10 x64 (Intel HD 2500) | 64-bit | Mihai Boldan | [IN PROGRESS] |
| Mac OS X 10.13 (Intel Iris Pro) | 64-bit | Cristian Comorasu | [IN PROGRESS] |
| Ubuntu 14.04 x64 (Intel HD 2500) | 64-bit | Timea Zsoldos | [IN PROGRESS] |
| Area | Results (report) |
| FIREFOX BRANDING | GREEN |
| CRASH REPORTER | GREEN |
| SESSION RESTORE | GREEN |
| WEB COMPATIBILITY | GREEN |
| MEDIA PLAYBACK & SUPPORT | GREEN |
| PLUGIN COMPATIBILITY | GREEN |
| GRAPHICS | GREEN |
| PDF VIEWER | GREEN |
| GEOLOCATION | GREEN |
| DOWNLOADS | GREEN |
| PRINTING | GREEN |
| BOOKMARKS | GREEN |
| SCROLL & ZOOM | GREEN |
| SEARCH | GREEN |
| AWESOMEBAR & INDICATORS | GREEN |
| POLICY ENGINE AND API | YELLOW |
Checklist
- [DONE] Functional automation
- [DONE] Treeherder
- [DONE] Manual Smoke Testing
- [DONE] Bug fix verifications
- [Out of Scope, updates are not generated for the first ESR] Update automation on esr-localtest
- [Out of Scope, updates are not generated for the first ESR] Update automation on esr-cdntest
- [Out of Scope, updates are not generated for the first ESR] Update automation on esr
Bug Fix Verifications
- Bug fixes triaged in terms of testability/priority: list.
- Verified fixes:
- Security fixes: none
- Other fixes:
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1
Issues
New
| ID | Summary | Status | Resolution |
|---|---|---|---|
| 1459639 | "Enterprise policies" errors displayed in Browser Console | RESOLVED | INVALID |
| 1459641 | About: Screens are not blocked on a specific configuration | RESOLVED | WORKSFORME |
2 Total; 0 Open (0%); 2 Resolved (100%); 0 Verified (0%);
Known
41 Total; 10 Open (24.39%); 29 Resolved (70.73%); 2 Verified (4.88%);
Firefox 60.0.1 ESR
Build 1
| Builds | BUILD1 |
| ID | 20180516032417 |
| Changeset | BUILD1, (pushlog) |
| Platform | Build architecture | Assignee | Results: report |
| Windows 7 x64 (Intel I5-3470 Graphics AMD R7 360) | 64-bit | Cristian Fogel | [DONE] |
| Windows 10 x64 (IntelHD Graphics 530) | 64-bit | Cristian Baica | [DONE] |
| macOS 10.12 (Intel Iris Pro 15636) | 64-bit | Anca Soncutean | [DONE] |
| Ubuntu 16.04 x64 (AMD RS780) | 64-bit | Stefania Farcas | [DONE] |
| Area | Results (report) |
| WEB COMPATIBILITY | YELLOW |
Checklist
- [DONE] Functional automation
- [DONE] Treeherder
- Reviewed by Phil Ringnalda
- [DONE] Treeherder
- [IN PROGRESS] Manual Smoke Testing
- [DONE] Bug fix verifications
- Manual update testing:
Bug Fix Verifications
- Bug fixes triaged in terms of testability/priority: list.
- Verified fixes:
- Security fixes: none
- Other fixes:
4 Total; 0 Open (0%); 0 Resolved (0%); 4 Verified (100%);
Issues
New
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1
Known
12 Total; 4 Open (33.33%); 7 Resolved (58.33%); 1 Verified (8.33%);
Firefox 60.0.2 ESR
Build 2
| Builds | BUILD2 |
| ID | 20180605201706 |
| Changeset | BUILD2, (pushlog) |
| Platform | Build architecture | Assignee | Results: report |
| Windows 10 x64 (Intel HD Graphics) | 64-bit | Cristian Baica | [DONE] |
| Windows 7 x64 (NVIDIA GeForce 210) | 64-bit | Camelia Badau | [DONE] |
| Mac OS X 10.11 (Intel Iris Pro 15636) | 64-bit | Oana Botisan | [DONE] |
| Ubuntu 16.04 x86 (AMD RS780) | 32-bit | Stefania Farcas | [DONE] |
| Area | Results (report) |
| WEB COMPATIBILITY | YELLOW |
Checklist
- [DONE] Functional automation
- [DONE] Treeherder
- Reviewed by Phil Ringnalda
- [DONE] Treeherder
- [DONE] Manual Smoke Testing
- [DONE] Bug fix verifications
- Manual update testing:
Bug Fix Verifications
- Bug fixes triaged in terms of testability/priority: list.
- Verified fixes:
- Security fixes: none
- Other fixes:
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1
Issues
New
| ID | Summary | Status | Resolution |
|---|---|---|---|
| 1467114 | BBC - highlighter for navigation spans extends to body edge | NEW |
1 Total; 1 Open (100%); 0 Resolved (0%); 0 Verified (0%);
Known
| ID | Summary | Status | Resolution |
|---|---|---|---|
| 558178 | Only show password capture dialog if we're reasonably sure the password was correct and the login was successful | RESOLVED | WONTFIX |
| 1194214 | [HTML5] Several side effects using the context menu options on Youtube | NEW | |
| 1309534 | Glitches when zoom in .jpg files from Wikipedia | RESOLVED | WORKSFORME |
| 1345877 | Dotted square appears above the in focused video's seek bar in Linkedin | RESOLVED | WORKSFORME |
| 1393460 | Keyboard scrolling is not smooth on Pinterest | RESOLVED | WORKSFORME |
| 1416721 | [twitch] The buttons glitch as long as you hover the cursor over them | RESOLVED | WORKSFORME |
| 1436334 | The fullscreen button is not fully functional on Bloomberg videos | RESOLVED | FIXED |
| 1458470 | Bing tab index - selects hidden dropdown menus | NEW | |
| 1458471 | Bing search icon selection moves when dragging mouse left-right | RESOLVED | WORKSFORME |
9 Total; 2 Open (22.22%); 7 Resolved (77.78%); 0 Verified (0%);
Firefox 60.1.0 ESR
Build 1
| Builds | BUILD1 |
| ID | 20180619173714 |
| Changeset | BUILD1, (pushlog) |
| Platform | Build architecture | Assignee | Results: report |
| Windows 8.1 x64 (Intel HD Graphics) | 64-bit | Alexandru Simonca | [DONE] |
| Windows 7 x86 (AMD 760G) | 32-bit | Cristian Fogel | [DONE] |
| Mac OS X 10.11 (Intel Iris Pro 15636) | 64-bit | Catalin Sasca | [DONE] |
| Ubuntu 16.04 x86 (AMD RS780) | 32-bit | Timea Zsoldos | [DONE] |
| Area | Results (report) |
| FIREFOX BRANDING | GREEN |
| CRASH REPORTER | GREEN |
| SESSION RESTORE | GREEN |
| WEB COMPATIBILITY | YELLOW |
| MEDIA PLAYBACK & SUPPORT | GREEN |
| PLUGIN COMPATIBILITY | GREEN |
| GRAPHICS | GREEN |
| PDF VIEWER | GREEN |
| GEOLOCATION | GREEN |
| DOWNLOADS | GREEN |
| PRINTING | GREEN |
| BOOKMARKS | GREEN |
| SCROLL & ZOOM | GREEN |
| SEARCH | GREEN |
| AWESOMEBAR & INDICATORS | GREEN |
| POLICY ENGINE AND API | GREEN |
Checklist
- [IN PROGRESS] Functional automation
- [DONE] Treeherder
- [DONE] Manual Smoke Testing
- [DONE] Bug fix verifications
- Manual update testing:
Bug Fix Verifications
- Bug fixes triaged in terms of testability/priority: list.
- Verified fixes:
- Security fixes: none
- Other fixes:
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1
Issues
New
2 Total; 2 Open (100%); 0 Resolved (0%); 0 Verified (0%);
Known
35 Total; 11 Open (31.43%); 23 Resolved (65.71%); 1 Verified (2.86%);
Build 2
| Builds | BUILD2 |
| ID | 20180621121604 |
| Changeset | BUILD2, (pushlog) |
| Platform | Build architecture | Assignee | Results: report |
| Windows 8.1 x64 (AMD 760G) | 64-bit | Cristian Fogel | [DONE] |
| Windows 7 x64 (Intel HD Graphics 5500) | 32-bit | Cristian Comorasu | [DONE] |
| macOS 10.13 (Intel Iris Plus 650) | 64-bit | Alexandru Simonca | [DONE] |
| Ubuntu 18.04 x86 (Intel® HD Graphics 530) | 32-bit | Berlinger Maria | [DONE] |
| Area | Results (report) |
| WEB COMPATIBILITY | GREEN |
Checklist
- [DONE] Functional automation
- [DONE] Treeherder
- [DONE] Manual Smoke Testing
- [DONE] Bug fix verifications
- Manual update testing:
Bug Fix Verifications
- Bug fixes triaged in terms of testability/priority: list.
- Verified fixes:
- Security fixes: none
- Other fixes:
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1
Issues
New
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1
Known
17 Total; 3 Open (17.65%); 12 Resolved (70.59%); 2 Verified (11.76%);
Firefox 60.2.0 ESR =
Build 2
| Builds | 60.2.0esr-build2 |
| ID | 20180903060751 |
| Changeset | a87efaac5c06, (pushlog) |
| Platform | Build architecture | Assignee | Results: report |
| Windows 7 x64 (gpu) | 32-bit | [IN PROGRESS] | |
| Windows 10 x64 (gpu) | 64-bit | Camelia Badau | [IN PROGRESS] |
| Mac OS X 10.13 (Intel Iris Pro) | 64-bit | Catalin Sasca | [IN PROGRESS] |
| Ubuntu 16.04 x86 (AMD RS780) | 32-bit | Anca Soncutean | [IN PROGRESS] |
| Area | Results (report) |
| FIREFOX BRANDING | TBD |
| CRASH REPORTER | TBD |
| SESSION RESTORE | TBD |
| WEB COMPATIBILITY | TBD |
| MEDIA PLAYBACK & SUPPORT | TBD |
| PLUGIN COMPATIBILITY | TBD |
| GRAPHICS | TBD |
| PDF VIEWER | TBD |
| GEOLOCATION | TBD |
| DOWNLOADS | TBD |
| PRINTING | TBD |
| BOOKMARKS | TBD |
| SCROLL & ZOOM | TBD |
| SEARCH | TBD |
| AWESOMEBAR & INDICATORS | TBD |
| POLICY ENGINE AND API | TBD |
Checklist
- [DONE] Functional automation
- [DONE] Treeherder
- [IN PROGRESS] Manual Smoke Testing
- [DONE] Bug fix verifications
- Manual update testing:
Bug Fix Verifications
- Bug fixes triaged in terms of testability/priority: list.
- Verified fixes:
- Security fixes: none
- Other fixes:
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1
Issues
New
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1
Known
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1