Releases/Firefox 52 ESR/Test Plan: Difference between revisions

no edit summary
No edit summary
 
(28 intermediate revisions by 4 users not shown)
Line 2,664: Line 2,664:
  | class="header" style="text-align:center;" | Build architecture
  | class="header" style="text-align:center;" | Build architecture
  | class="header" style="text-align:center;" | Assignee
  | class="header" style="text-align:center;" | Assignee
  | class="header" style="text-align:center;" | Results: [https://testrail.stage.mozaws.net/index.php?/reports/view/906 report] and [https://docs.google.com/document/d/1NS5dsU2K3IctVD6cPt_ctTOl-d8sSqE68LjvsMWtntA/edit?ts=5aaada0c Driver bugs]
  | class="header" style="text-align:center;" | Results
  |-
  |-
  | Windows 7 x64 (GPU)
  | Windows 7 x64 (AMD 760G)
  | 32-bit
  | 32-bit
  |  
  | Anca Soncutean
  | style="text-align:center;" | {{mdone|}}
  | style="text-align:center;" | {{mdone|}}
  |-
  |-
  | Windows 10 x64 (ATI Radeon 3000)
  | Windows 10 x64 (Intel HD Graphics 530)
  | 64-bit
  | 64-bit
  |  
  | Emil Ghitta
  | style="text-align:center;" | {{mdone|}}
  | style="text-align:center;" | {{mdone|}}
  |-
  |-
  | macOS 10.13 (Intel Iris Pro 1536)
  | macOS 10.13 (Intel Iris Pro 1536)
  | 64-bit
  | 64-bit
  |  
  | Oana Botisan
  | style="text-align:center;" | {{mdone|}}
  | style="text-align:center;" | {{mdone|}}
  |-
  |-
  | Ubuntu 16.04 x64 (AMD RS780)
  | Ubuntu 16.04 x64 (Intel HD Graphics 530)
  | 64-bit
  | 64-bit
  |  
  | Alexandru Simonca
  | style="text-align:center;" | {{mdone|}}
  | style="text-align:center;" | {{mdone|}}
  |}
  |}
Line 2,691: Line 2,691:
  | class="header" style="width:20%; text-align:center;" | Area
  | class="header" style="width:20%; text-align:center;" | Area
  | class="header" style="width:20%; text-align:center;" | Results ([https://testrail.stage.mozaws.net/index.php?/reports/view/906 report])
  | class="header" style="width:20%; text-align:center;" | Results ([https://testrail.stage.mozaws.net/index.php?/reports/view/906 report])
|-
| BUILD BRANDING
| style="background: green; color: white; text-align:center;" | PASS
|-
| CRASH REPORTER
| style="background: green; color: white; text-align:center;" | PASS
  |-
  |-
  | Web Compatibility
  | SESSION RESTORE
  | style="background: xgreen; color: white; text-align:center;" | GREEN
  | style="background: green; color: white; text-align:center;" | PASS
  |-
  |-
  | Build Branding
  | WEB COMPATIBILITY
  | style="background: xgreen; color: white; text-align:center;" | GREEN
  | style="background: green; color: white; text-align:center;" | PASS
|-
| VIDEO COMPATIBILITY
| style="background: green; color: white; text-align:center;" | PASS
|-
| AUDIO COMPATIBILITY
| style="background: green; color: white; text-align:center;" | PASS
|-
| PLUG-IN COMPATIBILITY
| style="background: green; color: white; text-align:center;" | PASS
|-
| GRAPHICS
| style="background: green; color: white; text-align:center;" | PASS
|-
| PDF VIEWER
| style="background: green; color: white; text-align:center;" | PASS
|-
| GEOLOCATION
| style="background: green; color: white; text-align:center;" | PASS
|-
| DOWNLOADS
| style="background: green; color: white; text-align:center;" | PASS
|-
| PRINTING
| style="background: green; color: white; text-align:center;" | PASS
|-
| BOOKMARKS
| style="background: green; color: white; text-align:center;" | PASS
|-
| APZ
| style="background: green; color: white; text-align:center;" | PASS
|-
| CUSTOMIZATION
| style="background: green; color: white; text-align:center;" | PASS
|-
| SYNC & FXA
| style="background: green; color: white; text-align:center;" | PASS
  |-
  |-
  |}
  |}


=== Checklist ===
=== Checklist ===
* {{mprog|}} [https://treeherder.mozilla.org/#/jobs?repo=mozilla-esr52&revision=494e5d5278ba Functional automation]
* {{mprog|}} [https://treeherder.mozilla.org/#/jobs?repo=mozilla-esr52&revision=20f775af7b06 Functional automation]
** Reviewed by Ryan VanderMeulen.
** Reviewed by Ryan VanderMeulen.
* {{mprog|}} [https://testrail.stage.mozaws.net/index.php?/reports/view/906 Manual Smoke Testing]
* {{mdone|}} [https://testrail.stage.mozaws.net/index.php?/reports/view/911 Manual Smoke Testing]
* {{mprog|}} [https://docs.google.com/spreadsheets/d/1dPCAIZvCXXsW-efi7o66Yx5fP8jfj5oJxK8k48BTsjw/edit#gid=1391305042 Bug fix verifications]
* {{mdone|}} [https://docs.google.com/spreadsheets/d/1dPCAIZvCXXsW-efi7o66Yx5fP8jfj5oJxK8k48BTsjw/edit#gid=1391305042 Bug fix verifications]
* Automated update testing ([[QA/Desktop_Firefox/Releases/Configs/Fx52.8.0esr|configs]] for [http://mm-ci-production.qa.scl3.mozilla.com:8080/job/trigger-ondemand/build?delay=0sec ondemand])
* Automated update testing ([[QA/Desktop_Firefox/Releases/Configs/Fx52.8.0esr|configs]] for [http://mm-ci-production.qa.scl3.mozilla.com:8080/job/trigger-ondemand/build?delay=0sec ondemand])
** {{mprog|}} Updates on esr-localtest channel ([https://treeherder.mozilla.org/#/jobs?repo=mozilla-esr52&revision=20f775af7b06&group_state=expanded&filter-tier=3&filter-searchStr=Fxup-esr-localtest( results])
** {{mdone|}} Updates on esr-localtest channel ([https://treeherder.mozilla.org/#/jobs?repo=mozilla-esr52&revision=20f775af7b06&group_state=expanded&filter-tier=3&filter-searchStr=Fxup-esr-localtest( results])
** {{mnotstarted|}} Updates on esr-cdntest channel ([https://treeherder.mozilla.org/#/jobs?repo=mozilla-esr52&revision=20f775af7b06&group_state=expanded&filter-tier=3&filter-searchStr=Fxup-esr-cdntest( results])
** {{mdone|}} Updates on esr-cdntest channel ([https://treeherder.mozilla.org/#/jobs?repo=mozilla-esr52&revision=20f775af7b06&group_state=expanded&filter-tier=3&filter-searchStr=Fxup-esr-cdntest( results])
** {{mnotstarted|}} Updates on esr channel ([https://treeherder.mozilla.org/#/jobs?repo=mozilla-esr52&revision=20f775af7b06&group_state=expanded&filter-tier=3&filter-searchStr=Fxup-esr( results])
** {{mdone|}} Updates on esr channel ([https://treeherder.mozilla.org/#/jobs?repo=mozilla-esr52&revision=20f775af7b06&group_state=expanded&filter-tier=3&filter-searchStr=Fxup-esr( results])


=== Bug Fix Verifications ===
=== Bug Fix Verifications ===
Line 2,735: Line 2,778:
{
{
  "id":"",
  "id":"",
"include_fields":"id,summary,status,resolution"
}
</bugzilla>
== Firefox 52.8.1 ESR ==
=== Build 1 ===
{| class="wikitable" style="width:30%"
|-
| '''Builds'''
| [https://archive.mozilla.org/pub/firefox/candidates/52.8.1esr-candidates/build1/ 52.8.1esr-build1]
|-
| '''ID'''
| 20180430140610
|-
| '''Changeset'''
| [https://hg.mozilla.org/releases/mozilla-esr52/rev/087eeb5396d1 BUILD1], ([https://hg.mozilla.org/releases/mozilla-esr52/pushloghtml pushlog])
|}
{|class="wikitable" style="width:80%"
|-
| class="header" style="text-align:center;" | Platform
| class="header" style="text-align:center;" | Build architecture
| class="header" style="text-align:center;" | Assignee
| class="header" style="text-align:center;" | Results
|-
| Windows 7 x64 (AMD 760G)
| 32-bit
| Mihai Boldan
| style="text-align:center;" | {{mdone|}}
|-
| Windows 10 x64 (Ati Radeon HD 3000)
| 64-bit
| Lucaci Vlad
| style="text-align:center;" | {{mdone|}}
|-
| macOS 10.12 (NVIDIA GT 640M)
| 64-bit
| Gabi Cheta
| style="text-align:center;" | {{mdone|}}
|-
| Ubuntu 16.04 x64 (AMD RS780)
| 64-bit
| AMD RS780
| style="text-align:center;" | {{mdone|}}
|}
{|class="wikitable" style="width:60%"
|-
| class="header" style="width:20%; text-align:center;" | Area
| class="header" style="width:20%; text-align:center;" | Results ([https://testrail.stage.mozaws.net/index.php?/reports/view/TBD report])
|-
| WEB COMPATIBILITY
| style="background: green; color: white; text-align:center;" | GREEN
|-
|}
=== Checklist ===
* {{mdone|}} [https://treeherder.mozilla.org/#/jobs?repo=mozilla-esr52&revision=20f775af7b06 Functional automation]
** Reviewed by Ryan VanderMeulen.
* {{mdone|}} [https://testrail.stage.mozaws.net/index.php?/reports/view/TBD Manual Smoke Testing]
* {{mdone|}} [https://docs.google.com/spreadsheets/d/1dPCAIZvCXXsW-efi7o66Yx5fP8jfj5oJxK8k48BTsjw/edit#gid=1391305042 Bug fix verifications]
* Automated update testing ([[QA/Desktop_Firefox/Releases/Configs/Fx52.8.1esr|configs]] for [http://mm-ci-production.qa.scl3.mozilla.com:8080/job/trigger-ondemand/build?delay=0sec ondemand])
** {{mdone|}} Updates on esr-localtest channel ([https://public.etherpad-mozilla.org/p/esr-52.8.1-build1( results])
** {{mdone|}} Updates on esr-cdntest channel ([https://public.etherpad-mozilla.org/p/esr-52.8.1-build1 results])
** {{mdone|}} Updates on esr channel ([https://public.etherpad-mozilla.org/p/esr-52.8.1-build1 results])
=== Bug Fix Verifications ===
* Bug fixes triaged in terms of testability/priority: [https://docs.google.com/spreadsheets/d/1dPCAIZvCXXsW-efi7o66Yx5fP8jfj5oJxK8k48BTsjw/edit#gid=427160117 list].
* Verified fixes:
** Security fixes: {{bug|}}, {{bug|}}, {{bug|}}, {{bug|}}, {{bug|}}, {{bug|}}
** Other fixes:
<bugzilla>
{
"id":"",
"include_fields":"id,summary,status,resolution"
}
</bugzilla>
=== Issues ===
==== New ====
<bugzilla>
{
"id":"1467104, 1467114",
"include_fields":"id,summary,status,resolution"
}
</bugzilla>
==== Known ====
<bugzilla>
{
"id":"558178, 1194214, 1309534, 1345877, 1436334, 1458470, 1458471, 1459636",
"include_fields":"id,summary,status,resolution"
}
</bugzilla>
== Firefox 52.9.0 ESR ==
=== Build 1 ===
{| class="wikitable" style="width:30%"
|-
| '''Builds'''
| [https://archive.mozilla.org/pub/firefox/candidates/52.9.0esr-candidates/build1/ 52.9.0esr-build1]
|-
| '''ID'''
| 20180619102821
|-
| '''Changeset'''
| [https://hg.mozilla.org/releases/mozilla-esr52/rev/528d4d997bb3 BUILD1], ([https://hg.mozilla.org/releases/mozilla-esr52/pushloghtml pushlog])
|}
{|class="wikitable" style="width:80%"
|-
| class="header" style="text-align:center;" | Platform
| class="header" style="text-align:center;" | Build architecture
| class="header" style="text-align:center;" | Assignee
| class="header" style="text-align:center;" | Results
|-
| Windows 7 x64 (NVIDIA GeForce 210)
| 32-bit
| Camelia Badau
| style="text-align:center;" | {{mdone|}}
|-
| Windows 10 x64 (ATI Radeon 3000)
| 64-bit
| Vlad Lucaci
| style="text-align:center;" | {{mdone|}}
|-
| macOS 10.12 (Intel Iris Pro 1536)
| 64-bit
| Iulia Cristescu
| style="text-align:center;" | {{mdone|}}
|-
| Ubuntu 16.04 x64 (AMD RS780)
| 64-bit
| Anca Soncutean
| style="text-align:center;" | {{mdone|}}
|}
{|class="wikitable" style="width:60%"
|-
| class="header" style="width:20%; text-align:center;" | Area
| class="header" style="width:20%; text-align:center;" | Results ([https://testrail.stage.mozaws.net/index.php?/reports/view/TBD report])
|-
| BUILD BRANDING
| style="background: green; color: white; text-align:center;" | GREEN
|-
| CRASH REPORTER
| style="background: green; color: white; text-align:center;" | GREEN
|-
| SESSION RESTORE
| style="background: green; color: white; text-align:center;" | GREEN
|-
| WEB COMPATIBILITY
| style="background: yellow; color: black; text-align:center;" | YELLOW
|-
| VIDEO COMPATIBILITY
| style="background: yellow; color: black; text-align:center;" | YELLOW
|-
| AUDIO COMPATIBILITY
| style="background: green; color: white; text-align:center;" | PASS
|-
| PLUG-IN COMPATIBILITY
| style="background: green; color: white; text-align:center;" | PASS
|-
| GRAPHICS
| style="background: yellow; color: black; text-align:center;" | YELLOW
|-
| PDF VIEWER
| style="background: yellow; color: black; text-align:center;" | YELLOW
|-
| GEOLOCATION
| style="background: green; color: white; text-align:center;" | PASS
|-
| DOWNLOADS
| style="background: green; color: white; text-align:center;" | PASS
|-
| PRINTING
| style="background: green; color: white; text-align:center;" | PASS
|-
| BOOKMARKS
| style="background: green; color: white; text-align:center;" | PASS
|-
| APZ
| style="background: green; color: white; text-align:center;" | PASS
|-
| CUSTOMIZATION
| style="background: yellow; color: black; text-align:center;" | YELLOW
|-
| SYNC & FXA
| style="background: yellow; color: black; text-align:center;" | YELLOW
|-
|}
=== Checklist ===
* {{mprog|}} [https://treeherder.mozilla.org/#/jobs?repo=mozilla-esr52&revision=20f775af7b06 Functional automation]
** Reviewed by Ryan VanderMeulen.
* {{mdone|}} [https://testrail.stage.mozaws.net/index.php?/reports/view/TBD Manual Smoke Testing]
* {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=803809069 Bug fix verifications]
* Manual update testing
** {{mnotstarted|}} Updates on esr-localtest channel ([https://public.etherpad-mozilla.org/p/esr-52.9.0-build1 results])
** {{mnotstarted|}} Updates on esr-cdntest channel ([https://public.etherpad-mozilla.org/p/esr-52.9.0-build1 results])
** {{mnotstarted|}} Updates on esr channel ([https://public.etherpad-mozilla.org/p/esr-52.9.0-build1 results])
* Verified fixes:
** Security fixes: none
** Other fixes:
<bugzilla>
{
"id":"",
"include_fields":"id,summary,status,resolution"
}
</bugzilla>
=== Issues ===
==== New ====
<bugzilla>
{
"id":"",
"include_fields":"id,summary,status,resolution"
}
</bugzilla>
==== Known ====
<bugzilla>
{
"id":"428378, 539339, 839074, 843087, 972658, 1043280, 1057858, 1144124, 1177382, 1182606, 1194214, 1195053, 1209518, 1230678, 1234958, 1243385, 1249000, 1267592, 1277327, 1282075, 1298395, 1305028, 1309534, 1312024, 1348290, 1349217, 1354033, 1354992, 1360545, 1364436, 1393460, 1411533, 1429065, 1430114, 1443511, 1448823, 1458471, 1458885, 1461635, 1465774",
"include_fields":"id,summary,status,resolution"
}
</bugzilla>
=== Build 2 ===
{| class="wikitable" style="width:30%"
|-
| '''Builds'''
| [https://archive.mozilla.org/pub/firefox/candidates/52.9.0esr-candidates/build1/ 52.9.0esr-build2]
|-
| '''ID'''
| 20180621064021
|-
| '''Changeset'''
| [https://hg.mozilla.org/releases/mozilla-esr52/rev/755067c14b06 BUILD2], ([https://hg.mozilla.org/releases/mozilla-esr52/pushloghtml pushlog])
|}
{|class="wikitable" style="width:80%"
|-
| class="header" style="text-align:center;" | Platform
| class="header" style="text-align:center;" | Build architecture
| class="header" style="text-align:center;" | Assignee
| class="header" style="text-align:center;" | Results
|-
| Windows 7 x64 (NVIDIA GeForce 210)
| 32-bit
| Camelia Badau
| style="text-align:center;" | {{mdone|}}
|-
| Windows 10 x64 (ATI Radeon 3000)
| 64-bit
| Vlad Lucaci
| style="text-align:center;" | {{mdone|}}
|-
| macOS 10.12 (Intel Iris Pro 1536)
| 64-bit
| Timea Zsoldos
| style="text-align:center;" | {{mdone|}}
|-
| Ubuntu 16.04 x64 (ATI HD 3000)
| 64-bit
| Ciprian Georgiu
| style="text-align:center;" | {{mdone|}}
|}
{|class="wikitable" style="width:60%"
|-
| class="header" style="width:20%; text-align:center;" | Area
| class="header" style="width:20%; text-align:center;" | Results ([https://testrail.stage.mozaws.net/index.php?/reports/view/993 report])
|-
| WEB COMPATIBILITY
| style="background: green; color: white; text-align:center;" | GREEN
|-
|-
|}
=== Checklist ===
* {{mprog|}} [https://treeherder.mozilla.org/#/jobs?repo=mozilla-esr52&revision=20f775af7b06 Functional automation]
** Reviewed by Ryan VanderMeulen.
* {{mdone|}} [https://testrail.stage.mozaws.net/index.php?/reports/view/993 Manual Smoke Testing]
* {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=803809069 Bug fix verifications]
* Manual update testing
** {{mdone|}} Updates on esr-localtest channel ([https://public.etherpad-mozilla.org/p/esr-52.9.0-build2 results])
** {{mdone|}} Updates on esr-cdntest channel ([https://public.etherpad-mozilla.org/p/esr-52.9.0-build2 results])
** {{mdone|}} Updates on esr channel ([https://public.etherpad-mozilla.org/p/esr-52.9.0-build2 results])
* Verified fixes:
** Security fixes: none
** Other fixes:
<bugzilla>
{
"id":"",
"include_fields":"id,summary,status,resolution"
}
</bugzilla>
=== Issues ===
==== New ====
<bugzilla>
{
"id":"",
"include_fields":"id,summary,status,resolution"
}
</bugzilla>
==== Known ====
<bugzilla>
{
"id":"558178, 1194214, 1309534, 1393460, 1402827, 1403118, 1405718, 1409673, 1416721, 1429790, 1460860, 1470154, 1470377",
  "include_fields":"id,summary,status,resolution"
  "include_fields":"id,summary,status,resolution"
}
}
</bugzilla>
</bugzilla>
306

edits