MozillaWiki

Releases/Firefox 31 ESR/Test Plan: Difference between revisions

Page Discussion

Releases/Firefox 31 ESR/Test Plan (view source)

Revision as of 14:04, 13 July 2015

7,330 bytes added ,  13 July 2015
→‎Firefox 31.8.0 ESR
 
(42 intermediate revisions by 4 users not shown)
Line 1,654: Line 1,654:
* {{bug|1133634}} VERIFIED: Black video on Linux
* {{bug|1133634}} VERIFIED: Black video on Linux
* {{bug|1146339}} VERIFIED: Doc Navigation
* {{bug|1146339}} VERIFIED: Doc Navigation
* {{bug|1146855}} NO VERIFY: Release engineering tools
* {{bug|1146855}} NO VERIFY: Release engineering tools --- mozharness bug, not a Firefox bug
** not verified - mozharness bug, not a Firefox bug
* {{bug|1141081}} NO VERIFY: Plug-ins crash --- no steps to reproduce, no previous crashes in ESR
* {{bug|1141081}} NO VERIFY: Plug-ins crash
* {{bug|106596}} NO VERIFY: Heap use-after-free --- no ASAN builds available to verify
** not verified - no steps to reproduce, no previous crashes in ESR
* {{bug|106596}} NO VERIFY: Heap use-after-free
** not verified - no ASAN builds available to verify


=== Issues ===
=== Issues ===
Line 1,669: Line 1,666:
{
{
  "id":"545940,579843,856034,942130,965780,972658,1000108,1008178,1010976,1018882,1020341,1043280,1059726,1059816,1124666,1133764,1144124"
  "id":"545940,579843,856034,942130,965780,972658,1000108,1008178,1010976,1018882,1020341,1043280,1059726,1059816,1124666,1133764,1144124"
}
</bugzilla>
== Firefox 31.7.0 ESR ==
{| class="wikitable" style="width:30%"
|-
| '''Builds'''
| [ftp://ftp.mozilla.org/pub/firefox/nightly/31.7.0esr-candidates/build2/ FTP], [http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/31.7.0esr-candidates/build2/ HTTP]
|-
| '''ID'''
| 20150504194141
|-
| '''Changeset'''
| [https://hg.mozilla.org/releases/mozilla-esr31/rev/7f3854a8ddcf 7f3854a8ddcf] ([https://hg.mozilla.org/releases/mozilla-esr31/log/a16695912cbc pushlog])
|}
; Checklist
* {{done|}} Functional automation [http://mozmill-release.blargon7.com/#/functional/reports?app=All&branch=31&platform=All&from=2015-05-05&to=2015-05-11 reports]
** Known Issues:
*** NEW {{bug|1111568}} Test failure 'Number of visible rows should equal 6' in /testAwesomeBar/testVisibleItemsMax.js
*** FIXED {{bug|1148182}} Re-enable testSecNotification and make the expired tests work with the new domain
* {{done|}} Manual smoke tests
* {{done|}} Bug fix verifications [https://bugzilla.mozilla.org/buglist.cgi?f1=cf_status_firefox_esr31&list_id=12214975&o1=equals&chfieldto=Now&query_format=advanced&chfield=cf_status_firefox_esr31&chfieldfrom=2015-03-31&chfieldvalue=fixed&v1=fixed bug fixes]
* {{done|}} Update automation on esr-localtest [http://mozmill-release.blargon7.com/#/update/detail?app=All&branch=31&channel=esr-localtest&from=2015-05-11&to=2015-05-12&target=31.7.0 reports]
** [[QA/Desktop_Firefox/Releases/Configs/Fx31.7.0esr|configs]]
* {{done|}} Conditional sign-off for push to mirrors
* {{done|}} Update automation on esr-cdntest
* {{done|}} Final sign-off for push to esr
* {{done|}} Update automation on esr
* {{done|}} Post Release - Verify that ESR 31.7.0 has been whitelisted by Apple - {{bug|1170516}}
=== Manual Smoketests ===
Run the '''[https://moztrap.mozilla.org/runtests/environment/7091/ Firefox ESR 31.7.0 Smoketests]''' in MozTrap and report the results below.
{|class="wikitable" style="width:60%"
|-
| class="header" style="text-align:center;" | Platform
| class="header" style="text-align:center;" | Assignee
| class="header" style="text-align:center;" | Result: [https://moztrap.mozilla.org/results/cases/?filter-run=7091 report]
|-
| Windows 8.1 32-bit
| Vasilica Mihasca
| style="text-align:center;" | {{done|}}
|-
| Windows 7 64-bit
| Camelia Badau
| style="text-align:center;" | {{done|}}
|-
| Mac OS X 10.9.5
| Petruta Rasa
| style="text-align:center;" | {{done|}}
|-
| Ubuntu 14.04 32-bit
| Catalin Varga
| style="text-align:center;" | {{done|}}
|}
=== Bug Fix Verifications ===
* {{bug|822298}} NO VERIFY: Intermittent test failure --- intermittent failure of automated test
* {{bug|981869}} VERIFIED: Slow loading via PAC file
* {{bug|1080995}} VERIFIED: Video Crash
* {{bug|1087565}} VERIFIED: IPC
* {{bug|1120655}} NO VERIFY: JS analysis ---- no manual verification needed
* {{bug|1128586}} VERIFIED: mach mercurial-setup
* {{bug|1140537}} VERIFIED: XML parser
* {{bug|1141081}} NO VERIFY: Plug-ins crash --- no steps to reproduce, no previous crashes in ESR
* {{bug|1143299}} NO VERIFY: Layout crash ---- no manual verification needed
* {{bug|1144366}} NO VERIFY: JS code style --- only changes code style and should not affect anything else
* {{bug|1149542}} VERIFIED: SVG crash
* {{bug|1150038}} NO VERIFY: Intermittent test failure --- intermittent failure of automated test
* {{bug|1151139}} NO VERIFY: WebRTC Signaling --- no manual verification needed
* {{bug|1152177}} VERIFIED: JavaScript assertion
* {{bug|1153478}} NO VERIFY: Layout crash --- could not reproduce, asked reporter to verify
=== Issues ===
==== New ====
<bugzilla>
{
"id":"1161952"
}
</bugzilla>
==== Known ====
<bugzilla>
{
"id":"481781,545940,579843,856034,942130,947079,972658,1000108,1008178,1018882,1020341,1043696,1059726,1153133"
}
</bugzilla>
== Firefox 31.8.0 ESR ==
{| class="wikitable" style="width:30%"
|-
| '''Builds'''
| [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/candidates/31.8.0esr-candidates/build1/ FTP], [https://ftp.mozilla.org/pub/mozilla.org/firefox/candidates/31.8.0esr-candidates/build1// HTTPS]
|-
| '''ID'''
| 20150624141335
|-
| '''Changeset'''
| [https://hg.mozilla.org/releases/mozilla-esr31/rev/7707a37fe477 7707a37fe477] ([https://hg.mozilla.org/releases/mozilla-esr31/pushloghtml pushlog])
|}
; Checklist
* {{done|}} Functional automation [http://mozmill-release.blargon7.com/#/functional/reports?app=All&branch=31&platform=All&from=2015-06-22&to=2015-06-30 reports]
** Known Issues: [FIXED] {{bug|1119784}} Test failure 'The SSL error message contains disabled information...' in testSecurity/testSSLDisabledErrorPage.js
* {{done|}} [https://goo.gl/GaXjjI Manual Smoke tests]
* {{done|}} Bug fix verifications - [https://goo.gl/0PElDy query]
* {{done|}} Update automation on esr-localtest [http://mozmill-release.blargon7.com/#/update/detail?app=All&branch=All&channel=esr-localtest&from=2015-06-30&to=2015-06-30&target=31.8.0 reports]
** [[QA/Desktop_Firefox/Releases/Configs/Fx31.8.0esr|configs]]
* {{done|}} Conditional sign-off for push to mirrors
* {{done|}} Update automation on esr-cdntest [http://mozmill-release.blargon7.com/#/update/detail?app=All&branch=All&channel=esr-cdntest&from=2015-07-01&to=2015-07-01&target=31.8.0 reports]
* {{done|}} Final sign-off for push to esr
* {{done|}} Update automation on esr
* {{done|}} Post Release - Verify that ESR 31.8.0 has been whitelisted by Apple
=== Manual Smoketests ===
{|class="wikitable" style="width:60%"
|-
| class="header" style="text-align:center;" | Platform
| class="header" style="text-align:center;" | Assignee
| class="header" style="text-align:center;" | Result: [https://docs.google.com/spreadsheets/d/1DjD6JkpMzyc_QubQXbGDNUJXGvJQCrC1aRTqsSbv8Mw/edit#gid=897005781 report]
|-
| Windows 8.1 64-bit
| Andrei Vaida
| style="text-align:center;" | {{done|}}
|-
| Windows 7 64-bit
| Camelia Badau
| style="text-align:center;" | {{done|}}
|-
| Mac OS X 10.9.5
| Bogdan Maris
| style="text-align:center;" | {{done|}}
|-
| Ubuntu 12.04 32-bit
| Cornel Ionce
| style="text-align:center;" | {{done|}}
|}
{|class="wikitable" style="width:60%"
|-
| class="header" style="width:20%; text-align:center;" | Testing Type
| class="header" style="width:20%; text-align:center;" | Results ([https://docs.google.com/spreadsheets/d/1DjD6JkpMzyc_QubQXbGDNUJXGvJQCrC1aRTqsSbv8Mw/edit#gid=343932925 report])
|-
| Smoke Testing
| style="background:#9D9; text-align:center;" | GOOD FOR RELEASE
|-
|}
=== Bug Fix Verifications ===
* Bug fixes triaged in terms of testability/priority: [https://docs.google.com/spreadsheets/d/1dPCAIZvCXXsW-efi7o66Yx5fP8jfj5oJxK8k48BTsjw/edit#gid=164551274 list].
* Verified fixes ([https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1154876%2C%201138554%20&list_id=12351013 query]):
** Security fixes: [https://bugzil.la/1142210 1142210], [https://bugzil.la/1154876 1154876], [https://bugzil.la/1160884 1160884], [https://bugzil.la/1163109 1163109], [https://bugzil.la/1166924 1166924]
** Other fixes:
<blockquote>
<bugzilla>
{
"id":"1138554",
"include_fields":"id,summary,status,resolution"
}
</bugzilla>
</blockquote>
=== Issues ===
==== New ====
<bugzilla>
{
"id":"1177382, 1177385"
}
</bugzilla>
==== Known ====
<bugzilla>
{
"id":"942130, 1142945, 962560, 1147363, 1161952, 1010976, 1059726, 1144124, 1018882, 1043280, 1008178, 972658, 1127353"
}
}
</bugzilla>
</bugzilla>
Florin.Mezei
Confirmed users
2,482

edits

Retrieved from "https://wiki.mozilla.org/Special:MobileDiff/1067239...1084362"