MozillaWiki

Releases/Firefox 24 ESR/Test Plan: Difference between revisions

Page Discussion

Releases/Firefox 24 ESR/Test Plan (view source)

Revision as of 22:56, 24 September 2014

8,414 bytes added ,  24 September 2014
→‎Firefox 24.8.1 ESR
 
(38 intermediate revisions by 2 users not shown)
Line 1,966: Line 1,966:


== Firefox 24.7.0 ESR ==
== Firefox 24.7.0 ESR ==
{| class="querytable" style="width:30%"
{| class="wikitable" style="width:30%"
| style="width:10%" |
| style="width:20%" |
  |-
  |-
  | '''Builds'''
  | '''Builds'''
Line 1,992: Line 1,990:
=== Automated Testing ===
=== Automated Testing ===
The following are the detailed results of the automated Mozmill test runs.
The following are the detailed results of the automated Mozmill test runs.
{|class="querytable" style="width:60%"
{|class="wikitable" style="width:60%"
  |-
  |-
  | class="header" style="width:20%; text-align:center;" | Platform
  | class="header" style="width:20%; text-align:center;" | Platform
Line 2,039: Line 2,037:
=== Manual Smoketests ===
=== Manual Smoketests ===
Run the '''[https://moztrap.mozilla.org/runtests/environment/4686/ Firefox ESR 24.7 Smoke Tests]''' in MozTrap and report the results below.
Run the '''[https://moztrap.mozilla.org/runtests/environment/4686/ Firefox ESR 24.7 Smoke Tests]''' in MozTrap and report the results below.
{|class="querytable" style="width:60%"
{|class="wikitable" style="width:60%"
  |-
  |-
  | class="header" style="text-align:center;" | Platform
  | class="header" style="text-align:center;" | Platform
Line 2,066: Line 2,064:
* Complete: 24.5.0
* Complete: 24.5.0


{|class="querytable" style="width:60%"
{|class="wikitable" style="width:60%"
  |-
  |-
  | class="header" style="text-align:center;" | Platform
  | class="header" style="text-align:center;" | Platform
Line 2,212: Line 2,210:
* {{done|}} Functional automation
* {{done|}} Functional automation
* {{done|}} Manual smoketests
* {{done|}} Manual smoketests
* {{ok|}} Bug fix verifications
* {{done|}} Bug fix verifications
* {{done|}} Update automation on esrtest
* {{done|}} Update automation on esrtest
* {{ok|}} Conditional sign-off for push to mirrors
* {{done|}} Conditional sign-off for push to mirrors
* {{ok|}} Update automation on releasetest
* {{done|}} Update automation on releasetest
* {{ok|}} Final sign-off for push to esr
* {{done|}} Final sign-off for push to esr
* {{ok|}} Update automation on esr
* {{done|}} Update automation on esr


=== Automated Testing ===
=== Automated Testing ===
Line 2,306: Line 2,304:
  | style="text-align:center;"| Firefox 24.8.0
  | style="text-align:center;"| Firefox 24.8.0
  | style="background:#9D9; text-align:center;" | PASSED
  | style="background:#9D9; text-align:center;" | PASSED
  |  
  | style="background:#9D9; text-align:center;" | PASSED
  |  
  | style="background:#9D9; text-align:center;" | PASSED
  |-
  |-
  | Windows Vista
  | Windows Vista
  | style="text-align:center;"| Firefox 24.8.0
  | style="text-align:center;"| Firefox 24.8.0
  | style="background:#9D9; text-align:center;" | PASSED
  | style="background:#9D9; text-align:center;" | PASSED
  |  
  | style="background:#9D9; text-align:center;" | PASSED
  |  
  | style="background:#9D9; text-align:center;" | PASSED
  |-
  |-
  | Windows 7 32-bit
  | Windows 7 32-bit
  | style="text-align:center;"| Firefox 24.8.0
  | style="text-align:center;"| Firefox 24.8.0
  | style="background:#9D9; text-align:center;" | PASSED
  | style="background:#9D9; text-align:center;" | PASSED
  |  
  | style="background:#9D9; text-align:center;" | PASSED
  |  
  | style="background:#9D9; text-align:center;" | PASSED
  |-
  |-
  | Windows 7 64-bit
  | Windows 7 64-bit
  | style="text-align:center;"| Firefox 24.8.0
  | style="text-align:center;"| Firefox 24.8.0
  | style="background:#9D9; text-align:center;" | PASSED
  | style="background:#9D9; text-align:center;" | PASSED
  |  
  | style="background:#9D9; text-align:center;" | PASSED
  |  
  | style="background:#9D9; text-align:center;" | PASSED
  |-
  |-
  | Windows 8 32-bit
  | Windows 8 32-bit
  | style="text-align:center;"| Firefox 24.8.0
  | style="text-align:center;"| Firefox 24.8.0
  | style="background:#9D9; text-align:center;" | PASSED
  | style="background:#9D9; text-align:center;" | PASSED
  |  
  | style="background:#9D9; text-align:center;" | PASSED
  |  
  | style="background:#9D9; text-align:center;" | PASSED
  |-
  |-
  | Windows 8 64-bit
  | Windows 8 64-bit
  | style="text-align:center;"| Firefox 24.8.0
  | style="text-align:center;"| Firefox 24.8.0
  | style="background:#9D9; text-align:center;" | PASSED
  | style="background:#9D9; text-align:center;" | PASSED
  |  
  | style="background:#9D9; text-align:center;" | PASSED
  |  
  | style="background:#9D9; text-align:center;" | PASSED
  |-
  |-
  | Mac OS X 10.6
  | Mac OS X 10.6
  | style="text-align:center;"| Firefox 24.8.0
  | style="text-align:center;"| Firefox 24.8.0
  | style="background:#9D9; text-align:center;" | PASSED
  | style="background:#9D9; text-align:center;" | PASSED
  |  
  | style="background:#9D9; text-align:center;" | PASSED
  |  
  | style="background:#9D9; text-align:center;" | PASSED
  |-
  |-
  | Mac OS X 10.7
  | Mac OS X 10.7
  | style="text-align:center;"| Firefox 24.8.0
  | style="text-align:center;"| Firefox 24.8.0
  | style="background:#9D9; text-align:center;" | PASSED
  | style="background:#9D9; text-align:center;" | PASSED
  |  
  | style="background:#9D9; text-align:center;" | PASSED
  |  
  | style="background:#9D9; text-align:center;" | PASSED
  |-
  |-
  | Mac OS X 10.8
  | Mac OS X 10.8
  | style="text-align:center;"| Firefox 24.8.0
  | style="text-align:center;"| Firefox 24.8.0
  | style="background:#9D9; text-align:center;" | PASSED
  | style="background:#9D9; text-align:center;" | PASSED
  |  
  | style="background:#9D9; text-align:center;" | PASSED
  |  
  | style="background:#9D9; text-align:center;" | PASSED
  |-
  |-
  | Ubuntu 12.04 32-bit
  | Ubuntu 12.04 32-bit
  | style="text-align:center;"| Firefox 24.8.0
  | style="text-align:center;"| Firefox 24.8.0
  | style="background:#9D9; text-align:center;" | PASSED
  | style="background:#9D9; text-align:center;" | PASSED
  |  
  | style="background:#9D9; text-align:center;" | PASSED
  |  
  | style="background:#9D9; text-align:center;" | PASSED
  |-
  |-
  | Ubuntu 12.04 64-bit
  | Ubuntu 12.04 64-bit
  | style="text-align:center;"| Firefox 24.8.0
  | style="text-align:center;"| Firefox 24.8.0
  | style="background:#9D9; text-align:center;" | PASSED
  | style="background:#9D9; text-align:center;" | PASSED
  |  
  | style="background:#9D9; text-align:center;" | PASSED
  |  
  | style="background:#9D9; text-align:center;" | PASSED
  |-
  |-
  | Ubuntu 13.04 32-bit
  | Ubuntu 13.04 32-bit
  | style="text-align:center;"| Firefox 24.8.0
  | style="text-align:center;"| Firefox 24.8.0
  | style="background:#9D9; text-align:center;" | PASSED
  | style="background:#9D9; text-align:center;" | PASSED
  |  
  | style="background:#9D9; text-align:center;" | PASSED
  |  
  | style="background:#9D9; text-align:center;" | PASSED
  |-
  |-
  | Ubuntu 13.04 64-bit
  | Ubuntu 13.04 64-bit
  | style="text-align:center;"| Firefox 24.8.0
  | style="text-align:center;"| Firefox 24.8.0
  | style="background:#9D9; text-align:center;" | PASSED
  | style="background:#9D9; text-align:center;" | PASSED
  |  
  | style="background:#9D9; text-align:center;" | PASSED
  |  
  | style="background:#9D9; text-align:center;" | PASSED
  |}
  |}


Line 2,400: Line 2,398:
{
{
  "id":"913747, 928379, 1000108, 1000306, 1058010"
  "id":"913747, 928379, 1000108, 1000306, 1058010"
}
</bugzilla>
== Firefox 24.8.1 ESR ==
{| class="wikitable" style="width:30%"
|-
| '''Builds'''
| [ftp://ftp.mozilla.org/pub/firefox/nightly/24.8.1esr-candidates/build1/ FTP], [http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/24.8.1esr-candidates/build1/ HTTP]
|-
| '''ID'''
| 20140923194127
|-
| '''Changeset'''
| [https://hg.mozilla.org/releases/mozilla-esr24/rev/1a4ef6655b21 1a4ef6655b21] ([http://hg.mozilla.org/releases/mozilla-esr24/pushloghtml?fromchange=420be099bad9&tochange=1a4ef6655b21 pushlog])
|}
; Checklist
* {{done|}} Functional automation
* {{done|}} Manual smoketests
* {{done|}} Bug fix verifications
* {{done|}} Update automation on esrtest
* {{done|}} Conditional sign-off for push to mirrors
* {{done|}} Update automation on releasetest
* {{done|}} Final sign-off for push to esr
* {{done|}} Update automation on esr
=== Automated Testing ===
The following are the detailed results of the automated Mozmill test runs.
{|class="wikitable" style="width:60%"
|-
| class="header" style="width:20%; text-align:center;" | Platform
| class="header" style="width:20%; text-align:center;" | Functional [[http://mozmill-release.blargon7.com/#/functional/reports?app=All&branch=24.8&platform=All&from=2014-09-23&to=2014-09-24 report]]
|-
| Windows XP
| style="background:#9D9; text-align:center;" | PASSED
|-
| Windows Vista
| style="background:#9D9; text-align:center;" | PASSED
|-
| Windows 7 32-bit
| style="background:#9D9; text-align:center;" | PASSED
|-
| Windows 7 64-bit
| style="background:#9D9; text-align:center;" | PASSED
|-
| Windows 8 32-bit
| style="background:#9D9; text-align:center;" | PASSED
|-
| Windows 8 64-bit
| style="background:#9D9; text-align:center;" | PASSED
|-
| Mac OS X 10.6
| style="background:#9D9; text-align:center;" | PASSED
|-
| Mac OS X 10.7
| style="background:#9D9; text-align:center;" | PASSED
|-
| Mac OS X 10.8
| style="background:#9D9; text-align:center;" | PASSED
|-
| Ubuntu 12.04 32-bit
| style="background:#9D9; text-align:center;" | PASSED
|-
| Ubuntu 12.04 64-bit
| style="background:#9D9; text-align:center;" | PASSED
|-
| Ubuntu 13.10 32-bit
| style="background:#9D9; text-align:center;" | PASSED
|-
| Ubuntu 13.10 64-bit
| style="background:#9D9; text-align:center;" | PASSED
|}
=== Manual Smoketests ===
Exploratory testing focused on: Browsing secure sites, Web compatibility, Add-on & Plug-in compatibility, Common media format playback, Sync & Persona sign-on. Results are at: https://mozqa.etherpad.mozilla.org/ESR31-24-Testing.
{|class="wikitable" style="width:60%"
|-
| class="header" style="text-align:center;" | Platform
| class="header" style="text-align:center;" | Assignee
| class="header" style="text-align:center;" | Result: [https://mozqa.etherpad.mozilla.org/ESR31-24-Testing report]
|-
| Windows 8.1 32-bit
| Andrei Vaida
| style="text-align:center;" | {{done|}}
|-
| Windows 7 64-bit
| Cornel Ionce
| style="text-align:center;" | {{done|}}
|-
| Mac OS X 10.9.5
| Alexandra Lucinet
| style="text-align:center;" | {{done|}}
|-
| Ubuntu 14.04 32-bit
| Mihaela Velimiroviciu
| style="text-align:center;" | {{done|}}
|}
=== Update Testing ===
* Partial 17.0.x, 24.x.0
* Complete: 24.5.0
{|class="wikitable" style="width:60%"
|-
| class="header" style="text-align:center;" | Platform
| class="header" style="text-align:center;" | Target Version
| class="header" style="text-align:center;" | esrtest
| class="header" style="text-align:center;" | releasetest
| class="header" style="text-align:center;" | esr
|-
| Windows XP
| style="text-align:center;"| Firefox 24.8.1
| style="background:#9D9; text-align:center;" | PASSED
| style="background:#9D9; text-align:center;" | PASSED
| style="background:#9D9; text-align:center;" | PASSED
|-
| Windows Vista
| style="text-align:center;"| Firefox 24.8.1
| style="background:#9D9; text-align:center;" | PASSED
| style="background:#9D9; text-align:center;" | PASSED
| style="background:#9D9; text-align:center;" | PASSED
|-
| Windows 7 32-bit
| style="text-align:center;"| Firefox 24.8.1
| style="background:#9D9; text-align:center;" | PASSED
| style="background:#9D9; text-align:center;" | PASSED
| style="background:#9D9; text-align:center;" | PASSED
|-
| Windows 7 64-bit
| style="text-align:center;"| Firefox 24.8.1
| style="background:#9D9; text-align:center;" | PASSED
| style="background:#9D9; text-align:center;" | PASSED
| style="background:#9D9; text-align:center;" | PASSED
|-
| Windows 8 32-bit
| style="text-align:center;"| Firefox 24.8.1
| style="background:#9D9; text-align:center;" | PASSED
| style="background:#9D9; text-align:center;" | PASSED
| style="background:#9D9; text-align:center;" | PASSED
|-
| Windows 8 64-bit
| style="text-align:center;"| Firefox 24.8.1
| style="background:#9D9; text-align:center;" | PASSED
| style="background:#9D9; text-align:center;" | PASSED
| style="background:#9D9; text-align:center;" | PASSED
|-
| Mac OS X 10.6
| style="text-align:center;"| Firefox 24.8.1
| style="background:#9D9; text-align:center;" | PASSED
| style="background:#9D9; text-align:center;" | PASSED
| style="background:#9D9; text-align:center;" | PASSED
|-
| Mac OS X 10.7
| style="text-align:center;"| Firefox 24.8.1
| style="background:#9D9; text-align:center;" | PASSED
| style="background:#9D9; text-align:center;" | PASSED
| style="background:#9D9; text-align:center;" | PASSED
|-
| Mac OS X 10.8
| style="text-align:center;"| Firefox 24.8.1
| style="background:#9D9; text-align:center;" | PASSED
| style="background:#9D9; text-align:center;" | PASSED
| style="background:#9D9; text-align:center;" | PASSED
|-
| Ubuntu 12.04 32-bit
| style="text-align:center;"| Firefox 24.8.1
| style="background:#9D9; text-align:center;" | PASSED
| style="background:#9D9; text-align:center;" | PASSED
| style="background:#9D9; text-align:center;" | PASSED
|-
| Ubuntu 12.04 64-bit
| style="text-align:center;"| Firefox 24.8.1
| style="background:#9D9; text-align:center;" | PASSED
| style="background:#9D9; text-align:center;" | PASSED
| style="background:#9D9; text-align:center;" | PASSED
|-
| Ubuntu 13.04 32-bit
| style="text-align:center;"| Firefox 24.8.1
| style="background:#9D9; text-align:center;" | PASSED
| style="background:#9D9; text-align:center;" | PASSED
| style="background:#9D9; text-align:center;" | PASSED
|-
| Ubuntu 13.04 64-bit
| style="text-align:center;"| Firefox 24.8.1
| style="background:#9D9; text-align:center;" | PASSED
| style="background:#9D9; text-align:center;" | PASSED
| style="background:#9D9; text-align:center;" | PASSED
|}
=== Bug Fix Verifications ===
* {{bug|1064636}} {{done|}} VERIFIED: Update NSS to latest version r=rrelyea, a=lmandel
* {{bug|1069405}} {{done|}} VERIFIED: Update NSS to latest version r=rrelyea, a=lmandel
=== Issues ===
==== New ====
<bugzilla>
{
"id":""
}
</bugzilla>
==== Known ====
<bugzilla>
{
"id":"591893, 864912, 870779, 913747, 928379, 942130, 947079, 1000108, 1000306, 1010976, 1021703, 1058010, 1059310, 1059726"
}
}
</bugzilla>
</bugzilla>
Kjozwiak
Confirmed users
924

edits

Retrieved from "https://wiki.mozilla.org/Special:MobileDiff/1010226...1018156"