Releases/Firefox 38/Test Plan/Beta/RC: Difference between revisions

no edit summary
No edit summary
No edit summary
 
(2 intermediate revisions by the same user not shown)
Line 5: Line 5:
* QA Contact: [mailto:kairo@mozilla.com Robert Kaiser]; [mailto:florin.mezei@softvisioninc.eu Florin Mezei]
* QA Contact: [mailto:kairo@mozilla.com Robert Kaiser]; [mailto:florin.mezei@softvisioninc.eu Florin Mezei]
* IRC: irc://irc.mozilla.org#qa ping kairo; FlorinMezei
* IRC: irc://irc.mozilla.org#qa ping kairo; FlorinMezei
* Build 1: [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/candidates/38.0-candidates/build1/ Firefox 38 RC build 1] | [https://hg.mozilla.org/releases/mozilla-release/rev/ changeset] | (ID: TBD)
* Build 1: [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/candidates/38.0-candidates/build1/ Firefox 38 RC build 1] | [https://hg.mozilla.org/releases/mozilla-release/rev/3fe0e43cd50c changeset] | (ID: 20150503173159)


== QE recommendation regarding the quality of the build ==
== QE recommendation regarding the quality of the build ==
Line 11: Line 11:
{| class="wikitable" width=50%
{| class="wikitable" width=50%
  ! Recommendation based on results from manual testing
  ! Recommendation based on results from manual testing
  | style="background:#9D9; text-align:center;" | '''TBA'''
  | style="background:#9D9; text-align:center;" | '''GOOD FOR RELEASE'''
|}
|}


== Risks with this Beta and ways to mitigate them through testing ==
== Risks with this Beta and ways to mitigate them through testing ==
''Please list any risks related to the quality of this release.''
''Please list any risks related to the quality of this release.''
 
* '''1. YouTube (default player)'''
 
** Main focus area especially for Windows and Mac OS, where the intent is to use the HTML5 player (with MSE by default)
** Testing to make sure that the YouTube default player works without any major issues caused by recent fixes
** Will be covered by Sanity testing
* '''2. Audio/Video playback'''
** Several fixes landed for this are in recent Beta builds
** Testing to make sure that playing common Audio/Video formats still works without any major issues
** Will be covered by Sanity testing
* '''3. Web Compatibility'''
** Testing to ensure that the most common web sites work without issues
** Will be covered by Sanity testing


== Features ==
== Features ==
Line 56: Line 65:
  | [https://bugzilla.mozilla.org/show_bug.cgi?id=738796 In-content preferences]
  | [https://bugzilla.mozilla.org/show_bug.cgi?id=738796 In-content preferences]
  | Camelia Badau
  | Camelia Badau
  | {{mok|}}  
  | {{mdone|}}  
  | New feature since many previous versions - final QA sign-off at the end of Beta 38
  | Feature officially signed off on April 30th 2015
  | [[QA/Desktop Firefox/in-content-preferences| Test Plan]]
  | [[QA/Desktop Firefox/in-content-preferences| Test Plan]]
  |-
  |-
Line 69: Line 78:
  | Alexandra Lucinet
  | Alexandra Lucinet
  | {{mok|}}  
  | {{mok|}}  
  | Constantly monitoring for new issues and Verification of important fixes - NO final QA sign-off
  | Constant monitoring for new issues and Verification of important fixes - NO final QA sign-off
  | -
  | -
  |-
  |-
Line 75: Line 84:
  | Bogdan Maris
  | Bogdan Maris
  | {{mok|}}  
  | {{mok|}}  
  | Constantly monitoring for new issues and Verification of important fixes - NO final QA sign-off
  | Constant monitoring for new issues and Verification of important fixes - NO final QA sign-off
  | -
  | -
  |-
  |-
Line 87: Line 96:
== Known Issues ==  
== Known Issues ==  
*''Major issues''
*''Major issues''
    NONE
<bugzilla>
{
"id":"1142992,1155674",
"include_fields":"id,summary,status,resolution"
}
</bugzilla> 
*''Low impact issues''
*''Low impact issues''
<bugzilla>
<bugzilla>
{
{
  "id":"",
  "id":"947079,962560,1010976,1096357,1127577,1143988",
  "include_fields":"id,summary,status,resolution"
  "include_fields":"id,summary,status,resolution"
}
}
Line 121: Line 135:
** [PASS] Mac OSX 32-bit Mode
** [PASS] Mac OSX 32-bit Mode
** [PASS] Browsing secure sites
** [PASS] Browsing secure sites
** [PASS] Mac OSX Signing Verification
** [FAIL] Hello Smoke test
** [PASS] Install, disable, enable, remove themes and personas


* Remaining (for next beta builds)
* Remaining (for next beta builds)
** [PASS/FAIL] Mac OSX Signing Verification
    NONE
** [PASS/FAIL] Hello Smoke test
** [PASS/FAIL] Install, disable, enable, remove themes and personas


== Exploratory Testing ==
== Exploratory Testing ==
Line 135: Line 150:
  | class="header" style="text-align:center;" | Platform
  | class="header" style="text-align:center;" | Platform
  | class="header" style="text-align:center;" | Assignee
  | class="header" style="text-align:center;" | Assignee
  | class="header" style="text-align:center;" | Result: [https://etherpad.mozilla.org/Fx38RC1 report]
  | class="header" style="text-align:center;" | Result: [https://etherpad.mozilla.org/Fx38-0 report]
  |-
  |-
  |
  | Windows 7 64-bit (GPU: AMD Radeon HD 5450)
  |  
  | Catalin Varga
  | style="text-align:center;" | {{mnotstarted|}}
  | style="text-align:center;" | {{mdone|}}
  |-
  |-
  |  
  | Windows 8.1 32-bit (GPU: AMD Radeon HD 3000)
  |
  | Vasilica Mihasca
  | style="text-align:center;" | {{mnotstarted|}}
  | style="text-align:center;" | {{mdone|}}
  |-
  |-
  |  
  | Mac OS X 10.9.5 (GPU: Intel Iris Pro 1024 MB)
  |
  | Camelia Badau
  | style="text-align:center;" | {{mnotstarted|}}
  | style="text-align:center;" | {{mdone|}}
  |-
  |-
  |  
  | Ubuntu 14.04 x86 (GPU: Intel HD Graphics 2500)
  |  
  | Petruta Rasa
  | style="text-align:center;" | {{mnotstarted|}}
  | style="text-align:center;" | {{mdone|}}
  |}
  |}


Line 160: Line 175:
  | class="header" style="width:20%; text-align:center;" | Results ([https://etherpad.mozilla.org/Fx38RC1 report])
  | class="header" style="width:20%; text-align:center;" | Results ([https://etherpad.mozilla.org/Fx38RC1 report])
  |-
  |-
  |  
  | YouTube (default player)
  |  
  | Sanity testing
  | style="background:#9D9; text-align:center;" | TBA
  | style="background:#FFA500; text-align:center;" | CONDITIONAL PASS
|-
|
|
| style="background:#9D9; text-align:center;" | TBA
|-
|
|
| style="background:#9D9; text-align:center;" | TBA
  |-
  |-
  |  
  | Audio/Video playback
  |
  | Sanity testing
  | style="background:#FFA500; text-align:center;" | TBA
  | style="background:#9D9; text-align:center;" | PASS
  |-
  |-
  |
  | Web Compatibility
  |\
  | Sanity testing
  | style="background:#9D9; text-align:center;" | TBA
  | style="background:#9D9; text-align:center;" | PASS
  |-
  |-
  |}
  |}
Line 189: Line 196:
<bugzilla>
<bugzilla>
{
{
  "id":"",
  "id":"1130356,1137603",
  "include_fields":"id,summary,status,resolution"
  "include_fields":"id,summary,status,resolution"
}
}
Confirmed users
2,482

edits