Releases/Firefox 38/Test Plan/Beta/4: Difference between revisions

Jump to navigation Jump to search
no edit summary
No edit summary
Line 5: Line 5:
* QA Contact: [mailto:kairo@mozilla.com Robert Kaiser]; [mailto:florin.mezei@softvisioninc.eu Florin Mezei]
* QA Contact: [mailto:kairo@mozilla.com Robert Kaiser]; [mailto:florin.mezei@softvisioninc.eu Florin Mezei]
* IRC: irc://irc.mozilla.org#qa ping kairo; FlorinMezei
* IRC: irc://irc.mozilla.org#qa ping kairo; FlorinMezei
* Build 1: [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/candidates/38.0b4-candidates/build1/ Firefox 38 Beta 4] | [https://hg.mozilla.org/releases/mozilla-beta/pushloghtml?changeset=ec12b6470115 changeset] | (ID: 20150413143743)
* Build 1: [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/candidates/38.0b4-candidates/build1/ Firefox 38 Beta 4] | [https://hg.mozilla.org/releases/mozilla-beta/rev/05508ccf3ae8 changeset] | (ID: 20150413143743)


== QE recommendation regarding the quality of the build ==
== QE recommendation regarding the quality of the build ==
Line 11: Line 11:
{| class="wikitable" width=50%
{| class="wikitable" width=50%
  ! Recommendation based on results from manual testing
  ! Recommendation based on results from manual testing
  | style="background:#FFA500; text-align:center;" | ''''''
  | style="background:#FFFF00; text-align:center;" | '''TBD'''
|}
|}


== Risks with this Beta and ways to mitigate them through testing ==
== Risks with this Beta and ways to mitigate them through testing ==
''Please list any risks related to the quality of this release.''
''Please list any risks related to the quality of this release.''
 
* '''1. YouTube (default player)'''
** Some additional fixes landed for the Video/Audio area (e.g. https://bugzil.la/1133633, https://bugzil.la/1147744)
** YouTube is experimenting with a new HTML5 video player (http://goo.gl/TteTSO)
** Testing to ensure that there are no new issues with the YouTube default player (HTML5 for Windows and Mac OS)
** Will be covered by Exploratory testing
* '''2. Web Compatibility'''
** Part of the Beta Regression run
** Testing to ensure that the most common web sites work without major issues
** Will be covered by Regression testing
* '''3. Breakpad'''
** Part of the Beta Regression run
** Testing to ensure that the Breakpad works without major issues
** Will be covered by Regression testing
* '''4. Toolbars'''
** Part of the Beta Regression run
** Testing to ensure that Toolbars can be customized with any major issues
** Will be covered by Regression testing


== Features ==
== Features ==
Line 82: Line 98:
== Bug Summary ==  
== Bug Summary ==  
*'''New bugs'''
*'''New bugs'''
<bugzilla>
    NONE   
{
"id":"",
"include_fields":"id,summary,status,resolution"
}
</bugzilla>
*'''New bugs to this Beta'''
*'''New bugs to this Beta'''
<bugzilla>
    NONE   
{
"id":"",
"include_fields":"id,summary,status,resolution"
}
</bugzilla> 
*'''Known Issues'''
*'''Known Issues'''
<bugzilla>
<bugzilla>
{
{
  "id":"",
  "id":"942130,947079,1113647,1138967,1142992,1143988,1151863",
  "include_fields":"id,summary,status,resolution"
  "include_fields":"id,summary,status,resolution"
}
}
Line 119: Line 125:
** [FAIL] Play different video formats
** [FAIL] Play different video formats
** [FAIL] Play various audio formats
** [FAIL] Play various audio formats
** [PASS/FAIL] Desktop Firefox Web Compatibility - ''IN PROGRESS''
** [PASS/FAIL] Breakpad End-to-End Functionality - ''IN PROGRESS''
** [PASS/FAIL] Customize toolbars - ''IN PROGRESS''


* Remaining (for next beta builds)
* Remaining (for next beta builds)
** [PASS/FAIL] Desktop Firefox Add-on Compatibility
** [PASS/FAIL] Desktop Firefox Add-on Compatibility
** [PASS/FAIL] Desktop Firefox Plugin Compatibility
** [PASS/FAIL] Desktop Firefox Plugin Compatibility
** [PASS/FAIL] Desktop Firefox Web Compatibility
** [PASS/FAIL] Mac OSX Signing Verification
** [PASS/FAIL] Mac OSX Signing Verification
** [PASS/FAIL] Verify update applies with root owned files
** [PASS/FAIL] Verify update applies with root owned files
** [PASS/FAIL] Mac OSX 32-bit Mode
** [PASS/FAIL] Mac OSX 32-bit Mode
** [PASS/FAIL] Breakpad End-to-End Functionality
** [PASS/FAIL] Hello Smoke test
** [PASS/FAIL] Hello Smoke test
** [PASS/FAIL] Customize toolbars
** [PASS/FAIL] Browsing secure sites
** [PASS/FAIL] Browsing secure sites
** [PASS/FAIL] Install, disable, enable, remove themes and personas
** [PASS/FAIL] Install, disable, enable, remove themes and personas
Line 144: Line 150:
  | class="header" style="text-align:center;" | Result: [https://etherpad.mozilla.org/Fx38b4 report]
  | class="header" style="text-align:center;" | Result: [https://etherpad.mozilla.org/Fx38b4 report]
  |-
  |-
  | Windows 7 x64
  | Windows 7 64-bit (GPU: -)
  | Camelia Badau
  | Camelia Badau
  | style="text-align:center;" | {{|}}
  | style="text-align:center;" | {{ok|}}
  |-
  |-
  | Windows 8 x86
  | Windows 8 32-bit (GPU: nVIDIA GeForce 620)
  | Cornel Ionce
  | Cornel Ionce
  | style="text-align:center;" | {{|}}
  | style="text-align:center;" | {{ok|}}
  |-
  |-
  | Mac OSX 10.9.5
  | Mac OSX 10.9.5 (GPU: -)
  | Catalin Varga
  | Catalin Varga
  | style="text-align:center;" | {{|}}
  | style="text-align:center;" | {{ok|}}
  |-
  |-
  | Ubuntu x86
  | Ubuntu 14.04 32-bit (GPU: -)
  | Bogdan Maris
  | Bogdan Maris
  | style="text-align:center;" | {{|}}
  | style="text-align:center;" | {{ok|}}
  |}
  |}


Line 167: Line 173:
  | class="header" style="width:20%; text-align:center;" | Results ([https://etherpad.mozilla.org/Fx38b4 report])
  | class="header" style="width:20%; text-align:center;" | Results ([https://etherpad.mozilla.org/Fx38b4 report])
  |-
  |-
  |  
  | YouTube (default player)
  |  
  | Exploratory testing
  | style="background:#FFA500; text-align:center;" |
  | style="background:#FFFF00; text-align:center;" | IN PROGRESS
|-
|
|
| style="background:#9D9; text-align:center;" |  
  |-
  |-
  |
  | Web Compatibility
  |  
  | Regression testing
  | style="background:#9D9; text-align:center;" |  
  | style="background:#FFFF00; text-align:center;" | IN PROGRESS
  |-
  |-
  |  
  | Breakpad
  |
  | Regression testing
  | style="background:#FFA500; text-align:center;" |  
  | style="background:#FFFF00; text-align:center;" | IN PROGRESS
  |-
  |-
  |
  | Toolbars
  |  
  | Regression testing
  | style="background:#9D9; text-align:center;" |  
  | style="background:#FFFF00; text-align:center;" | IN PROGRESS
  |}
  |}


Confirmed users
2,482

edits

Navigation menu