QA/mozilla-beta/fx5/Beta 6: Difference between revisions

From MozillaWiki
< QA
Jump to navigation Jump to search
 
(16 intermediate revisions by 7 users not shown)
Line 11: Line 11:
== Platform Coverage ==
== Platform Coverage ==
All testing/spotchecks should be performed on the following operating systems:
All testing/spotchecks should be performed on the following operating systems:
* Windows 7 (32-bit & 64-bit) - Teodosia, AndreiD
* Windows 7 (32-bit & 64-bit)  
* Windows Vista - Vlad
* Windows Vista  
* Windows XP - Alex
* Windows XP
* Windows 2000 - George
* Windows 2000
* Mac OSX 10.6 - Vlad G
* Mac OSX 10.6
* Ubuntu 10.10 (32-bit and 64-bit) - Florin, George
* Ubuntu 10.10 (32-bit and 64-bit


== Results ==
== Results ==
Line 83: Line 83:
|-
|-
| Windows 2000  
| Windows 2000  
| tester
| George
| result
| PASS
|-
|-
| Windows XP  
| Windows XP  
| tester
| Alex
| result
| PASS
|-
|-
| Windows Vista  
| Windows Vista  
| vladmaniac
| vladmaniac
| result
| PASS
|-
|-
| Windows 7  
| Windows 7  
Line 100: Line 100:
| Windows 7 64-bit  
| Windows 7 64-bit  
| AndreiD
| AndreiD
| result
| PASS
|-
|-
| Mac OS X 10.6  
| Mac OS X 10.6  
| tester
| VladG
| result
| PASS
|-
|-
| Ubuntu 10.10  
| Ubuntu 10.10  
| tester
| George
| result
| PASS
|-
|-
| Ubuntu 10.10 64-bit  
| Ubuntu 10.10 64-bit  
| tester
| Florin
| result
| PASS
|}
|}


;Issues Found
* n/a


;BFTs
;BFTs
* WinXP  
* WinXP  
** Testers: Andrei, Simona, Vlad
** Testers: AndreiD, George, VladG
** Results: '''result''' in Litmus with known issues
** Results: '''PASS''' in Litmus with known issues


;Issues Found
=== Updates ===
* n/a
; Test Coverage
{| class="fullwidth-table"
| style="background:#EFEFEF;" | '''Versions'''
| 5.0b5, 5.0b3
|-
| style="background:#EFEFEF;" | '''Platforms'''
| Windows 2000/XP/7/7x64, Mac OS X 10.6, Ubuntu 10.10 i686/x86-64
|-
| style="background:#EFEFEF;" | '''Locales'''
| en-US, de, es-ES, fr, ru, zh-TW
|}


=== Updates ===
;Results
; Mozmill Results
{| class="fullwidth-table"
{| class="fullwidth-table"
  | style="background:#EFEFEF; width:25%" | '''Platform'''
  | style="background:#EFEFEF; width:25%" | '''Platform'''
  | style="background:#EFEFEF; width:25%" | '''Betatest''': [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=5.0&channel=betatest&from=2011-06-14&to=2011-06-14&target=5.0 report]
  | style="background:#EFEFEF; width:25%" | '''Betatest''': SKIPPED
  | style="background:#EFEFEF; width:25%" | '''Releasetest''': [ report]
| style="background:#EFEFEF; width:25%" | '''Releasetest''': [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=5.0&channel=releasetest&from=2011-06-07&to=2011-06-14&target=5.0 report]
| style="background:#EFEFEF; width:25%" | '''Beta''': [ report]
  | style="background:#EFEFEF; width:25%" | '''Beta''': [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=5.0&channel=beta&from=2011-06-14&to=2011-06-14&target=5.0 report]
  |-
  |-
  | Windows 2000
  | Windows 2000
  | en-US: '''result''' <br> de: '''result''' <br> es-ES: '''result''' <br> ru: '''result'''
  | '''SKIPPED'''
  | en-US: '''result''' <br> de: '''result''' <br> es-ES: '''result''' <br> ru: '''result'''
  | '''PASS'''
  | en-US: '''result''' <br> de: '''result''' <br> es-ES: '''result''' <br> ru: '''result'''
  | '''PASS'''
  |-
  |-
  | Windows XP
  | Windows XP
  | en-US: '''result''' <br> es-ES: '''result''' <br> fr: '''result''' <br> ru: '''result'''
  | '''SKIPPED'''
  | en-US: '''result''' <br> es-ES: '''result''' <br> fr: '''result''' <br> ru: '''result'''
  | '''PASS'''
  | en-US: '''result''' <br> es-ES: '''result''' <br> fr: '''result''' <br> ru: '''result'''
  | '''PASS'''
  |-
  |-
  | Windows Vista
  | Windows Vista
  | en-US: '''result''' <br> es-ES: '''result''' <br> fr: '''result''' <br> ru: '''result'''
  | '''SKIPPED'''
  | en-US: '''result''' <br> es-ES: '''result''' <br> fr: '''result''' <br> ru: '''result'''
  | '''PASS'''
  | en-US: '''result''' <br> es-ES: '''result''' <br> fr: '''result''' <br> ru: '''result'''
  | '''PASS'''
  |-
  |-
  | Windows 7
  | Windows 7
  | en-US: '''result''' <br> de: '''result''' <br> ru: '''result''' <br> zh-TW: '''result'''
  | '''SKIPPED'''
  | en-US: '''result''' <br> de: '''result''' <br> ru: '''result''' <br> zh-TW: '''result'''
  | '''PASS'''
  | en-US: '''result''' <br> de: '''result''' <br> ru: '''result''' <br> zh-TW: '''result'''
  | '''PASS'''
  |-
  |-
  | Windows 7 64-bit
  | Windows 7 64-bit
  | en-US: '''result''' <br> de: '''result''' <br> ru: '''result''' <br> zh-TW: '''result'''
  | '''SKIPPED'''
  | en-US: '''result''' <br> de: '''result''' <br> ru: '''result''' <br> zh-TW: '''result'''
  | '''PASS'''
  | en-US: '''result''' <br> de: '''result''' <br> ru: '''result''' <br> zh-TW: '''result'''
  | '''PASS'''
  |-
  |-
  | Mac OS X 10.6
  | Mac OS X 10.6
  | en-US: '''result''' <br> de: '''result''' <br> fr: '''result'''
  | '''SKIPPED'''
  | en-US: '''result''' <br> de: '''result''' <br> fr: '''result'''
  | '''PASS'''
  | en-US: '''result''' <br> de: '''result''' <br> fr: '''result'''
  | '''PASS'''
  |-
  |-
  | Ubuntu 10.10
  | Ubuntu 10.10
  | en-US: '''result''' <br> de: '''result''' <br> es-ES: '''result''' <br> fr: '''result''' <br> zh-TW: '''result'''
  | '''SKIPPED'''
  | en-US: '''result''' <br> de: '''result''' <br> es-ES: '''result''' <br> fr: '''result''' <br> zh-TW: '''result'''
| '''PASS'''
  | en-US: '''result''' <br> de: '''result''' <br> es-ES: '''result''' <br> fr: '''result''' <br> zh-TW: '''result'''
| '''PASS'''
|-
| Ubuntu 10.10 64-bit (i686)
| '''SKIPPED'''
| '''PASS'''
| '''PASS'''
  |-
| Ubuntu 10.10 64-bit (x86_64)
| '''SKIPPED'''
| '''PASS'''
| '''PASS'''
|}
 
; Channel Switching Spotchecks
''Spotcheck on Beta channel only'' -- '''NOT CHECKED DUE TO FAST SPIN-UP OF BETA7'''
{| class="fullwidth-table"
| style="background:#EFEFEF; width:25%" | '''Platform'''
  | style="background:#EFEFEF; width:65%" | '''Build IDs'''
| style="background:#EFEFEF; width:10%" | '''Result'''
|-
| Windows XP
| Firefox 5.0b1
| '''result'''
|-
| Windows 7
| Firefox 5.0b1
| '''result'''
|-
| Mac OS X 10.6
| Firefox 5.0b1
| '''result'''
  |-
  |-
  | Ubuntu 10.10 64-bit
  | Ubuntu 10.10
  | en-US: '''result''' <br> de: '''result''' <br> es-ES: '''result''' <br> fr: '''result''' <br> zh-TW: '''result'''
  | Firefox 5.0b1
  | en-US: '''result''' <br> de: '''result''' <br> es-ES: '''result''' <br> fr: '''result''' <br> zh-TW: '''result'''
  | '''result'''
| en-US: '''result''' <br> de: '''result''' <br> es-ES: '''result''' <br> fr: '''result''' <br> zh-TW: '''result'''
  |}
  |}


; Issues Found
; Issues Found
* n/a
* slow mirrors causing a few test runs to time out -- builds spotchecked ok


== Problems Found ==
== Problems Found ==
List any found issues or bugs here. Use '''[5b6]''' whiteboard entry to keep track.
List any found issues or bugs here. Use '''[5b6]''' whiteboard entry to keep track.

Latest revision as of 00:15, 15 June 2011

« mozilla-beta | mozilla-beta:fx5 | mozilla-beta:fx6 »

Beta 6 Test Results

The following spotchecks should be performed before signing off on the next weekly beta.

  • [ON TRACK] Manual Testing - result
  • [ON TRACK] Automation (Mozmill BFTs) - result
  • [ON TRACK] Automation (Updates) - result
  • [ON TRACK] Stability Report (crash-stats) - result
  • [ON TRACK] Bug Verifications - result

Platform Coverage

All testing/spotchecks should be performed on the following operating systems:

  • Windows 7 (32-bit & 64-bit)
  • Windows Vista
  • Windows XP
  • Windows 2000
  • Mac OSX 10.6
  • Ubuntu 10.10 (32-bit and 64-bit

Results

Automation

Run automated BFTs and link reports from dashboard

Platform Result General Tests Restart Tests
Windows 2000 PASS REPORT REPORT
Windows XP PASS REPORT REPORT
Windows Vista PASS REPORT REPORT
Windows 7 PASS REPORT REPORT
Windows 7 64-bit PASS REPORT REPORT
Mac OS X 10.6 PASS REPORT REPORT
Ubuntu 10.10 PASS REPORT REPORT
Ubuntu 10.10 64-bit PASS REPORT (i686)
REPORT (x86_64) 		REPORT (i686)
REPORT (x86_64)
Issues Found
  • n/a

Manual

Smoketests

Litmus Testrun: https://litmus.mozilla.org/run_tests.cgi?test_run_id=309

Platform Name of tester Results
Windows 2000 George PASS
Windows XP Alex PASS
Windows Vista vladmaniac PASS
Windows 7 Teodosia PASS
Windows 7 64-bit AndreiD PASS
Mac OS X 10.6 VladG PASS
Ubuntu 10.10 George PASS
Ubuntu 10.10 64-bit Florin PASS


BFTs
  • WinXP
    • Testers: AndreiD, George, VladG
    • Results: PASS in Litmus with known issues

Updates

Test Coverage
Versions 5.0b5, 5.0b3
Platforms Windows 2000/XP/7/7x64, Mac OS X 10.6, Ubuntu 10.10 i686/x86-64
Locales en-US, de, es-ES, fr, ru, zh-TW
Results
Platform Betatest: SKIPPED Releasetest: report Beta: report
Windows 2000 SKIPPED PASS PASS
Windows XP SKIPPED PASS PASS
Windows Vista SKIPPED PASS PASS
Windows 7 SKIPPED PASS PASS
Windows 7 64-bit SKIPPED PASS PASS
Mac OS X 10.6 SKIPPED PASS PASS
Ubuntu 10.10 SKIPPED PASS PASS
Ubuntu 10.10 64-bit (i686) SKIPPED PASS PASS
Ubuntu 10.10 64-bit (x86_64) SKIPPED PASS PASS
Channel Switching Spotchecks

Spotcheck on Beta channel only -- NOT CHECKED DUE TO FAST SPIN-UP OF BETA7

Platform Build IDs Result
Windows XP Firefox 5.0b1 result
Windows 7 Firefox 5.0b1 result
Mac OS X 10.6 Firefox 5.0b1 result
Ubuntu 10.10 Firefox 5.0b1 result
Issues Found
  • slow mirrors causing a few test runs to time out -- builds spotchecked ok

Problems Found

List any found issues or bugs here. Use [5b6] whiteboard entry to keep track.

Retrieved from "https://wiki.mozilla.org/index.php?title=QA/mozilla-beta/fx5/Beta_6&oldid=319105"