QA/mozilla-beta/fx6/Beta 2: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
Line 137: Line 137:


=== Updates ===
=== Updates ===
; Mozmill Results
{| class="fullwidth-table"
{| class="fullwidth-table"
  | style="background:#EFEFEF; width:25%" | '''Platform'''
  | style="background:#EFEFEF; width:15%" | '''Platform'''
  | style="background:#EFEFEF; width:25%" | '''Betatest''': [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=6.0&channel=betatest&from=2011-07-14&to=2011-07-14&target=6.0 report]
  | style="background:#EFEFEF; width:75%" | '''Build IDs'''
| style="background:#EFEFEF; width:25%" | '''Releasetest''': [ report]
| style="background:#EFEFEF; width:10%" | '''Result'''
| style="background:#EFEFEF; width:25%" | '''Beta''': [ report]
|-
| colspan="4" | '''Betatest''': [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=6.0&channel=betatest&from=2011-07-14&to=2011-07-14&target=6.0 report]
  |-
  |-
  | Windows 2000
  | Windows 2000
  | en-US: '''result''' <br> de: '''result''' <br> es-ES: '''result''' <br> ru: '''result'''
  |  
  | en-US: '''result''' <br> de: '''result''' <br> es-ES: '''result''' <br> ru: '''result'''
  |
| en-US: '''result''' <br> de: '''result''' <br> es-ES: '''result''' <br> ru: '''result'''
  |-
  |-
  | Windows XP
  | Windows XP
  | en-US: '''result''' <br> es-ES: '''result''' <br> fr: '''result''' <br> ru: '''result'''
  |  
  | en-US: '''result''' <br> es-ES: '''result''' <br> fr: '''result''' <br> ru: '''result'''
  |
| en-US: '''result''' <br> es-ES: '''result''' <br> fr: '''result''' <br> ru: '''result'''
  |-
  |-
  | Windows Vista
  | Windows Vista
  | en-US: '''result''' <br> es-ES: '''result''' <br> fr: '''result''' <br> ru: '''result'''
  |  
  | en-US: '''result''' <br> es-ES: '''result''' <br> fr: '''result''' <br> ru: '''result'''
  |
| en-US: '''result''' <br> es-ES: '''result''' <br> fr: '''result''' <br> ru: '''result'''
  |-
  |-
  | Windows 7
  | Windows 7
  | en-US: '''result''' <br> de: '''result''' <br> ru: '''result''' <br> zh-TW: '''result'''
  |  
  | en-US: '''result''' <br> de: '''result''' <br> ru: '''result''' <br> zh-TW: '''result'''
  |
| en-US: '''result''' <br> de: '''result''' <br> ru: '''result''' <br> zh-TW: '''result'''
  |-
  |-
  | Windows 7 64-bit
  | Windows 7 64-bit
  | en-US: '''result''' <br> de: '''result''' <br> ru: '''result''' <br> zh-TW: '''result'''
  |  
  | en-US: '''result''' <br> de: '''result''' <br> ru: '''result''' <br> zh-TW: '''result'''
  |
| en-US: '''result''' <br> de: '''result''' <br> ru: '''result''' <br> zh-TW: '''result'''
  |-
  |-
  | Mac OS X 10.6
  | Mac OS X 10.6
  | en-US: '''result''' <br> de: '''result''' <br> fr: '''result'''
  |  
  | en-US: '''result''' <br> de: '''result''' <br> fr: '''result'''
  |
| en-US: '''result''' <br> de: '''result''' <br> fr: '''result'''
  |-
  |-
  | Ubuntu 10.10
  | Mac OS X 10.7
| en-US: '''result''' <br> de: '''result''' <br> es-ES: '''result''' <br> fr: '''result''' <br> zh-TW: '''result'''
  |  
  | en-US: '''result''' <br> de: '''result''' <br> es-ES: '''result''' <br> fr: '''result''' <br> zh-TW: '''result'''
  |
  | en-US: '''result''' <br> de: '''result''' <br> es-ES: '''result''' <br> fr: '''result''' <br> zh-TW: '''result'''
  |-
  |-
  | Ubuntu 10.10 64-bit
  | Ubuntu 11.04
  | en-US: '''result''' <br> de: '''result''' <br> es-ES: '''result''' <br> fr: '''result''' <br> zh-TW: '''result'''
  |  
  | en-US: '''result''' <br> de: '''result''' <br> es-ES: '''result''' <br> fr: '''result''' <br> zh-TW: '''result'''
  |
| en-US: '''result''' <br> de: '''result''' <br> es-ES: '''result''' <br> fr: '''result''' <br> zh-TW: '''result'''
  |-
  |-
  | Mac OS X 10.7
  | Ubuntu 11.04 64-bit
| en-US: '''result''' <br> de: '''result''' <br> fr: '''result'''
  |  
  | en-US: '''result''' <br> de: '''result''' <br> fr: '''result'''
  |
  | en-US: '''result''' <br> de: '''result''' <br> fr: '''result'''
  |}
  |}


; Issues Found
; Issues Found
* Any major issues?
* Any major issues?

Revision as of 18:58, 14 July 2011

« mozilla-beta:fx6 | mozilla-beta:fx6:Beta 2 | mozilla-beta:fx6:Beta 3 »

Beta 2 Test Plan and Results

Tasks

We should complete the following tasks before signing off on the next weekly beta. We should be focusing on bug verifications and testing around fixes.

  • [DONE] Automation (Mozmill BFTs) - ashughes/whimboo: Signed Off
  • [DONE] Bug Verifications - Waverley Team: Signed Off
  • [DONE] Manual Testing - Waverley Team: Signed Off
  • [ON TRACK] Automation (Updates) - ashughes/whimboo: result
  • [ON TRACK] Crash Stats / Feedback / Web Content Sign Off - juanb, marcia: result

Spotchecks should be performed across all supported operating systems, including Mac OSX 10.7 which is close to shipping:

  • Windows XP
  • Windows 7 (32-bit & 64-bit)
  • Windows Vista
  • Mac OSX 10.6
  • Ubuntu 10.10 (32-bit and 64-bit)
  • Windows 2000
  • Mac OSX 10.7

Results

Problems Found

List any found issues or bugs here. Use [6b2] whiteboard entry to keep track.

Automation

Run automated BFTs and link reports from dashboard

Platform General Tests Restart Tests
Windows 2000 PASS PASS
Windows XP PASS (known random failure) PASS
Windows Vista PASS PASS
Windows 7 PASS (known failure) PASS
Windows 7 64-bit PASS (known failure) PASS
Mac OS X 10.6 PASS (known failure) PASS
Mac OS X 10.7 PASS PASS
Ubuntu 10.10 PASS PASS
Ubuntu 10.10 64-bit PASS (i686) (known failure)
PASS (x86_64)
PASS (i686)
PASS (x86_64)
Issues Found
  • Any major issues?

Manual

Smoketests

Litmus Testrun: https://litmus.mozilla.org/run_tests.cgi?test_run_id=321

Platform Name of tester Results
Windows 2000 SimonaB bug 671535 - Ogv videos fail to play on Windows 2000
Windows XP SimonaB PASS
Windows Vista SimonaB PASS
Windows 7 Andrei PASS
Windows 7 64-bit Andrei PASS
Mac OS X 10.6 VladG PASS
Ubuntu 11.04 George PASS
Ubuntu 11.04 64-bit George PASS
Mac OS X 10.7 VladG PASS
Issues Found
  • Any major issues?
    • bug 671535 - Ogv videos fail to play on Windows 2000
BFTs
  • WinXP
    • Testers: Andrei, George, Simona, Vlad
    • Results: PASS in Litmus with known issues
Issues Found
  • n/a

Updates

Platform Build IDs Result
Betatest: report
Windows 2000
Windows XP
Windows Vista
Windows 7
Windows 7 64-bit
Mac OS X 10.6
Mac OS X 10.7
Ubuntu 11.04
Ubuntu 11.04 64-bit
Issues Found
  • Any major issues?