QA/mozilla-beta/fx6/Beta 4: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
Line 156: Line 156:


=== Updates ===
=== Updates ===
'''Target Build ID:''' Mozilla/5.0 (Windows NT 5.0; rv:6.0) Gecko/20100101 Firefox/6.0 (???)
'''Source Builds:''' 4.0b*, 4.0, 4.0.1, 5.0b*, 5.0, 6.0b1, 6.0b2, 6.0b3 <br>
'''Source Locales:''' en-US + one random P1 locale per platform <br>
'''Update Types:''' complete+fallback, partial+fallback <br>
'''Target Build ID:''' Mozilla/5.0 (Windows NT 5.0; rv:6.0) Gecko/20100101 Firefox/6.0


{| class="fullwidth-table"
{| class="fullwidth-table"
  | style="background:#EFEFEF; width:15%" | '''Platform'''
  | style="background:#EFEFEF; width:25%" | '''Platform'''
  | style="background:#EFEFEF; width:75%" | '''Builds'''
  | style="background:#EFEFEF; width:65%" | '''Builds'''
  | style="background:#EFEFEF; width:10%" | '''Result'''
  | style="background:#EFEFEF; width:10%" | '''Result'''
  |-
  |-
  | colspan="4" | '''Betatest''': [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=6.0&channel=betatest&from=2011-07-14&to=2011-07-14&target=6.0 report]
  | colspan="4" | '''Betatest''': [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=6.0&channel=betatest&from=2011-08-01&to=2011-08-01&target=6.0 report]
  |-
  |-
  | Windows 2000
  | Windows 2000
  | 4.0b12 en-US/es-ES, 4.0 en-US/de, 5.0b7 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru
  |  
  | '''RESULT'''
  | '''RESULT'''
  |-
  |-
  | Windows XP
  | Windows XP
  | 4.0b9 en-US/es-ES, 4.0 en-US/ko, 5.0b2 en-US/fr, 5.0 en-US/it, 6.0b1 en-US/ru
  |  
  | '''RESULT'''
  | '''RESULT'''
  |-
  |-
  | Windows Vista
  | Windows Vista
  | 4.0b8 en-US/es-ES, 4.0.1 en-US/it, 5.0b3 en-US/it, 5.0 en-US/zh-TW, 6.0b1 en-US/ru
  |  
  | '''RESULT'''
  | '''RESULT'''
  |-
  |-
  | Windows 7
  | Windows 7
  | 4.0b8 en-US/es-ES, 4.0.1 en-US/de, 5.0b1 en-US, 5.0 en-US/zh-TW, 6.0b1 en-US/ru
  |  
  | '''RESULT'''
  | '''RESULT'''
  |-
  |-
  | Windows 7 64-bit
  | Windows 7 64-bit
  | 4.0b8 en-US/es-ES, 4.0 en-US/de, 5.0b6 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru
  |  
  | '''RESULT'''
  | '''RESULT'''
  |-
  |-
  | Mac OS X 10.6
  | Mac OS X 10.6
  | 4.0b10 en-US/de, 4.0.1 en-US/ja-JP-mac, 5.0b3 en-US/ja-JP-mac, 5.0 en-US/zh-TW, 6.0b1 en-US/es-ES
  |  
  | '''RESULT'''
  | '''RESULT'''
  |-
  |-
Line 194: Line 197:
  |-
  |-
  | Ubuntu 11.04
  | Ubuntu 11.04
  | 4.0b11 en-US/es-ES, 4.0.1 en-US/de, 5.0b5 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ko
  |  
  | '''RESULT'''
  | '''RESULT'''
  |-
  |-
  | Ubuntu 11.04 64-bit
  | Ubuntu 11.04 64-bit
  | 4.0b12 en-US/es-ES, 4.0 en-US/de, 5.0b7 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru
  |  
  | '''RESULT'''
  | '''RESULT'''
  |-
  |-
  | colspan="4" | '''Beta''': [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=6.0&channel=beta&from=2011-07-26&to=2011-07-30&target=6.0 report]
  | colspan="4" | '''Beta''': [ report]
  |-
  |-
  | Windows 2000
  | Windows 2000
  | 4.0b12 en-US/es-ES, 4.0 en-US/de, 5.0b7 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru
  |  
  | '''RESULT'''
  | '''RESULT'''
  |-
  |-
  | Windows XP
  | Windows XP
  | 4.0b9 en-US/es-ES, 4.0 en-US/ko, 5.0b2 en-US/fr, 5.0 en-US/it, 6.0b1 en-US/ru
  |  
  | '''RESULT'''
  | '''RESULT'''
  |-
  |-
  | Windows Vista
  | Windows Vista
  | 4.0b8 en-US/es-ES, 4.0.1 en-US/it, 5.0b3 en-US/it, 5.0 en-US/zh-TW, 6.0b1 en-US/ru
  |  
  | '''RESULT'''
  | '''RESULT'''
  |-
  |-
  | Windows 7
  | Windows 7
  | 4.0b8 en-US/es-ES, 4.0.1 en-US/de, 5.0b1 en-US, 5.0 en-US/zh-TW, 6.0b1 en-US/ru
  |  
  | '''RESULT'''
  | '''RESULT'''
  |-
  |-
  | Windows 7 64-bit
  | Windows 7 64-bit
  | 4.0b8 en-US/es-ES, 4.0 en-US/de, 5.0b6 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru
  |  
  | '''RESULT'''
  | '''RESULT'''
  |-
  |-
  | Mac OS X 10.6
  | Mac OS X 10.6
  | 4.0b10 en-US/de, 4.0.1 en-US/ja-JP-mac, 5.0b3 en-US/ja-JP-mac, 5.0 en-US/zh-TW, 6.0b1 en-US/es-ES
  |  
  | '''RESULT'''
  | '''RESULT'''
  |-
  |-
Line 232: Line 235:
  |-
  |-
  | Ubuntu 11.04
  | Ubuntu 11.04
  | 4.0b11 en-US/es-ES, 4.0.1 en-US/de, 5.0b5 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ko
  |  
  | '''RESULT'''
  | '''RESULT'''
  |-
  |-
  | Ubuntu 11.04 64-bit
  | Ubuntu 11.04 64-bit
  | 4.0b12 en-US/es-ES, 4.0 en-US/de, 5.0b7 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru
  |  
  | '''RESULT'''
  | '''RESULT'''
  |-
  |-
Line 242: Line 245:


; Issues Found
; Issues Found
* Any major issues?

Revision as of 15:20, 1 August 2011

« mozilla-beta:fx6 | mozilla-beta:fx6:Beta 3 | mozilla-beta:fx6:Beta 4 | mozilla-beta:fx6:Beta 5 »

Beta 4 Test Plan and Results

Tasks

We should complete the following tasks before signing off on the next weekly beta. We should be focusing on bug verifications and testing around fixes.

  • [ON TRACK] Automation (Mozmill BFTs) - ashughes/whimboo: result
  • [ON TRACK] Bug Verifications - Waverley Team: result
  • [ON TRACK] Manual Testing - Waverley Team: result
  • [ON TRACK] Automation (Updates) - ashughes/whimboo: result
  • [ON TRACK] Crash Stats / Feedback / Web Content Sign Off - juanb, marcia: result

Spotchecks should be performed across all supported operating systems, including Mac OSX 10.7:

  • Windows XP
  • Windows 7 (32-bit & 64-bit)
  • Windows Vista
  • Mac OS X 10.6
  • Mac OS X 10.7
  • Ubuntu 11.04 (32-bit and 64-bit)
  • Windows 2000

Results

Problems Found

List any found issues or bugs here. Use [6b4] whiteboard entry to keep track.

Automation

Run automated BFTs and link reports from dashboard: Litmus, Mozmill

Platform General Tests Restart Tests
Windows 2000 PASS PASS
Windows XP PASS PASS
Windows Vista PASS PASS
Windows 7 PASS PASS
Windows 7 64-bit PASS PASS
Mac OS X 10.6 PASS PASS
Mac OS X 10.7 PASS PASS
Ubuntu 11.04 PASS PASS
Ubuntu 11.04 64-bit PASS PASS
Issues Found

Manual

Smoketests
Platform Name of tester Results
Windows 2000 Simona PASS
Windows XP Andrei PASS
Windows Vista Simona PASS
Windows 7 Andrei PASS
Windows 7 64-bit Alin PASS
Mac OS X 10.6 Vlad G PASS
Ubuntu 11.04 George PASS
Ubuntu 11.04 64-bit George PASS
Mac OS X 10.7 Vlad G PASS
Issues Found
  • Any major issues?
    • n/a
l10n spotchecking
  • German
    • Name of tester: Alin
    • PASS
  • French
    • Name of tester: Alin
    • PASS
  • Spanish
    • Name of tester: Alin
    • PASS
  • Italian
    • Name of tester: Alin
    • PASS
  • Russian
    • Name of tester: Alin
    • PASS
Exploratory Testing Around Changes - On Applicable Platforms
  • WebGL
    • bug 675625 - Firefox crashes when performing WebGL conformance tests on Ubuntu 11.04
  • Flash
  • Silverlight


Issues Found
  • n/a

Updates

Source Builds: 4.0b*, 4.0, 4.0.1, 5.0b*, 5.0, 6.0b1, 6.0b2, 6.0b3
Source Locales: en-US + one random P1 locale per platform
Update Types: complete+fallback, partial+fallback
Target Build ID: Mozilla/5.0 (Windows NT 5.0; rv:6.0) Gecko/20100101 Firefox/6.0

Platform Builds Result
Betatest: report
Windows 2000 RESULT
Windows XP RESULT
Windows Vista RESULT
Windows 7 RESULT
Windows 7 64-bit RESULT
Mac OS X 10.6 RESULT
Mac OS X 10.7
Ubuntu 11.04 RESULT
Ubuntu 11.04 64-bit RESULT
Beta: [ report]
Windows 2000 RESULT
Windows XP RESULT
Windows Vista RESULT
Windows 7 RESULT
Windows 7 64-bit RESULT
Mac OS X 10.6 RESULT
Mac OS X 10.7
Ubuntu 11.04 RESULT
Ubuntu 11.04 64-bit RESULT
Issues Found
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/mozilla-beta/fx6/Beta_4&oldid=335047"