QA/mozilla-beta/fx6/Beta 2: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
No edit summary
Line 4: Line 4:
We should complete the following tasks before signing off on the next weekly beta. We should be focusing on bug verifications and testing around fixes.
We should complete the following tasks before signing off on the next weekly beta. We should be focusing on bug verifications and testing around fixes.


* {{ok|}} Manual Testing - [[QA/mozilla-beta/fx6/Beta_2/Manual_Testing|'''result''']]
* {{ok|}} Manual Testing - Waverley Team: [[QA/mozilla-beta/fx6/Beta_2/Manual_Testing|'''result''']]
* {{ok|}} Automation (Mozmill BFTs) - [[QA/mozilla-beta/fx6/Beta_2#Automation|'''result''']]
* {{ok|}} Automation (Mozmill BFTs) - ashughes/whimboo: [[QA/mozilla-beta/fx6/Beta_2#Automation|'''result''']]
* {{ok|}} Automation (Updates) - [[QA/mozilla-beta/fx6/Beta_2#Updates|'''result''']]
* {{ok|}} Automation (Updates) - ashughes/whimboo: [[QA/mozilla-beta/fx6/Beta_2#Updates|'''result''']]
* {{ok|}} Stability Report (crash-stats) - '''result'''
* {{ok|}} Stability Report (crash-stats) - marcia: '''result'''
* {{ok|}} [https://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=0d82a53ffaa6&tochange=ea7034005498 Bug Verifications] - '''result'''
* {{ok|}} [https://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=0d82a53ffaa6&tochange=ea7034005498 Bug Verifications] - Waverley Team: '''result'''


Spotchecks should be performed across all supported operating systems, including Mac OSX 10.7 which is close to shipping:
Spotchecks should be performed across all supported operating systems, including Mac OSX 10.7 which is close to shipping:
Line 20: Line 20:


== Results ==
== Results ==
== Problems Found ==
=== Problems Found ===
List any found issues or bugs here. Use '''[6b2]''' whiteboard entry to keep track.
List any found issues or bugs here. Use '''[6b2]''' whiteboard entry to keep track.


=== Automation ===
=== Automation - Anthony/Henrik ===
Run automated BFTs and link reports from dashboard
Run automated BFTs and link reports from dashboard
* Reports: [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=321 Litmus], [http://mozmill-release.brasstacks.mozilla.com/#/functional/reports?branch=6.0&platform=All&from=2011-07-13&to=2011-07-14 Mozmill]
* Reports: [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=321 Litmus], [http://mozmill-release.brasstacks.mozilla.com/#/functional/reports?branch=6.0&platform=All&from=2011-07-13&to=2011-07-14 Mozmill]
Line 81: Line 81:
* Any major issues?
* Any major issues?


=== Manual ===
=== Manual - Waverley Team ===
;Smoketests
;Smoketests
Litmus Testrun: https://litmus.mozilla.org/run_tests.cgi?test_run_id=321
Litmus Testrun: https://litmus.mozilla.org/run_tests.cgi?test_run_id=321
Line 140: Line 140:
* n/a
* n/a


=== Updates ===
=== Updates - Anthony/Henrik ===
; Mozmill Results
; Mozmill Results
{| class="fullwidth-table"
{| class="fullwidth-table"

Revision as of 06:01, 14 July 2011

« mozilla-beta:fx6 | mozilla-beta:fx6:Beta 2 | mozilla-beta:fx6:Beta 3 »

Beta 2 Test Results

We should complete the following tasks before signing off on the next weekly beta. We should be focusing on bug verifications and testing around fixes.

  • [ON TRACK] Manual Testing - Waverley Team: result
  • [ON TRACK] Automation (Mozmill BFTs) - ashughes/whimboo: result
  • [ON TRACK] Automation (Updates) - ashughes/whimboo: result
  • [ON TRACK] Stability Report (crash-stats) - marcia: result
  • [ON TRACK] Bug Verifications - Waverley Team: result

Spotchecks should be performed across all supported operating systems, including Mac OSX 10.7 which is close to shipping:

  • Windows XP
  • Windows 7 (32-bit & 64-bit)
  • Windows Vista
  • Mac OSX 10.6
  • Ubuntu 10.10 (32-bit and 64-bit)
  • Windows 2000
  • Mac OSX 10.7

Results

Problems Found

List any found issues or bugs here. Use [6b2] whiteboard entry to keep track.

Automation - Anthony/Henrik

Run automated BFTs and link reports from dashboard

Platform Result General Tests Restart Tests
Windows 2000 result REPORT REPORT
Windows XP result REPORT REPORT
Windows Vista result REPORT REPORT
Windows 7 result REPORT REPORT
Windows 7 64-bit result REPORT REPORT
Mac OS X 10.6 result REPORT REPORT
Ubuntu 10.10 result REPORT REPORT
Ubuntu 10.10 64-bit result REPORT (i686)
REPORT (x86_64)
REPORT (i686)
REPORT (x86_64)
Mac OS X 10.7 result REPORT REPORT
Issues Found
  • Any major issues?

Manual - Waverley Team

Smoketests

Litmus Testrun: https://litmus.mozilla.org/run_tests.cgi?test_run_id=321

Platform Name of tester Results
Windows 2000 tester result
Windows XP tester result
Windows Vista tester result
Windows 7 tester result
Windows 7 64-bit tester result
Mac OS X 10.6 tester result
Ubuntu 10.10 tester result
Ubuntu 10.10 64-bit tester result
Mac OS X 10.7 result tester result
Issues Found
  • Any major issues?
BFTs
  • WinXP
    • Testers:
    • Results: result in Litmus with known issues
Issues Found
  • n/a

Updates - Anthony/Henrik

Mozmill Results
Platform Betatest: report Releasetest: [ report] Beta: [ report]
Windows 2000 en-US: result
de: result
es-ES: result
ru: result
en-US: result
de: result
es-ES: result
ru: result
en-US: result
de: result
es-ES: result
ru: result
Windows XP en-US: result
es-ES: result
fr: result
ru: result
en-US: result
es-ES: result
fr: result
ru: result
en-US: result
es-ES: result
fr: result
ru: result
Windows Vista en-US: result
es-ES: result
fr: result
ru: result
en-US: result
es-ES: result
fr: result
ru: result
en-US: result
es-ES: result
fr: result
ru: result
Windows 7 en-US: result
de: result
ru: result
zh-TW: result
en-US: result
de: result
ru: result
zh-TW: result
en-US: result
de: result
ru: result
zh-TW: result
Windows 7 64-bit en-US: result
de: result
ru: result
zh-TW: result
en-US: result
de: result
ru: result
zh-TW: result
en-US: result
de: result
ru: result
zh-TW: result
Mac OS X 10.6 en-US: result
de: result
fr: result
en-US: result
de: result
fr: result
en-US: result
de: result
fr: result
Ubuntu 10.10 en-US: result
de: result
es-ES: result
fr: result
zh-TW: result
en-US: result
de: result
es-ES: result
fr: result
zh-TW: result
en-US: result
de: result
es-ES: result
fr: result
zh-TW: result
Ubuntu 10.10 64-bit en-US: result
de: result
es-ES: result
fr: result
zh-TW: result
en-US: result
de: result
es-ES: result
fr: result
zh-TW: result
en-US: result
de: result
es-ES: result
fr: result
zh-TW: result
Mac OS X 10.7 en-US: result
de: result
fr: result
en-US: result
de: result
fr: result
en-US: result
de: result
fr: result
Issues Found
  • Any major issues?