QA/mozilla-beta/fx6/Beta 2

« mozilla-beta:fx6 | mozilla-beta:fx6:Beta 2 | mozilla-beta:fx6:Beta 3 »

Beta 2 Test Plan and Results

• Release: Thursday/Friday July 15th/16th
• QA Contact: Juan Becerra
• IRC: irc://irc.mozilla.org#qa juanb
• Builds: Firefox 6.0b2 | pushlog

We should complete the following tasks before signing off on the next weekly beta. We should be focusing on bug verifications and testing around fixes.

• [ON TRACK] Manual Testing - Waverley Team: result
• [ON TRACK] Automation (Mozmill BFTs) - ashughes/whimboo: result
• [ON TRACK] Automation (Updates) - ashughes/whimboo: result
• [ON TRACK] Stability Report (crash-stats) - marcia: result
• [ON TRACK] Bug Verifications - Waverley Team: result

Spotchecks should be performed across all supported operating systems, including Mac OSX 10.7 which is close to shipping:

• Windows XP
• Windows 7 (32-bit & 64-bit)
• Windows Vista
• Mac OSX 10.6
• Ubuntu 10.10 (32-bit and 64-bit)
• Windows 2000
• Mac OSX 10.7

Results

Problems Found

List any found issues or bugs here. Use [6b2] whiteboard entry to keep track.

Automation - Anthony/Henrik

Run automated BFTs and link reports from dashboard

• Reports: Litmus, Mozmill

Platform	Result	General Tests	Restart Tests
Windows 2000	result	REPORT	REPORT
Windows XP	result	REPORT	REPORT
Windows Vista	result	REPORT	REPORT
Windows 7	result	REPORT	REPORT
Windows 7 64-bit	result	REPORT	REPORT
Mac OS X 10.6	result	REPORT	REPORT
Ubuntu 10.10	result	REPORT	REPORT
Ubuntu 10.10 64-bit	result	REPORT (i686) REPORT (x86_64)	REPORT (i686) REPORT (x86_64)
Mac OS X 10.7	result	REPORT	REPORT

Issues Found

• Any major issues?

Manual - Waverley Team

Smoketests

Litmus Testrun: https://litmus.mozilla.org/run_tests.cgi?test_run_id=321

Platform	Name of tester	Results
Windows 2000	tester	result
Windows XP	tester	result
Windows Vista	tester	result
Windows 7	tester	result
Windows 7 64-bit	tester	result
Mac OS X 10.6	tester	result
Ubuntu 10.10	tester	result
Ubuntu 10.10 64-bit	tester	result
Mac OS X 10.7	result	tester	result

Issues Found

• Any major issues?

BFTs

• WinXP
  • Testers:
  • Results: result in Litmus with known issues

Issues Found

• n/a

Updates - Anthony/Henrik

Mozmill Results

Platform	Betatest: report	Releasetest: [ report]	Beta: [ report]
Windows 2000	en-US: result de: result es-ES: result ru: result	en-US: result de: result es-ES: result ru: result	en-US: result de: result es-ES: result ru: result
Windows XP	en-US: result es-ES: result fr: result ru: result	en-US: result es-ES: result fr: result ru: result	en-US: result es-ES: result fr: result ru: result
Windows Vista	en-US: result es-ES: result fr: result ru: result	en-US: result es-ES: result fr: result ru: result	en-US: result es-ES: result fr: result ru: result
Windows 7	en-US: result de: result ru: result zh-TW: result	en-US: result de: result ru: result zh-TW: result	en-US: result de: result ru: result zh-TW: result
Windows 7 64-bit	en-US: result de: result ru: result zh-TW: result	en-US: result de: result ru: result zh-TW: result	en-US: result de: result ru: result zh-TW: result
Mac OS X 10.6	en-US: result de: result fr: result	en-US: result de: result fr: result	en-US: result de: result fr: result
Ubuntu 10.10	en-US: result de: result es-ES: result fr: result zh-TW: result	en-US: result de: result es-ES: result fr: result zh-TW: result	en-US: result de: result es-ES: result fr: result zh-TW: result
Ubuntu 10.10 64-bit	en-US: result de: result es-ES: result fr: result zh-TW: result	en-US: result de: result es-ES: result fr: result zh-TW: result	en-US: result de: result es-ES: result fr: result zh-TW: result
Mac OS X 10.7	en-US: result de: result fr: result	en-US: result de: result fr: result	en-US: result de: result fr: result

Issues Found

• Any major issues?