QA/mozilla-beta/fx6/Beta 2

« mozilla-beta:fx6 | mozilla-beta:fx6:Beta 2 | mozilla-beta:fx6:Beta 3 »

Beta 2 Test Plan and Results

• Release: Thursday/Friday July 15th/16th
• QA Contact: Juan Becerra
• IRC: irc://irc.mozilla.org#qa juanb, ashughes, whimboo
• Builds: Firefox 6.0b2 | pushlog

Tasks

We should complete the following tasks before signing off on the next weekly beta. We should be focusing on bug verifications and testing around fixes.

• [ON TRACK] Automation (Mozmill BFTs) - ashughes/whimboo: result
• [ON TRACK] Bug Verifications - Waverley Team: result
• [ON TRACK] Manual Testing - Waverley Team: result
• [ON TRACK] Automation (Updates) - ashughes/whimboo: result
• [ON TRACK] Crash Stats / Feedback / Web Content Sign Off - juanb, marcia: result

Spotchecks should be performed across all supported operating systems, including Mac OSX 10.7 which is close to shipping:

• Windows XP
• Windows 7 (32-bit & 64-bit)
• Windows Vista
• Mac OSX 10.6
• Ubuntu 10.10 (32-bit and 64-bit)
• Windows 2000
• Mac OSX 10.7

Results

Problems Found

List any found issues or bugs here. Use [6b2] whiteboard entry to keep track.

Automation - Anthony/Henrik

Run automated BFTs and link reports from dashboard

• Reports: Litmus, Mozmill

Platform	Result	General Tests	Restart Tests
Windows 2000	result	PASS	PASS
Windows XP	result	PASS (known random failure)	PASS
Windows Vista	result	PASS	PASS
Windows 7	result	PASS (known failure)	PASS
Windows 7 64-bit	result	PASS (known failure)	PASS
Mac OS X 10.6	result	PASS (known failure)	PASS
Ubuntu 10.10	result	PASS	PASS
Ubuntu 10.10 64-bit	result	PASS (i686) (known failure) PASS (x86_64)	PASS (i686) PASS (x86_64)
Mac OS X 10.7	result	PASS	PASS

Issues Found

• Any major issues?

Manual - Waverley Team

Smoketests

Litmus Testrun: https://litmus.mozilla.org/run_tests.cgi?test_run_id=321

Platform	Name of tester	Results
Windows 2000	SimonaB	bug 671535 - Ogv videos fail to play on Windows 2000
Windows XP	SimonaB	PASS
Windows Vista	SimonaB	PASS
Windows 7	Andrei	PASS
Windows 7 64-bit	Andrei	PASS
Mac OS X 10.6	VladG	PASS
Ubuntu 11.04	George	PASS
Ubuntu 11.04 64-bit	George	PASS
Mac OS X 10.7	VladG	PASS

Issues Found

• Any major issues?
  • bug 671535 - Ogv videos fail to play on Windows 2000

BFTs

• WinXP
  • Testers: Andrei, George, Simona, Vlad
  • Results: result in Litmus with known issues

Issues Found

• n/a

Updates - Anthony/Henrik

Mozmill Results

Platform	Betatest: report	Releasetest: [ report]	Beta: [ report]
Windows 2000	en-US: result de: result es-ES: result ru: result	en-US: result de: result es-ES: result ru: result	en-US: result de: result es-ES: result ru: result
Windows XP	en-US: result es-ES: result fr: result ru: result	en-US: result es-ES: result fr: result ru: result	en-US: result es-ES: result fr: result ru: result
Windows Vista	en-US: result es-ES: result fr: result ru: result	en-US: result es-ES: result fr: result ru: result	en-US: result es-ES: result fr: result ru: result
Windows 7	en-US: result de: result ru: result zh-TW: result	en-US: result de: result ru: result zh-TW: result	en-US: result de: result ru: result zh-TW: result
Windows 7 64-bit	en-US: result de: result ru: result zh-TW: result	en-US: result de: result ru: result zh-TW: result	en-US: result de: result ru: result zh-TW: result
Mac OS X 10.6	en-US: result de: result fr: result	en-US: result de: result fr: result	en-US: result de: result fr: result
Ubuntu 10.10	en-US: result de: result es-ES: result fr: result zh-TW: result	en-US: result de: result es-ES: result fr: result zh-TW: result	en-US: result de: result es-ES: result fr: result zh-TW: result
Ubuntu 10.10 64-bit	en-US: result de: result es-ES: result fr: result zh-TW: result	en-US: result de: result es-ES: result fr: result zh-TW: result	en-US: result de: result es-ES: result fr: result zh-TW: result
Mac OS X 10.7	en-US: result de: result fr: result	en-US: result de: result fr: result	en-US: result de: result fr: result

Issues Found

• Any major issues?