QA/mozilla-beta/Template

« mozilla-beta:fx6 | mozilla-beta:fx6:Beta 3 | mozilla-beta:fx6:Beta 4 | mozilla-beta:fx6:Beta 5 » (Edit these to reflect previous milestone, current, and next).

Beta Test Plan and Results Template

• Target Release Date:
• QA Contact: Anthony Hughes
• IRC: irc://irc.mozilla.org#qa juanb, ashughes, whimboo
• Builds: Firefox Milestone Builds | pushlog (example)

Tasks

We should complete the following tasks before signing off on the next weekly beta. We should be focusing on bug verifications and testing around fixes.

• [ON TRACK] Automation (Mozmill BFTs) - ashughes/whimboo: Link to section and result
• [ON TRACK] Bug Verifications - Waverley Team:
• [ON TRACK] Manual Testing - Waverley Team:
• [ON TRACK] Automation (Updates) - ashughes/whimboo:

Results

Problems Found

List any found issues or bugs here. Use [7b2] whiteboard entry to keep track (example)

Automation

Run automated BFTs and link reports from dashboard

• Reports: Litmus, Mozmill

Platform	General Tests	Restart Tests
Windows 2000	RESULT	RESULT
Windows XP	RESULT	RESULT
Windows Vista	RESULT	RESULT
Windows 7	RESULT	RESULT
Windows 7 64-bit	RESULT	RESULT
Mac OS X 10.6	RESULT	RESULT
Mac OS X 10.7	RESULT	RESULT
Ubuntu 10.10	RESULT	RESULT
Ubuntu 10.10 64-bit	RESULT (i686) RESULT (x86_64)	RESULT (i686) RESULT (x86_64)

Issues Found

• Any major issues?

Manual

Smoketests

Litmus Testrun: https://litmus.mozilla.org/run_tests.cgi?test_run_id=326

Platform	Name of tester	Results
Windows 2000	tester	bug 671535 - Ogv videos fail to play on Windows 2000
Windows XP	tester	RESULT
Windows Vista	tester	RESULT
Windows 7	tester	RESULT
Windows 7 64-bit	tester	RESULT
Mac OS X 10.6	tester	RESULT
Ubuntu 11.04	tester	RESULT
Ubuntu 11.04 64-bit	tester	RESULT
Mac OS X 10.7	tester	RESULT

Issues Found

• Any major issues?
  • n/a

Exploratory Testing Around Changes - On Applicable Platforms

• Change 1 - Signed Off?
• Change 2 - Signed Off?
• Etc...

Issues Found

• n/a

Updates

Target Build ID: Mozilla/5.0 (Windows NT 5.0; rv:6.0) Gecko/20100101 Firefox/6.0 (???)

Platform	Builds	Result
Betatest: report
Windows 2000	4.0b12 en-US/es-ES, 4.0 en-US/de, 5.0b7 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru	RESULT
Windows XP	4.0b9 en-US/es-ES, 4.0 en-US/ko, 5.0b2 en-US/fr, 5.0 en-US/it, 6.0b1 en-US/ru	RESULT
Windows Vista	4.0b8 en-US/es-ES, 4.0.1 en-US/it, 5.0b3 en-US/it, 5.0 en-US/zh-TW, 6.0b1 en-US/ru	RESULT
Windows 7	4.0b8 en-US/es-ES, 4.0.1 en-US/de, 5.0b1 en-US, 5.0 en-US/zh-TW, 6.0b1 en-US/ru	RESULT
Windows 7 64-bit	4.0b8 en-US/es-ES, 4.0 en-US/de, 5.0b6 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru	RESULT
Mac OS X 10.6	4.0b10 en-US/de, 4.0.1 en-US/ja-JP-mac, 5.0b3 en-US/ja-JP-mac, 5.0 en-US/zh-TW, 6.0b1 en-US/es-ES	RESULT
Mac OS X 10.7
Ubuntu 11.04	4.0b11 en-US/es-ES, 4.0.1 en-US/de, 5.0b5 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ko	RESULT
Ubuntu 11.04 64-bit	4.0b12 en-US/es-ES, 4.0 en-US/de, 5.0b7 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru	RESULT
Beta: report
Windows 2000	4.0b12 en-US/es-ES, 4.0 en-US/de, 5.0b7 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru	RESULT
Windows XP	4.0b9 en-US/es-ES, 4.0 en-US/ko, 5.0b2 en-US/fr, 5.0 en-US/it, 6.0b1 en-US/ru	RESULT
Windows Vista	4.0b8 en-US/es-ES, 4.0.1 en-US/it, 5.0b3 en-US/it, 5.0 en-US/zh-TW, 6.0b1 en-US/ru	RESULT
Windows 7	4.0b8 en-US/es-ES, 4.0.1 en-US/de, 5.0b1 en-US, 5.0 en-US/zh-TW, 6.0b1 en-US/ru	RESULT
Windows 7 64-bit	4.0b8 en-US/es-ES, 4.0 en-US/de, 5.0b6 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru	RESULT
Mac OS X 10.6	4.0b10 en-US/de, 4.0.1 en-US/ja-JP-mac, 5.0b3 en-US/ja-JP-mac, 5.0 en-US/zh-TW, 6.0b1 en-US/es-ES	RESULT
Mac OS X 10.7
Ubuntu 11.04	4.0b11 en-US/es-ES, 4.0.1 en-US/de, 5.0b5 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ko	RESULT
Ubuntu 11.04 64-bit	4.0b12 en-US/es-ES, 4.0 en-US/de, 5.0b7 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru	RESULT

Issues Found

• Any major issues?