QA/mozilla-beta/fx6/Beta 4

« mozilla-beta:fx6 | mozilla-beta:fx6:Beta 3 | mozilla-beta:fx6:Beta 4 | mozilla-beta:fx6:Beta 5 »

Beta 4 Test Plan and Results

• Release: Thursday/Friday July 28th/30th
• QA Contact: Juan Becerra
• IRC: irc://irc.mozilla.org#qa juanb, ashughes, whimboo
• Builds: Firefox 6.0b4 | pushlog

Tasks

We should complete the following tasks before signing off on the next weekly beta. We should be focusing on bug verifications and testing around fixes.

• [ON TRACK] Automation (Mozmill BFTs) - ashughes/whimboo: result
• [ON TRACK] Bug Verifications - Waverley Team: result
• [ON TRACK] Manual Testing - Waverley Team: result
• [ON TRACK] Automation (Updates) - ashughes/whimboo: result
• [ON TRACK] Crash Stats / Feedback / Web Content Sign Off - juanb, marcia: result

Spotchecks should be performed across all supported operating systems, including Mac OSX 10.7:

• Windows XP
• Windows 7 (32-bit & 64-bit)
• Windows Vista
• Mac OS X 10.6
• Mac OS X 10.7
• Ubuntu 11.04 (32-bit and 64-bit)
• Windows 2000

Results

Problems Found

List any found issues or bugs here. Use [6b4] whiteboard entry to keep track.

Automation

Run automated BFTs and link reports from dashboard

• Reports: Litmus, Mozmill

Platform	General Tests	Restart Tests
Windows 2000	RESULT	RESULT
Windows XP	RESULT	RESULT
Windows Vista	RESULT	RESULT
Windows 7	RESULT	RESULT
Windows 7 64-bit	RESULT	RESULT
Mac OS X 10.6	RESULT	RESULT
Mac OS X 10.7	RESULT	RESULT
Ubuntu 10.10	RESULT	RESULT
Ubuntu 10.10 64-bit	RESULT (i686) RESULT (x86_64)	RESULT (i686) RESULT (x86_64)

Issues Found

• Any major issues?

Manual

Smoketests

• Litmus Testrun: https://litmus.mozilla.org/run_tests.cgi?test_run_id=326
• Litmus Report: https://litmus.mozilla.org/test_run_report.cgi?test_run_id=326

Platform	Name of tester	Results
Windows 2000	Simona	PASS
Windows XP	Andrei	PASS
Windows Vista	Simona	PASS
Windows 7	Andrei	PASS
Windows 7 64-bit	Alin	PASS
Mac OS X 10.6	Vlad G	PASS
Ubuntu 11.04	George	PASS
Ubuntu 11.04 64-bit	George	PASS
Mac OS X 10.7	Vlad G	PASS

Issues Found

• Any major issues?
  • n/a

l10n spotchecking

• German
  • Name of tester: Alin
  • PASS
• French
  • Name of tester: Alin
  • PASS
• Spanish
  • Name of tester: Alin
  • PASS
• Italian
  • Name of tester: Alin
  • PASS
• Russian
  • Name of tester: Alin
  • PASS

Exploratory Testing Around Changes - On Applicable Platforms

• Change 1 - Signed Off?
• Change 2 - Signed Off?
• Etc...

Issues Found

• n/a

Updates

Target Build ID: Mozilla/5.0 (Windows NT 5.0; rv:6.0) Gecko/20100101 Firefox/6.0 (???)

Platform	Builds	Result
Betatest: report
Windows 2000	4.0b12 en-US/es-ES, 4.0 en-US/de, 5.0b7 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru	RESULT
Windows XP	4.0b9 en-US/es-ES, 4.0 en-US/ko, 5.0b2 en-US/fr, 5.0 en-US/it, 6.0b1 en-US/ru	RESULT
Windows Vista	4.0b8 en-US/es-ES, 4.0.1 en-US/it, 5.0b3 en-US/it, 5.0 en-US/zh-TW, 6.0b1 en-US/ru	RESULT
Windows 7	4.0b8 en-US/es-ES, 4.0.1 en-US/de, 5.0b1 en-US, 5.0 en-US/zh-TW, 6.0b1 en-US/ru	RESULT
Windows 7 64-bit	4.0b8 en-US/es-ES, 4.0 en-US/de, 5.0b6 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru	RESULT
Mac OS X 10.6	4.0b10 en-US/de, 4.0.1 en-US/ja-JP-mac, 5.0b3 en-US/ja-JP-mac, 5.0 en-US/zh-TW, 6.0b1 en-US/es-ES	RESULT
Mac OS X 10.7
Ubuntu 11.04	4.0b11 en-US/es-ES, 4.0.1 en-US/de, 5.0b5 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ko	RESULT
Ubuntu 11.04 64-bit	4.0b12 en-US/es-ES, 4.0 en-US/de, 5.0b7 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru	RESULT
Beta: report
Windows 2000	4.0b12 en-US/es-ES, 4.0 en-US/de, 5.0b7 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru	RESULT
Windows XP	4.0b9 en-US/es-ES, 4.0 en-US/ko, 5.0b2 en-US/fr, 5.0 en-US/it, 6.0b1 en-US/ru	RESULT
Windows Vista	4.0b8 en-US/es-ES, 4.0.1 en-US/it, 5.0b3 en-US/it, 5.0 en-US/zh-TW, 6.0b1 en-US/ru	RESULT
Windows 7	4.0b8 en-US/es-ES, 4.0.1 en-US/de, 5.0b1 en-US, 5.0 en-US/zh-TW, 6.0b1 en-US/ru	RESULT
Windows 7 64-bit	4.0b8 en-US/es-ES, 4.0 en-US/de, 5.0b6 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru	RESULT
Mac OS X 10.6	4.0b10 en-US/de, 4.0.1 en-US/ja-JP-mac, 5.0b3 en-US/ja-JP-mac, 5.0 en-US/zh-TW, 6.0b1 en-US/es-ES	RESULT
Mac OS X 10.7
Ubuntu 11.04	4.0b11 en-US/es-ES, 4.0.1 en-US/de, 5.0b5 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ko	RESULT
Ubuntu 11.04 64-bit	4.0b12 en-US/es-ES, 4.0 en-US/de, 5.0b7 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru	RESULT

Issues Found

• Any major issues?