QA/mozilla-beta/fx6/Beta 2: Difference between revisions
< QA | mozilla-beta/fx6
Jump to navigation
Jump to search
(→Tasks) |
|||
| (2 intermediate revisions by 2 users not shown) | |||
| Line 13: | Line 13: | ||
* {{done|}} [https://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=0d82a53ffaa6&tochange=ea7034005498 Bug Verifications] - Waverley Team: [http://bit.ly/qr7afL '''Signed Off'''] | * {{done|}} [https://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=0d82a53ffaa6&tochange=ea7034005498 Bug Verifications] - Waverley Team: [http://bit.ly/qr7afL '''Signed Off'''] | ||
* {{done|}} Manual Testing - Waverley Team: [[QA/mozilla-beta/fx6/Beta_2/Manual_Testing|'''Signed Off''']] | * {{done|}} Manual Testing - Waverley Team: [[QA/mozilla-beta/fx6/Beta_2/Manual_Testing|'''Signed Off''']] | ||
* {{ | * {{done|}} Automation (Updates) - ashughes/whimboo: [[QA/mozilla-beta/fx6/Beta_2#Updates|'''Signed Off''']] | ||
* {{ | * {{done|}} Crash Stats / Feedback / Web Content Sign Off - juanb, marcia: '''Signed Off''' | ||
Spotchecks should be performed across all supported operating systems, including Mac OSX 10.7 which is close to shipping: | Spotchecks should be performed across all supported operating systems, including Mac OSX 10.7 which is close to shipping: | ||
| Line 137: | Line 137: | ||
=== Updates === | === Updates === | ||
'''Target Build ID:''' Mozilla/5.0 (Windows NT 5.0; rv:6.0) Gecko/20100101 Firefox/6.0 (20110713171652) | |||
{| class="fullwidth-table" | {| class="fullwidth-table" | ||
| style="background:#EFEFEF; width:15%" | '''Platform''' | | style="background:#EFEFEF; width:15%" | '''Platform''' | ||
| style="background:#EFEFEF; width:75%" | ''' | | style="background:#EFEFEF; width:75%" | '''Builds''' | ||
| style="background:#EFEFEF; width:10%" | '''Result''' | | style="background:#EFEFEF; width:10%" | '''Result''' | ||
|- | |- | ||
| Line 145: | Line 147: | ||
|- | |- | ||
| Windows 2000 | | Windows 2000 | ||
| 4.0b12 en-US/es-ES, 4.0 en-US/de, 5.0b7 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru | |||
| '''PASS''' | |||
|- | |||
| Windows XP | |||
| 4.0b9 en-US/es-ES, 4.0 en-US/ko, 5.0b2 en-US/fr, 5.0 en-US/it, 6.0b1 en-US/ru | |||
| '''PASS''' | |||
|- | |||
| Windows Vista | |||
| 4.0b8 en-US/es-ES, 4.0.1 en-US/it, 5.0b3 en-US/it, 5.0 en-US/zh-TW, 6.0b1 en-US/ru | |||
| '''PASS''' | |||
|- | |||
| Windows 7 | |||
| 4.0b8 en-US/es-ES, 4.0.1 en-US/de, 5.0b1 en-US, 5.0 en-US/zh-TW, 6.0b1 en-US/ru | |||
| '''PASS''' | |||
|- | |||
| Windows 7 64-bit | |||
| 4.0b8 en-US/es-ES, 4.0 en-US/de, 5.0b6 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru | |||
| '''PASS''' | |||
|- | |||
| Mac OS X 10.6 | |||
| 4.0b10 en-US/de, 4.0.1 en-US/ja-JP-mac, 5.0b3 en-US/ja-JP-mac, 5.0 en-US/zh-TW, 6.0b1 en-US/es-ES | |||
| '''PASS''' | |||
|- | |||
| Mac OS X 10.7 | |||
| | | | ||
| | | | ||
|- | |||
| Ubuntu 11.04 | |||
| 4.0b11 en-US/es-ES, 4.0.1 en-US/de, 5.0b5 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ko | |||
| '''PASS''' | |||
|- | |||
| Ubuntu 11.04 64-bit | |||
| 4.0b12 en-US/es-ES, 4.0 en-US/de, 5.0b7 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru | |||
| '''PASS''' | |||
|- | |||
| colspan="4" | '''Beta''': [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=6.0&channel=beta&from=2011-07-15&to=2011-07-15&target=6.0 report] | |||
|- | |||
| Windows 2000 | |||
| 4.0b12 en-US/es-ES, 4.0 en-US/de, 5.0b7 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru | |||
| '''PASS''' | |||
|- | |- | ||
| Windows XP | | Windows XP | ||
| | | 4.0b9 en-US/es-ES, 4.0 en-US/ko, 5.0b2 en-US/fr, 5.0 en-US/it, 6.0b1 en-US/ru | ||
| | | '''PASS''' | ||
|- | |- | ||
| Windows Vista | | Windows Vista | ||
| | | 4.0b8 en-US/es-ES, 4.0.1 en-US/it, 5.0b3 en-US/it, 5.0 en-US/zh-TW, 6.0b1 en-US/ru | ||
| | | '''PASS''' | ||
|- | |- | ||
| Windows 7 | | Windows 7 | ||
| | | 4.0b8 en-US/es-ES, 4.0.1 en-US/de, 5.0b1 en-US, 5.0 en-US/zh-TW, 6.0b1 en-US/ru | ||
| | | '''PASS''' | ||
|- | |- | ||
| Windows 7 64-bit | | Windows 7 64-bit | ||
| | | 4.0b8 en-US/es-ES, 4.0 en-US/de, 5.0b6 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru | ||
| | | '''PASS''' | ||
|- | |- | ||
| Mac OS X 10.6 | | Mac OS X 10.6 | ||
| | | 4.0b10 en-US/de, 4.0.1 en-US/ja-JP-mac, 5.0b3 en-US/ja-JP-mac, 5.0 en-US/zh-TW, 6.0b1 en-US/es-ES | ||
| | | '''PASS''' | ||
|- | |- | ||
| Mac OS X 10.7 | | Mac OS X 10.7 | ||
| Line 173: | Line 213: | ||
|- | |- | ||
| Ubuntu 11.04 | | Ubuntu 11.04 | ||
| | | 4.0b11 en-US/es-ES, 4.0.1 en-US/de, 5.0b5 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ko | ||
| | | '''PASS''' | ||
|- | |- | ||
| Ubuntu 11.04 64-bit | | Ubuntu 11.04 64-bit | ||
| | | 4.0b12 en-US/es-ES, 4.0 en-US/de, 5.0b7 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru | ||
| | | '''PASS''' | ||
|- | |||
|} | |} | ||
; Issues Found | ; Issues Found | ||
* Any major issues? | * Any major issues? | ||
Latest revision as of 22:21, 15 July 2011
« mozilla-beta:fx6 | mozilla-beta:fx6:Beta 2 | mozilla-beta:fx6:Beta 3 »
Beta 2 Test Plan and Results
- Release: Thursday/Friday July 15th/16th
- QA Contact: Juan Becerra
- IRC: irc://irc.mozilla.org#qa juanb, ashughes, whimboo
- Builds: Firefox 6.0b2 | pushlog
Tasks
We should complete the following tasks before signing off on the next weekly beta. We should be focusing on bug verifications and testing around fixes.
- [DONE] Automation (Mozmill BFTs) - ashughes/whimboo: Signed Off
- [DONE] Bug Verifications - Waverley Team: Signed Off
- [DONE] Manual Testing - Waverley Team: Signed Off
- [DONE] Automation (Updates) - ashughes/whimboo: Signed Off
- [DONE] Crash Stats / Feedback / Web Content Sign Off - juanb, marcia: Signed Off
Spotchecks should be performed across all supported operating systems, including Mac OSX 10.7 which is close to shipping:
- Windows XP
- Windows 7 (32-bit & 64-bit)
- Windows Vista
- Mac OSX 10.6
- Ubuntu 10.10 (32-bit and 64-bit)
- Windows 2000
- Mac OSX 10.7
Results
Problems Found
List any found issues or bugs here. Use [6b2] whiteboard entry to keep track.
Automation
Run automated BFTs and link reports from dashboard
| Platform | General Tests | Restart Tests |
| Windows 2000 | PASS | PASS |
| Windows XP | PASS (known random failure) | PASS |
| Windows Vista | PASS | PASS |
| Windows 7 | PASS (known failure) | PASS |
| Windows 7 64-bit | PASS (known failure) | PASS |
| Mac OS X 10.6 | PASS (known failure) | PASS |
| Mac OS X 10.7 | PASS | PASS |
| Ubuntu 10.10 | PASS | PASS |
| Ubuntu 10.10 64-bit | PASS (i686) (known failure) PASS (x86_64) |
PASS (i686) PASS (x86_64) |
- Issues Found
- Any major issues?
Manual
- Smoketests
Litmus Testrun: https://litmus.mozilla.org/run_tests.cgi?test_run_id=321
| Platform | Name of tester | Results |
| Windows 2000 | SimonaB | bug 671535 - Ogv videos fail to play on Windows 2000 |
| Windows XP | SimonaB | PASS |
| Windows Vista | SimonaB | PASS |
| Windows 7 | Andrei | PASS |
| Windows 7 64-bit | Andrei | PASS |
| Mac OS X 10.6 | VladG | PASS |
| Ubuntu 11.04 | George | PASS |
| Ubuntu 11.04 64-bit | George | PASS |
| Mac OS X 10.7 | VladG | PASS |
- Issues Found
- Any major issues?
- bug 671535 - Ogv videos fail to play on Windows 2000
- BFTs
- WinXP
- Testers: Andrei, George, Simona, Vlad
- Results: PASS in Litmus with known issues
- Issues Found
- n/a
Updates
Target Build ID: Mozilla/5.0 (Windows NT 5.0; rv:6.0) Gecko/20100101 Firefox/6.0 (20110713171652)
| Platform | Builds | Result | |
| Betatest: report | |||
| Windows 2000 | 4.0b12 en-US/es-ES, 4.0 en-US/de, 5.0b7 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru | PASS | |
| Windows XP | 4.0b9 en-US/es-ES, 4.0 en-US/ko, 5.0b2 en-US/fr, 5.0 en-US/it, 6.0b1 en-US/ru | PASS | |
| Windows Vista | 4.0b8 en-US/es-ES, 4.0.1 en-US/it, 5.0b3 en-US/it, 5.0 en-US/zh-TW, 6.0b1 en-US/ru | PASS | |
| Windows 7 | 4.0b8 en-US/es-ES, 4.0.1 en-US/de, 5.0b1 en-US, 5.0 en-US/zh-TW, 6.0b1 en-US/ru | PASS | |
| Windows 7 64-bit | 4.0b8 en-US/es-ES, 4.0 en-US/de, 5.0b6 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru | PASS | |
| Mac OS X 10.6 | 4.0b10 en-US/de, 4.0.1 en-US/ja-JP-mac, 5.0b3 en-US/ja-JP-mac, 5.0 en-US/zh-TW, 6.0b1 en-US/es-ES | PASS | |
| Mac OS X 10.7 | |||
| Ubuntu 11.04 | 4.0b11 en-US/es-ES, 4.0.1 en-US/de, 5.0b5 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ko | PASS | |
| Ubuntu 11.04 64-bit | 4.0b12 en-US/es-ES, 4.0 en-US/de, 5.0b7 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru | PASS | |
| Beta: report | |||
| Windows 2000 | 4.0b12 en-US/es-ES, 4.0 en-US/de, 5.0b7 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru | PASS | |
| Windows XP | 4.0b9 en-US/es-ES, 4.0 en-US/ko, 5.0b2 en-US/fr, 5.0 en-US/it, 6.0b1 en-US/ru | PASS | |
| Windows Vista | 4.0b8 en-US/es-ES, 4.0.1 en-US/it, 5.0b3 en-US/it, 5.0 en-US/zh-TW, 6.0b1 en-US/ru | PASS | |
| Windows 7 | 4.0b8 en-US/es-ES, 4.0.1 en-US/de, 5.0b1 en-US, 5.0 en-US/zh-TW, 6.0b1 en-US/ru | PASS | |
| Windows 7 64-bit | 4.0b8 en-US/es-ES, 4.0 en-US/de, 5.0b6 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru | PASS | |
| Mac OS X 10.6 | 4.0b10 en-US/de, 4.0.1 en-US/ja-JP-mac, 5.0b3 en-US/ja-JP-mac, 5.0 en-US/zh-TW, 6.0b1 en-US/es-ES | PASS | |
| Mac OS X 10.7 | |||
| Ubuntu 11.04 | 4.0b11 en-US/es-ES, 4.0.1 en-US/de, 5.0b5 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ko | PASS | |
| Ubuntu 11.04 64-bit | 4.0b12 en-US/es-ES, 4.0 en-US/de, 5.0b7 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru | PASS | |
- Issues Found
- Any major issues?