QA/mozilla-beta/fx6/Beta 2: Difference between revisions
< QA | mozilla-beta/fx6
Jump to navigation
Jump to search
No edit summary |
|||
| Line 34: | Line 34: | ||
{| class="fullwidth-table" | {| class="fullwidth-table" | ||
| style="background:#EFEFEF; width:20%" | '''Platform''' | | style="background:#EFEFEF; width:20%" | '''Platform''' | ||
| style="background:#EFEFEF; width:25%" | '''General Tests''' | | style="background:#EFEFEF; width:25%" | '''General Tests''' | ||
| style="background:#EFEFEF; width:25%" | '''Restart Tests''' | | style="background:#EFEFEF; width:25%" | '''Restart Tests''' | ||
|- | |- | ||
| Windows 2000 | | Windows 2000 | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952de11e3 PASS] | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952de11e3 PASS] | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952de30b6 PASS] | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952de30b6 PASS] | ||
|- | |- | ||
| Windows XP | | Windows XP | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952dde81c PASS] (known random failure) | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952dde81c PASS] (known random failure) | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952ddfd5e PASS] | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952ddfd5e PASS] | ||
|- | |- | ||
| Windows Vista | | Windows Vista | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952de0593 PASS] | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952de0593 PASS] | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952de4b56 PASS] | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952de4b56 PASS] | ||
|- | |- | ||
| Windows 7 | | Windows 7 | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952ddd2cd PASS] (known failure) | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952ddd2cd PASS] (known failure) | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952ddfda1 PASS] | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952ddfda1 PASS] | ||
|- | |- | ||
| Windows 7 64-bit | | Windows 7 64-bit | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952ddef1c PASS] (known failure) | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952ddef1c PASS] (known failure) | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952de4349 PASS] | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952de4349 PASS] | ||
|- | |- | ||
| Mac OS X 10.6 | | Mac OS X 10.6 | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952ddfa66 PASS] (known failure) | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952ddfa66 PASS] (known failure) | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952de3fca PASS] | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952de3fca PASS] | ||
|- | |||
| Mac OS X 10.7 | |||
| [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952de66ec PASS] | |||
| [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952de6b63 PASS] | |||
|- | |- | ||
| Ubuntu 10.10 | | Ubuntu 10.10 | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952dde86a PASS] | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952dde86a PASS] | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952de2935 PASS] | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952de2935 PASS] | ||
|- | |- | ||
| Ubuntu 10.10 64-bit | | Ubuntu 10.10 64-bit | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952dddb52 PASS] (i686) (known failure)<br>[http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952de5856 PASS] (x86_64) | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952dddb52 PASS] (i686) (known failure)<br>[http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952de5856 PASS] (x86_64) | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952de194e PASS] (i686)<br>[http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952de5c7c PASS] (x86_64) | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952de194e PASS] (i686)<br>[http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952de5c7c PASS] (x86_64) | ||
|} | |} | ||
Revision as of 16:47, 14 July 2011
« mozilla-beta:fx6 | mozilla-beta:fx6:Beta 2 | mozilla-beta:fx6:Beta 3 »
Beta 2 Test Plan and Results
- Release: Thursday/Friday July 15th/16th
- QA Contact: Juan Becerra
- IRC: irc://irc.mozilla.org#qa juanb, ashughes, whimboo
- Builds: Firefox 6.0b2 | pushlog
Tasks
We should complete the following tasks before signing off on the next weekly beta. We should be focusing on bug verifications and testing around fixes.
- [DONE] Automation (Mozmill BFTs) - ashughes/whimboo: Signed Off
- [DONE] Bug Verifications - Waverley Team: Signed Off
- [DONE] Manual Testing - Waverley Team: Signed Off
- [ON TRACK] Automation (Updates) - ashughes/whimboo: result
- [ON TRACK] Crash Stats / Feedback / Web Content Sign Off - juanb, marcia: result
Spotchecks should be performed across all supported operating systems, including Mac OSX 10.7 which is close to shipping:
- Windows XP
- Windows 7 (32-bit & 64-bit)
- Windows Vista
- Mac OSX 10.6
- Ubuntu 10.10 (32-bit and 64-bit)
- Windows 2000
- Mac OSX 10.7
Results
Problems Found
List any found issues or bugs here. Use [6b2] whiteboard entry to keep track.
Automation
Run automated BFTs and link reports from dashboard
| Platform | General Tests | Restart Tests |
| Windows 2000 | PASS | PASS |
| Windows XP | PASS (known random failure) | PASS |
| Windows Vista | PASS | PASS |
| Windows 7 | PASS (known failure) | PASS |
| Windows 7 64-bit | PASS (known failure) | PASS |
| Mac OS X 10.6 | PASS (known failure) | PASS |
| Mac OS X 10.7 | PASS | PASS |
| Ubuntu 10.10 | PASS | PASS |
| Ubuntu 10.10 64-bit | PASS (i686) (known failure) PASS (x86_64) |
PASS (i686) PASS (x86_64) |
- Issues Found
- Any major issues?
Manual
- Smoketests
Litmus Testrun: https://litmus.mozilla.org/run_tests.cgi?test_run_id=321
| Platform | Name of tester | Results |
| Windows 2000 | SimonaB | bug 671535 - Ogv videos fail to play on Windows 2000 |
| Windows XP | SimonaB | PASS |
| Windows Vista | SimonaB | PASS |
| Windows 7 | Andrei | PASS |
| Windows 7 64-bit | Andrei | PASS |
| Mac OS X 10.6 | VladG | PASS |
| Ubuntu 11.04 | George | PASS |
| Ubuntu 11.04 64-bit | George | PASS |
| Mac OS X 10.7 | VladG | PASS |
- Issues Found
- Any major issues?
- bug 671535 - Ogv videos fail to play on Windows 2000
- BFTs
- WinXP
- Testers: Andrei, George, Simona, Vlad
- Results: PASS in Litmus with known issues
- Issues Found
- n/a
Updates
- Mozmill Results
| Platform | Betatest: report | Releasetest: [ report] | Beta: [ report] |
| Windows 2000 | en-US: result de: result es-ES: result ru: result |
en-US: result de: result es-ES: result ru: result |
en-US: result de: result es-ES: result ru: result |
| Windows XP | en-US: result es-ES: result fr: result ru: result |
en-US: result es-ES: result fr: result ru: result |
en-US: result es-ES: result fr: result ru: result |
| Windows Vista | en-US: result es-ES: result fr: result ru: result |
en-US: result es-ES: result fr: result ru: result |
en-US: result es-ES: result fr: result ru: result |
| Windows 7 | en-US: result de: result ru: result zh-TW: result |
en-US: result de: result ru: result zh-TW: result |
en-US: result de: result ru: result zh-TW: result |
| Windows 7 64-bit | en-US: result de: result ru: result zh-TW: result |
en-US: result de: result ru: result zh-TW: result |
en-US: result de: result ru: result zh-TW: result |
| Mac OS X 10.6 | en-US: result de: result fr: result |
en-US: result de: result fr: result |
en-US: result de: result fr: result |
| Ubuntu 10.10 | en-US: result de: result es-ES: result fr: result zh-TW: result |
en-US: result de: result es-ES: result fr: result zh-TW: result |
en-US: result de: result es-ES: result fr: result zh-TW: result |
| Ubuntu 10.10 64-bit | en-US: result de: result es-ES: result fr: result zh-TW: result |
en-US: result de: result es-ES: result fr: result zh-TW: result |
en-US: result de: result es-ES: result fr: result zh-TW: result |
| Mac OS X 10.7 | en-US: result de: result fr: result |
en-US: result de: result fr: result |
en-US: result de: result fr: result |
- Issues Found
- Any major issues?