Releases/Firefox 6/Test Plan: Difference between revisions
< Releases
Jump to navigation
Jump to search
(→Manual) |
|||
| Line 25: | Line 25: | ||
=== Automation === | === Automation === | ||
The following are the detailed results of the automated BFT test runs. | The following are the detailed results of the automated BFT test runs. | ||
* {{|}} Windows 2000: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f9797bd normal] | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f97aecf restart] | * {{done|}} Windows 2000: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f9797bd normal] | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f97aecf restart] | ||
* {{|}} Windows XP: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f9de820 normal] | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f9de8c3 restart] | * {{done|}} Windows XP: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f9de820 normal] | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f9de8c3 restart] | ||
* {{|}} Windows Vista: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f97a259 normal] | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f97bac9 restart] | * {{done|}} Windows Vista: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f97a259 normal] | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f97bac9 restart] | ||
* {{|}} Windows 7: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f976f64 normal] | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f9778ce restart] | * {{done|}} Windows 7: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f976f64 normal] | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f9778ce restart] | ||
* {{|}} Windows 7 64-bit: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f97786f normal] | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f978743 restart] | * {{done|}} Windows 7 64-bit: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f97786f normal] | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f978743 restart] | ||
* {{|}} Mac OS X 10.6: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f97a565 normal] | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f97beb0 restart] | * {{done|}} Mac OS X 10.6: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f97a565 normal] | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f97beb0 restart] | ||
* {{|}} Mac OS X 10.7: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f97cbf3 normal] | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f97d82a restart] | * {{done|}} Mac OS X 10.7: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f97cbf3 normal] | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f97d82a restart] | ||
* {{|}} Ubuntu 11.04: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f9e7bd8 normal] | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f9e8b96 restart] | * {{done|}} Ubuntu 11.04: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f9e7bd8 normal] | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f9e8b96 restart] | ||
* {{|}} Ubuntu 11.04 64-bit (x86): [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f9e7392 normal] | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f9e8030 restart] | * {{done|}} Ubuntu 11.04 64-bit (x86): [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f9e7392 normal] | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f9e8030 restart] | ||
* {{|}} Ubuntu 11.04 64-bit (x64): [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f9ea428 normal] | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f9eae1d restart] | * {{done|}} Ubuntu 11.04 64-bit (x64): [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f9ea428 normal] | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f9eae1d restart] | ||
* '''Litmus''': Sync results to [https://litmus.mozilla.org/run_tests.cgi?test_run_id=331 here] | * '''Litmus''': Sync results to [https://litmus.mozilla.org/run_tests.cgi?test_run_id=331 here] | ||
* '''Mozmill''': [http://mozmill-release.brasstacks.mozilla.com/#/functional/reports?branch=6.0&platform=All&from=2011-08-12&to=2011-08-12 results] | * '''Mozmill''': [http://mozmill-release.brasstacks.mozilla.com/#/functional/reports?branch=6.0&platform=All&from=2011-08-12&to=2011-08-12 results] | ||
Revision as of 14:17, 12 August 2011
« mozilla-beta:fx6 | Firefox 6 | Firefox 7 »
Firefox 6 Test Plan
- Release: Tuesday, August 16, 2011
- QA Contact:
Juan BecerraAnthony Hughes - IRC: irc://irc.mozilla.org#qa (juanb, ashughes, whimboo)
- Builds: Firefox 6.0
Tasks
The following tasks need to be completed to sign-off the release.
- {{|}} [ashughes] Automated BFTs: details
- {{|}} [softvision] Manual Testing: details
- {{|}} [softvision] Feature sign-off: details
- {{|}} [softvision] Bug Verifications: details
- {{|}} [ashughes] Automated Updates: details
- Docs: timeline, softvision testplan
Spotchecks should be performed across all supported operating systems, including Mac OSX 10.7:
- Windows 2000, XP, Vista, 7, 7 64bit
- Mac OS X 10.5, 10.6, 10.7
- Ubuntu 11.04, 11.04 64-bit
If you find any issues use [fx6] whiteboard entry of the bug to keep track.
Automation
The following are the detailed results of the automated BFT test runs.
- [DONE] Windows 2000: normal | restart
- [DONE] Windows XP: normal | restart
- [DONE] Windows Vista: normal | restart
- [DONE] Windows 7: normal | restart
- [DONE] Windows 7 64-bit: normal | restart
- [DONE] Mac OS X 10.6: normal | restart
- [DONE] Mac OS X 10.7: normal | restart
- [DONE] Ubuntu 11.04: normal | restart
- [DONE] Ubuntu 11.04 64-bit (x86): normal | restart
- [DONE] Ubuntu 11.04 64-bit (x64): normal | restart
- Litmus: Sync results to here
- Mozmill: results
- Issues Found
Manual
The following are the detailed results of the manual smoketests.
- [DONE] [Alin] Windows 2000: PASS
- [DONE] [Mihaela] Windows XP: PASS
- [DONE] [Simona] Windows Vista: PASS
- [DONE] [Simona] Windows 7: PASS
- [DONE] [AndreiD] Windows 7 64-bit: PASS
- [DONE] [VladG] Mac OS X 10.6: PASS
- [DONE] [VladG] Mac OS X 10.7: PASS
- [DONE] [Virgil] Ubuntu 11.04: PASS
- [DONE] [AndreiD] Ubuntu 11.04 32-bit: PASS
- Litmus testrun, report
- Firefox 6 builds
- Issues Found
- Exploratory Testing
- Conduct exploratory tests on WebGL, Javascript, Flash, and QuickTime plugin content
- Tested plugin content using the following testing matrix: testing matrix
- {{|}} [tester] Windows XP: status
- {{|}} [tester] Windows 7: status
- {{|}} [VladG] Mac OS X 10.6: status
- {{|}} [tester] Ubuntu 11.04: status
- Issues Found
- Bug 638741 - Right click on flash content displays two context menus sometimes
- Bug Bug 638770 - clicking on a quicktime video pauses it
- Bug Bug 678482 - Scrolling in web pages with java and shockwave scrambles the content
- Bug Bug 607586 - Realplayer Plugin does not work
Feature sign-off
The following are the details about spotchecks performed on landed features
- [DONE] [andreid] 50ms Assert: OK for release
- {{|}} [whimboo] PlugincheckLinkInAOM: status
- [DONE] [tracy] Sync Discoverability: SIGN-OFF
- [DONE] [george] Persist Panorama Groups: SIGN-OFF
- [DONE] [george] Panorama Groups On Demand: SIGN-OFF
- [DONE] [george] Site-based data management UI: SIGN-OFF
- [DONE] [george] windows-scrolling: SIGN-OFF
- [DONE] [simona] Locationbar Domain Highlight: SIGN-OFF
- [DONE] [simona] WebDeveloper Menu: SIGN-OFF
- [DONE] [vladg] RevampAboutMemory: SIGN-OFF
- [DONE] [vladg] Progress Element: SIGN-OFF
- {{|}} [vladmaniac] Autocomplete Popup: status
- {{|}} [vladmaniac] WebConsoleUpgrade: status
- [DONE] [alex] Scratchpad: SIGN-OFF
- Issues Found
Bug Verifications
The following are the detailed results of bug fix verifications for Firefox 6.
- Bugzilla: tracking-firefox6+
- Results: VERIFIED, REOPENED
- Issues Found
- [DONE] bug 677510 - Video Controls buttons "Mute/unmute" and "Expand/Shrink" are lacking icons on HTML5 videos
- Issue has been fixed on YouTube's end
- [DONE] bug 677095 - 1px background-image miss-handling when position is fixed
- Issue will be rel-noted and fixed in Firefox 7
- bug 675260 - Crash in arena_dalloc_small coming from ShutdownNSS
- Not a priority for Firefox 6 -- If you have free cycles, we need help identifying builds affected and steps to reproduce
Updates
The following are details of update verifications for Firefox 6
- Coverage
- Platforms: Windows (2000, XP, Vista, 7, 7 64-bit), Mac OS X (10.6, 10.7), Ubuntu (11.04, 11.04 64-bit)
- Updates: partial, complete, fallback
- Locales: en-US, random
- Versions: Firefox 4*, 5*, 6b*
- Target Build:
- Results
Betatest: report
- {{|}} Windows XP: status
- {{|}} Windows Vista: status
- {{|}} Windows 7: status
- {{|}} Windows 7 64-bit: status
- {{|}} Mac OS X 10.6: status
- {{|}} Mac OS X 10.7: status
- {{|}} Ubuntu 11.04: status
- {{|}} Ubuntu 11.04 64-bit: status
Beta: report
- {{|}} Windows XP: status
- {{|}} Windows Vista: status
- {{|}} Windows 7: status
- {{|}} Windows 7 64-bit: status
- {{|}} Mac OS X 10.6: status
- {{|}} Mac OS X 10.7: status
- {{|}} Ubuntu 11.04: status
- {{|}} Ubuntu 11.04 64-bit: status
Releasetest: report
- {{|}} Windows XP: status
- {{|}} Windows Vista: status
- {{|}} Windows 7: status
- {{|}} Windows 7 64-bit: status
- {{|}} Mac OS X 10.6: status
- {{|}} Mac OS X 10.7: status
- {{|}} Ubuntu 11.04: status
- {{|}} Ubuntu 11.04 64-bit: status
Release: report
- {{|}} Windows XP: status
- {{|}} Windows Vista: status
- {{|}} Windows 7: status
- {{|}} Windows 7 64-bit: status
- {{|}} Mac OS X 10.6: status
- {{|}} Mac OS X 10.7: status
- {{|}} Ubuntu 11.04: status
- {{|}} Ubuntu 11.04 64-bit: status
- Issues Found