Releases/Firefox 6/Test Plan
< Releases
Firefox 6 Test Plan
- Release: Tuesday, August 16, 2011
- QA Contact:
Juan BecerraAnthony Hughes - IRC: irc://irc.mozilla.org#qa (juanb, ashughes, whimboo)
- Builds: Firefox 6.0
Tasks
The following tasks need to be completed to sign-off the release.
- {{|}} [ashughes] Automated BFTs: details
- {{|}} [softvision] Manual Testing: details
- {{|}} [softvision] Feature sign-off: details
- {{|}} [softvision] Bug Verifications: details
- {{|}} [ashughes] Automated Updates: details
- Docs: timeline, softvision testplan
Spotchecks should be performed across all supported operating systems, including Mac OSX 10.7:
- Windows 2000, XP, Vista, 7, 7 64bit
- Mac OS X 10.5, 10.6, 10.7
- Ubuntu 11.04, 11.04 64-bit
If you find any issues use [fx6] whiteboard entry of the bug to keep track.
Automation
The following are the detailed results of the automated BFT test runs.
- {{|}} Windows 2000: [ http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f9797bd normal] | [ http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f97aecf restart]
- {{|}} Windows XP: [ http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f9de820 normal] | [ http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f9de8c3 restart]
- {{|}} Windows Vista: [ http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f97a259 normal] | [ http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f97bac9 restart]
- {{|}} Windows 7: [ http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f976f64 normal] | [ http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f9778ce restart]
- {{|}} Windows 7 64-bit: [ http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f97786f normal] | [ http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f978743 restart]
- {{|}} Mac OS X 10.6: [ http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f97a565 normal] | [ http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f97beb0 restart]
- {{|}} Mac OS X 10.7: [ http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f97cbf3 normal] | [ http://mozmill-release.brasstacks.mozilla.com/#/functional/report/1aa1a55cbadc6f0e705647266f97d82a restart]
- {{|}} Ubuntu 11.04: normal | restart
- {{|}} Ubuntu 11.04 64-bit (x86): normal | restart
- {{|}} Ubuntu 11.04 64-bit (x64): normal | restart
- Litmus: Sync results to here
- Mozmill: [ ]
- Issues Found
Manual
The following are the detailed results of the manual smoketests.
- {{|}} [tester] Windows 2000: status
- {{|}} [tester] Windows XP: status
- {{|}} [tester] Windows Vista: status
- {{|}} [tester] Windows 7: status
- {{|}} [tester] Windows 7 64-bit: status
- {{|}} [VladG] Mac OS X 10.6: PASS
- {{|}} [VladG] Mac OS X 10.7: PASS
- {{|}} [tester] Ubuntu 11.04: status
- {{|}} [tester] Ubuntu 11.04 32-bit: status
- Litmus testrun, report
- Firefox 6 builds
- Issues Found
- Exploratory Testing
Conduct exploratory tests on WebGL, Javascript, Flash, and QuickTime plugin content
- {{|}} [tester] Windows XP: status
- {{|}} [tester] Windows 7: status
- {{|}} [tester] Mac OS X 10.6: status
- {{|}} [tester] Ubuntu 11.04: status
- Issues Found
Feature sign-off
The following are the details about spotchecks performed on landed features
- {{|}} [andreid] 50ms Assert: status
- {{|}} [whimboo] PlugincheckLinkInAOM: status
- {{|}} [tracy] Sync Discoverability: status
- {{|}} [george] Persist Panorama Groups: status
- {{|}} [george] Panorama Groups On Demand: status
- {{|}} [george] Site-based data management UI: status
- {{|}} [george] windows-scrolling: status
- {{|}} [simona] Locationbar Domain Highlight: status
- {{|}} [simona] WebDeveloper Menu: status
- {{|}} [vladg] RevampAboutMemory: PASS
- {{|}} [vladg] Progress Element: PASS
- {{|}} [vladmaniac] Autocomplete Popup: status
- {{|}} [vladmaniac] WebConsoleUpgrade: status
- {{|}} [alex] Scratchpad: status
- Issues Found
Bug Verifications
The following are the detailed results of bug fix verifications for Firefox 6.
- Bugzilla: tracking-firefox6+
- Results: VERIFIED, REOPENED
- Issues Found
- [DONE] bug 677510 - Video Controls buttons "Mute/unmute" and "Expand/Shrink" are lacking icons on HTML5 videos
- Issue has been fixed on YouTube's end
- [DONE] bug 677095 - 1px background-image miss-handling when position is fixed
- Issue will be rel-noted and fixed in Firefox 7
- bug 675260 - Crash in arena_dalloc_small coming from ShutdownNSS
- Not a priority for Firefox 6 -- If you have free cycles, we need help identifying builds affected and steps to reproduce
Updates
The following are details of update verifications for Firefox 6
- Coverage
- Platforms: Windows (2000, XP, Vista, 7, 7 64-bit), Mac OS X (10.6, 10.7), Ubuntu (11.04, 11.04 64-bit)
- Updates: partial, complete, fallback
- Locales: en-US, random
- Versions: Firefox 4*, 5*, 6b*
- Target Build:
- Results
Betatest: report
- {{|}} Windows XP: status
- {{|}} Windows Vista: status
- {{|}} Windows 7: status
- {{|}} Windows 7 64-bit: status
- {{|}} Mac OS X 10.6: status
- {{|}} Mac OS X 10.7: status
- {{|}} Ubuntu 11.04: status
- {{|}} Ubuntu 11.04 64-bit: status
Beta: report
- {{|}} Windows XP: status
- {{|}} Windows Vista: status
- {{|}} Windows 7: status
- {{|}} Windows 7 64-bit: status
- {{|}} Mac OS X 10.6: status
- {{|}} Mac OS X 10.7: status
- {{|}} Ubuntu 11.04: status
- {{|}} Ubuntu 11.04 64-bit: status
Releasetest: report
- {{|}} Windows XP: status
- {{|}} Windows Vista: status
- {{|}} Windows 7: status
- {{|}} Windows 7 64-bit: status
- {{|}} Mac OS X 10.6: status
- {{|}} Mac OS X 10.7: status
- {{|}} Ubuntu 11.04: status
- {{|}} Ubuntu 11.04 64-bit: status
Release: report
- {{|}} Windows XP: status
- {{|}} Windows Vista: status
- {{|}} Windows 7: status
- {{|}} Windows 7 64-bit: status
- {{|}} Mac OS X 10.6: status
- {{|}} Mac OS X 10.7: status
- {{|}} Ubuntu 11.04: status
- {{|}} Ubuntu 11.04 64-bit: status
- Issues Found