Releases/Firefox 8/Test Plan: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(60 intermediate revisions by 10 users not shown)
Line 1: Line 1:
<small>[[Releases/Firefox_7/Test_Plan|« Firefox 7]] | [[Releases/Firefox_8/Test_Plan|Firefox 8]] | [[Releases/Firefox_9/Test_Plan|Firefox 9 »]] </small>  
<small>[[Releases/Firefox 7/Test Plan|« Firefox 7]] | [[Releases/Firefox_8/Test_Plan|Firefox 8]] | [[Releases/Firefox 9/Test Plan|Firefox 9 »]] </small>  
 
= Firefox 8 Test Plan  =
 
== Summary  ==


= Firefox 8 Test Plan =
== Summary ==
{| class="fullwidth-table"
{| class="fullwidth-table"
|-
|-
| style="width:15%" | '''Milestone'''
| style="width:15%" | '''Milestone'''  
| [https://wiki.mozilla.org/Firefox/Flight_Tracking#Firefox_8 Firefox 8]
| [https://wiki.mozilla.org/Firefox/Flight_Tracking#Firefox_8 Firefox 8]
|-
|-
| '''Status'''
| '''Status'''  
| Currently in '''Beta''' -- Releasing on November 8th, 2011
| Currently in '''Beta''' -- Releasing on November 8th, 2011
|-
|-
| '''Lead'''
| '''Lead'''  
| [mailto:jbecerra@mozilla.com Juan Becerra] (irc: juanb)
| [mailto:jbecerra@mozilla.com Juan Becerra] (irc: juanb)
|-
|-
| '''2nd'''
| '''2nd'''  
| [mailto:ahughes@mozilla.com Anthony Hughes] (irc: ashughes)
| [mailto:ahughes@mozilla.com Anthony Hughes] (irc: ashughes)
  |}
|}
 
'''Latest Build: [ftp://ftp.mozilla.org/pub/firefox/nightly/latest-mozilla-beta/ ftp], [http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/latest-mozilla-beta/ http], [http://www.mozilla.com/en-US/firefox/channel/ web]'''
 
The following is the test plan for Firefox 8 from Nightly through to Release. Use this document as a reference for what is being tested to validate the quality of Firefox 8. After the release this document will be used as an archive of what was done to validate this release.
 
''If you have some free time, please pick a task below and get in touch with one of the leads.''
 
== Details ==
 
The following is a description of the tasks which need to be completed throughout this release.
 
;Daily Tasks
 
*{{ok|}} [softvision] [[#Automation|Automation]]: Check dashboards for new failures
*{{ok|}} [softvision] [[#Bug_Triage|Bug Triage]]: Check Bugzilla for regressions
*{{ok|}} [softvision] [[#Features|Features]]: Test features and triage feature bugs targeted for this releases
*{{ok|}} [softvision] [[#Input|Input]]: Triage Input.MO for prevalent issues and feature requests
 
;One-time-only Tasks
 
*{{done|}} [juanb] [[#Nightly_Merge|Nightly Merge]]: Sign-off initial merge to Nightly
*{{ok|}} [ashughes] [[#Aurora_Merge|Aurora Merge]]: Sign-off merge from Nightly to Aurora
*{{ok|}} [iBeta] [[#Full_Functional_Tests|Full Functional Tests]]: Run the full suite of full functional tests on Aurora
*{{ok|}} [uTest] [[#Website_Compatibility|Website Compatibility]]: Run suite of Aurora website compatibility tests
*{{ok|}} [ashughes] [[#Beta_Merge|Beta Merge]]: Sign-off merge from Aurora to Beta
*{{ok|}} [uTest] [[#Website_Compatibility|Website Compatibility]]: Run suite of Beta website compatibility tests
*{{ok|}} [ashughes] [[#Release|Release]]: Sign-off final release
 
== Automation  ==
 
=== BFTs  ===
 
Triage the [http://mozmill-release.brasstacks.mozilla.com/#/functional/top?branch=8.0&platform=All Mozmill dashboard] for test failures and debug for potential Firefox regressions.
 
*'''Lead''': [mailto:vlad.maniac@softvision.ro Vlad Maniac] (Softvision)
*'''Peer''': [mailto:alex.lakatos@softvision.ro Alex Lakatos] (Softvision)
*'''Failure Status''': [http://bit.ly/q7Vm95 NEW] (12) | [http://bit.ly/oTmHo2 ASSIGNED] (7) | [http://bit.ly/q1sH6a FIXED] (3) | REGRESSIONS (0)
*'''Tasks''':
**Check the [http://mozmill-release.brasstacks.mozilla.com/#/functional/reports?branch=7.0&platform=All Mozmill dashboard] for failing tests for the day
**Cross reference any failure to the list of [http://bit.ly/q7Vm95 NEW] and [http://bit.ly/oTmHo2 ASSIGNED] bugs
***If the bug is NEW, assign it to yourself and try to fix it
***If the bug is ASSIGNED and there has been no activity on the bug in over a week, offer your assistance to fix the bug
***If there is NO bug on file, file it using [https://bugzilla.mozilla.org/enter_bug.cgi?alias=&assigned_to=nobody%40mozilla.org&blocked=&bug_file_loc=&bug_severity=normal&bug_status=NEW&comment=-----%20INSTRUCTIONS%20FOR%20FILING%20A%20MOZMILL%20FAILURE%20BUG%20-----%0D%0ANOTE%3A%20REMOVE%20THIS%20SECTION%20BEFORE%20FILING%20THE%20BUG%0D%0A%0D%0A1.%20Include%20a%20URL%20above%20for%20the%20dashboard%20report%20where%20the%20failure%20occurs%0D%0A%0D%0AEXAMPLE%3A%0D%0Ahttp%3A%2F%2Fmozmill-release.brasstacks.mozilla.com%2F%23%2Ffunctional%2Ffailure%3Ftest%3D%252FtestSecurity%252FtestGreenLarry.js%26func%3DtestLarryGreen%0D%0A%0D%0A2.%20Include%20the%20test%20and%20failure%20type%20in%20the%20SUMMARY%20field%0D%0A%0D%0AEXAMPLE%3A%0D%0A%22Failure%20in%20%2FtestSecurity%2FtestGreenLarry.js%20%7C%20Timeout%20waiting%20for%20page%20loaded.%22%0D%0A%0D%0A3.%20Add%20%22%5Bmozmill-test-failure%5D%22%20to%20the%20whiteboard%20field%20below%0D%0A%0D%0A4.%20Include%20the%20test%20function%2C%20error%20message%2C%20date%20when%20the%20error%20occurred%2C%20date%20with%20the%20error%20first%20occurred%2C%20and%20number%20of%20times%20the%20error%20has%20been%20reported%20in%20the%20DESCRIPTION%20field%0D%0A%0D%0AEXAMPLE%3A%0D%0ATEST%3A%20testSecurity%2FtestGreenLarry.js%3AtestLarryGreen%28%29%0D%0AERROR%3A%20controller.waitForPageLoad%28%29%3A%20Timeout%20waiting%20for%20page%20loaded.%20%0D%0AWHEN%3A%202011-07-01%0D%0AFIRST%3A%202011-06-25%0D%0AFREQ%3A%205%0D%0A%0D%0A5.%20Remove%20these%20instructions%0D%0A%0D%0A6.%20Click%20SUBMIT%20BUG%0D%0A-----%20END%20INSTRUCTIONS%20-----%0D%0A%0D%0ATEST%3A%20%0D%0AERROR%3A%20%0D%0AWHEN%3A%20%0D%0AFIRST%3A%20%0D%0AFREQ%3A%20%0D%0A&component=Mozmill%20Tests&contenttypeentry=&contenttypemethod=autodetect&contenttypeselection=text%2Fplain&data=&dependson=&description=&flag_type-37=X&flag_type-4=X&flag_type-607=X&form_name=enter_bug&keywords=&maketemplate=Remember%20values%20as%20bookmarkable%20template&op_sys=All&priority=--&product=Mozilla%20QA&qa_contact=mozmill-tests%40mozilla-qa.bugs&rep_platform=All&requestee_type-325=&requestee_type-4=&requestee_type-607=&short_desc=&status_whiteboard=&target_milestone=---&version=unspecified this template]
**If you need assistance, ask ashughes in the [irc://irc.mozilla.org/#mozmill #mozmill] channel
 
=== Endurance  ===
 
;Performed during NIGHTLY phase only
 
Triage and report the performance numbers from the daily Endurance tests.
 
*'''Lead''': [mailto:vlad.maniac@softvision.ro Vlad Maniac] (Softvision)
*'''Peer''': [mailto:alex.lakatos@softvision.ro Alex Lakatos] (Softvision)
*Endurance [http://mozmill-release.brasstacks.mozilla.com/#/endurance/reports reports]
*Spreadsheet for tracking [https://spreadsheets.google.com/spreadsheet/ccc?key=0AsTwehGIbXUkdE5CSEFqTTI1Tm9HY0RWOF80dDhsVWc#gid=0 results]
*'''NOTE''': Report any spikes in performance degradation to the QA release driver
 
;Analysis (20110722 - 20110815)
 
*Windows Memory Usage: +15.58% (77MB -&gt; 89MB)
*Mac Memory Usage: +3.27% (153MB -&gt; 158MB)
*Linux Memory Usage: +0.00% (84MB -&gt; 84MB)
 
;Issues Found
 
== Bug Triage  ==
 
Check UNCONFIRMED, NEW, FIXED, REOPEN, and tracking/status bugs
 
*'''Lead''': [mailto:vlad.maniac@softvision.ro Vlad Maniac] (Softvision)
*'''Peer''': [mailto:alex.lakatos@softvision.ro Alex Lakatos] (Softvision)
*'''Bugs:''' [http://bit.ly/qTLvQZ QA+], [http://bit.ly/pvrNS5 FIXED]
*'''Results:''' [http://bit.ly/pSkOvh VERIFIED], [http://bit.ly/osNACX REOPENED]
*'''Tips''':
**If you don't know how to verify a bug, just skip it, move onto the next bug
**Ignore code-level bugs, bugs in tests, build issues
 
;Notes
 
== Features  ==
 
Track features which have [[Firefox/Flight Tracking#Firefox_9|landed]] in Firefox 8 and are ready to be tested ([https://docs.google.com/spreadsheet/ccc?key=0AoWKqsW66shRdFhoU3ZGYVRMMG1JN3djaXF0d3pyTXc&hl=en_US#gid=0 spreadsheet])
 
=== Feature  ===
 
Description of feature
 
*'''Leads''': Person (role)
*'''QA Owner:''' Owner
*'''Status:''' Status
*'''Links:''' Feature page, test plan, tracking bug, etc
*'''Notes:'''
 
=== [[Firefox/Features/Tab move detach animations|Tab move detach animations]]  ===
 
When dragging tabs on the tab bar, we should show the tab and animate when you rearrange them, instead of showing a placeholder indicator like we currently do. We should also show a thumbnail of the page on detach operations, and make sure we have a good threshold, so this isn't triggered accidentally.
 
*'''Leads''': Asa Dotzler (Product), Alex Limi (Feature, UX lead), Frank Yan (Lead Engineer),
*'''QA Owner:''' Paul Silaghi (:PaulS)
*'''Status:''' '''Landed, Complete''' - Currently at risk. Feature backed out from Firefox 8.0
*'''Links:''' [https://wiki.mozilla.org/Firefox/Features/Tab_move_detach_animations Feature Page], [https://bugzilla.mozilla.org/show_bug.cgi?id=455694 Tracking Bug], [https://bugzilla.mozilla.org/show_bug.cgi?id=690227 Back out Tracking Bug]
*'''Notes:''' [https://wiki.mozilla.org/Firefox/Features/Tab_move_detach_animations/TestPlan Feature Test Plan]
 
There are regressions and the team backed this change out for Firefox 8. The changes have been verified. The feature was backed out without other regressions.
 
=== [[Extension Manager:Projects:Third Party Add-on Warnings|Third Party Add-on Warnings]]  ===
 
We currently do not provide adequate warning to users that new third-party provided add-ons have been installed. This project will ensure that users opt-in to all add-ons that aren't installed through the Firefox UI. This feature falls primarily in the Experience category (from the "Discover, Experience, and Connect" vision statement.)
 
*'''Leads''': Asa Dotzler (Product), Dave Townsend (Feature, Lead), Curtis Koenig (Security lead), Jennifer Boriss (UX Lead)
*'''QA Owner: Vlad Maniac (:vladmaniac)'''
*'''Status:''' '''Complete. Health: OK''' - Feature Landed.
*'''Links:''' [https://wiki.mozilla.org/Extension_Manager:Projects:Third_Party_Add-on_Warnings Feature Page], [https://bugzilla.mozilla.org/show_bug.cgi?id=476430 Tracking Bug] [https://wiki.mozilla.org/Extension_Manager/QA/Feature_Test_Plans/Extension_Manager:Projects:Third_Party_Add-on_Warnings Test Plan]
*'''Notes:'''
 
=== [[Features/Desktop/People Search|People Search]]  ===
 
Users can currently search for general web content, ecommerce items, and reference material, but they cannot search for people. We should add some form of People search to our search list. Twitter search is probably a good first step.
 
*'''Leads''': Chris Lee (Product)
*'''QA Owner:''' Ioana Budnar
*'''Status:''' '''Landed. Health: OK'''
*'''Links:''' [https://wiki.mozilla.org/Features/Desktop/People_Search Feature Page] [https://bugzilla.mozilla.org/show_bug.cgi?id=671307 Tracking Bug] [https://wiki.mozilla.org/Features/Desktop/People_Search/TestPlan#People_Search Test Plan]
*'''Notes:''' '''Signed off'''
 
=== [[Extension Manager:Projects:Confirm on Upgrade|Confirm add-ons on upgrade]]  ===
 
Then next time existing users upgrade Firefox they should be presented with a list of add-ons they have installed where they can choose to disable them. By default add-ons from third-parties which may have been installed without the users' knowledge will be disabled. This replaces the compatibility wizard for that one time upgrade, subsequent upgrades use the compatibility wizard still.<br> This feature falls primarily in the Experience category (from the "Discover, Experience, and Connect" vision statement.)
 
*'''Leads''': Justin Scott (Product), Dave Townsend (Feature, Lead), Curtis Koenig (Security lead), Alex Faaborg (UX Lead)
*'''QA Owner: Vlad Maniac (:vladmaniac)'''
*'''Status:''' '''Complete. Health: OK''' - Feature Landed.
*'''Links:''' [https://wiki.mozilla.org/Extension_Manager:Projects:Confirm_on_Upgrade Feature Page], [https://bugzilla.mozilla.org/show_bug.cgi?id=596343 Tracking Bug], [https://wiki.mozilla.org/Extension_Manager/QA/Feature_Test_Plans/Extension_Manager:Projects:Confirm_on_Upgrade Test Plan]
*'''Notes:'''
 
=== [[Features/Desktop/Expose prefs for tabs-on-demand|Expose prefs for tabs-on-demand]]  ===
 
Firefox 4 has the hidden ability to load tabs on-demand by setting the maximum number of concurrent tabs being restored to "0" — now that the feature has been in the wild for a while, we'd like to expose it as the default behavior for session restore. It makes startup a lot faster, and uses a lot less memory.<br> This feature falls primarily in the Experience category (from the "Discover, Experience, and Connect" vision statement.)
 
*'''Leads''': Asa Dotzler (Product), Alex Limi (Feature), Paul O'Shannessy (Lead Engineer)
*'''QA Owner: ''' Mihaela Velimiroviciu
*'''Status:''' '''Complete. Health: OK''' - Feature Landed.
*'''Links:''' [https://wiki.mozilla.org/Extension_Manager:Projects:Confirm_on_Upgrade Feature Page], [https://bugzilla.mozilla.org/show_bug.cgi?id=648683 Tracking Bug], [https://wiki.mozilla.org/Features/Desktop/Expose_prefs_for_tabs-on-demand/TestPlan#Expose_prefs_for_tabs-on-demand Test Plan]
*'''Notes:'''
 
=== [[Firefox/Features/Lessen App Update Displayed UI|Silent Update: Reduce Displayed UI]]  ===
 
To reduce update fatigue, don't display application update download and notifications user interface unless necessary. <br> Twelve hours after an update is downloaded the user is told to restart Firefox by the display of the application update user interface. Instead of always notifying after twelve hours and possibly interrupting the user the notification should only be displayed when it is important for the user to apply the update (e.g. when the update contains an important security fix the user should be notified). From analyzing crashes (questionable source), approximately 15% of users run Firefox longer than 12 hours and would be affected (see bug 659425 for details). <br> This feature falls primarily in the Experience category (from the "Discover, Experience, and Connect" vision statement.)
 
*'''Leads''': Chris Lee (Product), Lawrence Mandel (Directly Responsible individual), Tim Taubert (Lead Engineer), Lucas Adamki (Security Lead), Alex Limi (UX Lead)
*'''QA Owner:''' Paul Silaghi
*'''Status:''' '''In progress. Health: OK'''
*'''Links:''' [https://wiki.mozilla.org/Firefox/Features/Lessen_App_Update_Displayed_UI Feature Page], [https://wiki.mozilla.org/Firefox/Features/Lessen_App_Update_Displayed_UI/TestPlan Test Plan], [https://bugzilla.mozilla.org/show_bug.cgi?id=657472 Tracking Bug]
*'''Notes:'''
 
== Input  ==
 
The following are the details of daily triage conducted on '''http://input.mozilla.org'''.
 
*'''Lead''': Simona Badau, irc:simonab (Softvision)
*'''Tasks''':
**Go to http://input.mozilla.org
**Filter the results by Firefox version
**Put your results here: [https://docs.google.com/spreadsheet/ccc?key=0AmkRt0ylPb8zdDFpZjZRTkt4QzlWdjZ5VmxQRmRzYUE&hl=en_US#gid=2 spreadsheet]
**Any feedback which is spiking should listed below and escalated to the QA release driver
 
;Popular Feedback
 
*Results: [https://docs.google.com/spreadsheet/ccc?key=0AmkRt0ylPb8zdDFpZjZRTkt4QzlWdjZ5VmxQRmRzYUE&hl=en_US#gid=0 spreadsheet]
 
== Full Functional Tests  ==
 
The following tracks testing done by iBeta for full functional test coverage. This task is performed once during '''Aurora only'''.
 
*'''Lead''': [mailto:jbecerra@mozilla.com Juan Becerra]
*[ link to test suite]
*[ link to results of testing]
*[ link to bugs filed by iBeta]
 
== Website Compatibility  ==
 
The following tracks testing done by uTest for website compatibility. This task is performed after '''every merge'''.
 
*'''Lead''': [mailto:jbecerra@mozilla.com Juan Becerra]
*Link to test suite
*Link to report for Aurora Web Compatibility
*Link to report for Beta Web Compatibility
*Link to bugs filed
 
== Aurora Merge  ==
 
Verify that the builds generated from the merge to Aurora have updated properly.
 
;Auroratest
 
*{{done|}} [ashughes] Windows XP: '''PASS'''
**Source: Mozilla/5.0 (Windows NT 5.1; rv:7.0a2) Gecko/20110813 Firefox/7.0a2
**Target: Mozilla/5.0 (Windows NT 5.1; rv:8.0a2) Gecko/20110817 Firefox/8.0a2
*{{done|}} [ashughes] Windows 7: '''PASS'''
**Source: Mozilla/5.0 (Windows NT 6.1; rv:7.0a2) Gecko/20110814 Firefox/7.0a2
**Target: Mozilla/5.0 (Windows NT 6.1; rv:8.0a2) Gecko/20110817 Firefox/8.0a2
*{{done|}} [ashughes] Mac OS X 10.6: '''PASS'''
**Source: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:7.0a2) Gecko/20110812 Firefox/7.0a2
**Target: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:8.0a2) Gecko/20110817 Firefox/8.0a2
*{{done|}} [ashughes] Ubuntu 11.04: '''PASS'''
**Source: Mozilla/5.0 (X11; Linux i686 on x86_64; rv:7.0a2) Gecko/20110814 Firefox/7.0a2
**Target: Mozilla/5.0 (X11; Linux i686 on x86_64; rv:8.0a2) Gecko/20110817 Firefox/8.0a2
 
;Aurora
 
*{{done|}} [ashughes] Windows XP: '''PASS'''
**Source: Mozilla/5.0 (Windows NT 5.1; rv:7.0a2) Gecko/20110813 Firefox/7.0a2
**Target: Mozilla/5.0 (Windows NT 5.1; rv:8.0a2) Gecko/20110819 Firefox/8.0a2
*{{done|}} [ashughes] Windows 7: '''PASS'''
**Source: Mozilla/5.0 (Windows NT 6.1; rv:7.0a2) Gecko/20110814 Firefox/7.0a2
**Target: Mozilla/5.0 (Windows NT 6.1; rv:8.0a2) Gecko/20110819 Firefox/8.0a2
*{{done|}} [ashughes] Mac OS X 10.6: '''PASS'''
**Source: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:7.0a2) Gecko/20110812 Firefox/7.0a2
**Target: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:8.0a2) Gecko/20110819 Firefox/8.0a2
*{{done|}} [ashughes] Ubuntu 11.04: '''PASS'''
**Source: Mozilla/5.0 (X11; Linux i686 on x86_64; rv:7.0a2) Gecko/20110814 Firefox/7.0a2
**Target: Mozilla/5.0 (X11; Linux i686 on x86_64; rv:8.0a2) Gecko/20110819 Firefox/8.0a2
 
;Issues Found
 
== Beta 1  ==
 
The following tasks need to be completed to sign-off the Beta merge
 
*{{ok|}} [ashughes] Automated Tests: [[#Automated_Tests_2|details]]
*{{ok|}} [softvision] Manual Tests: [[#Manual_Tests_2|details]]
*{{ok|}} [ashughes] Updates: [[#Updates_2|details]]
 
'''Builds''': [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/8.0b1-candidates/build1 Firefox 8.0b1(1)]<br> '''Litmus''':[https://litmus.mozilla.org/run_tests.cgi?test_run_id=351 testrun]<br>
 
=== Automated Tests  ===
 
The following are the detailed results of the automated BFT test runs.
 
*{{done|}} [ashughes] Windows 2000: '''PASS'''
*{{done|}} [ashughes] Windows XP: '''PASS'''
*{{done|}} [ashughes] Windows Vista: '''PASS'''
*{{done|}} [ashughes] Windows 7: '''PASS'''
*{{done|}} [ashughes] Windows 7 64-bit: '''PASS'''
*{{done|}} [ashughes] Mac OS X 10.6: '''PASS'''
*{{done|}} [ashughes] Mac OS X 10.7: '''PASS'''
*{{done|}} [ashughes] Ubuntu 11.04: '''PASS'''
*{{done|}} [ashughes] Ubuntu 11.04 64-bit: '''PASS'''
*'''Reports''': [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=351 Litmus], [http://mozmill-release.brasstacks.mozilla.com/#/functional/reports?branch=8.0&platform=All&from=2011-09-28&to=2011-09-30 Mozmill]
 
;Issues Found
 
*Two tests are constantly failing and which need to be fixed as soon as possible.
 
=== Manual Tests  ===
 
;Smoketests
 
The following are the detailed results of the manual smoketests.
 
*{{done|}} [Simona] Windows 2000: '''PASS'''
*{{done|}} [Ioana] Windows XP: '''PASS'''
*{{done|}} [Simona] Windows Vista: '''PASS'''
*{{done|}} [Mihaela] Windows 7: '''PASS'''
*{{done|}} [Andrei] Windows 7 64-bit: '''PASS'''
*{{done|}} [VladG] Mac OS X 10.6: '''PASS'''
*{{done|}} [VladG] Mac OS X 10.7: '''PASS'''
*{{done|}} [Ioana] Ubuntu 11.04: '''PASS'''
*{{done|}} [Virgil] Ubuntu 11.04 64-bit: '''PASS'''
*'''Litmus''' [https://litmus.mozilla.org/run_tests.cgi?test_run_id=351 testrun], [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=351 report]
*'''Firefox 8.0b1''' [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/8.0b1-candidates/build1 build1]
 
;Exploratory Tests
 
The following are the detailed results of the exploratory testing - Web App compatibility
 
*{{done|}} [Simona] Windows 2000: '''PASS'''
*{{done|}} [Ioana] Windows XP: '''PASS'''
*{{done|}} [Simona] Windows Vista: '''PASS'''
*{{done|}} [Mihaela] Windows 7: '''PASS'''
*{{done|}} [Andrei] Windows 7 64-bit: '''PASS'''
*{{done|}} [VladG] Mac OS X 10.6: '''PASS'''
*{{done|}} [VladG] Mac OS X 10.7: '''PASS'''
*{{done|}} [Ioana] Ubuntu 11.04: '''PASS'''
*{{done|}} [Virgil] Ubuntu 11.04 64-bit '''PASS'''
*'''Litmus''' [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=351 report]
 
;Issues Found
 
*Html5
**{{Bug|690356}} - Lower half of html5 youtube videos flickers in full screen
*Tab animation
**{{Bug|689554}} - The use of closing browser window shortcut key (ctrl+shift+w) while dnd a tab disturbs tab animation [NEW]
**{{Bug|689566}} - Keyboard shortcut cmd+shift+w disturbs tab animation - dnd a tab from a window to another window [mac] [NEW]
**{{Bug|689575}} - Disable keyboard shortcuts while tab animation is active [NEW]
**{{Bug|690341}} - Using the close tab option from the menu opens a new tab when dragging a tab [NEW]
 
=== Updates  ===
 
The following are details of update verifications for Firefox 8 beta 1
 
'''Releasetest:''' [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=releasetest&from=2011-09-29&to=2011-09-29&target=8.0 report]
 
*{{done|}} [ashughes] Windows 2000: '''PASS'''
*{{done|}} [ashughes] Windows XP: '''PASS'''
*{{done|}} [ashughes] Windows Vista: '''PASS'''
*{{done|}} [ashughes] Windows 7: '''PASS'''
*{{done|}} [ashughes] Windows 7 64-bit: '''PASS'''
*{{done|}} [ashughes] Mac OS X 10.6: '''PASS'''
*{{done|}} [ashughes] Mac OS X 10.7: '''PASS'''
*{{done|}} [ashughes] Ubuntu 11.04: '''PASS'''
*{{done|}} [ashughes] Ubuntu 11.04 64-bit: '''PASS'''
 
'''Beta:''' [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=beta&from=2011-09-29&to=2011-09-30&target=8.0 report]
 
*{{done|}} [ashughes] Windows 2000: '''PASS'''
*{{done|}} [ashughes] Windows XP: '''PASS'''
*{{done|}} [ashughes] Windows Vista: '''PASS'''
*{{done|}} [ashughes] Windows 7: '''PASS'''
*{{done|}} [ashughes] Windows 7 64-bit: '''PASS'''
*{{done|}} [ashughes] Mac OS X 10.6: '''PASS'''
*{{done|}} [ashughes] Mac OS X 10.7: '''PASS'''
*{{done|}} [ashughes] Ubuntu 11.04: '''PASS'''
*{{done|}} [ashughes] Ubuntu 11.04 64-bit: '''PASS'''
 
;Issues Found
 
== Beta 2 (build1)  ==
 
The following tasks need to be completed to sign-off the Beta merge
 
*{{ok|}} [ashughes] Automated Tests: [[#Automated_Tests_2|details]]
*{{ok|}} [softvision] Manual Tests: [[#Manual_Tests_2|details]]
*{{ok|}} [softvision] Bug fix verifications [[#Bug_Fix_Verification|details]]
*{{ok|}} [ashughes] Updates: [[#Updates_2|details]]
 
'''Builds''': [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/8.0b2-candidates/build1 Firefox 8.0b2(1)]<br> '''Litmus''':[https://litmus.mozilla.org/run_tests.cgi?test_run_id=355 testrun]<br>
 
=== Automated Tests  ===
 
The following are the detailed results of the automated BFT test runs.
 
*{{done|}} [ashughes] Windows 2000: '''PASS'''
*{{done|}} [ashughes] Windows XP: '''PASS'''
*{{done|}} [ashughes] Windows Vista: '''PASS'''
*{{done|}} [ashughes] Windows 7: '''PASS'''
*{{done|}} [ashughes] Windows 7 64-bit: '''PASS'''
*{{done|}} [ashughes] Mac OS X 10.6: '''PASS'''
*{{done|}} [ashughes] Mac OS X 10.7: '''PASS'''
*{{done|}} [ashughes] Ubuntu 11.04: '''PASS'''
*{{done|}} [ashughes] Ubuntu 11.04 64-bit: '''PASS'''
*'''Reports''': [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=355 Litmus], [http://mozmill-release.brasstacks.mozilla.com/#/functional/reports?branch=8.0&platform=All&from=2011-10-06&to=2011-10-06 Mozmill]
 
;Issues Found
 
*/restartTests/testAddons_installMultipleExtensions/test1.js is failing on Win XP
 
=== Manual Tests  ===
 
;Smoketests
 
The following are the detailed results of the manual smoketests.
 
*{{done|}} [Simona] Windows 2000: '''PASS'''
*{{done|}} [Ioana] Windows XP: '''PASS'''
*{{done|}} [Simona] Windows Vista: '''PASS'''
*{{done|}} [Mihaela] Windows 7: '''PASS'''
*{{done|}} [Mihaela] Windows 7 64-bit: '''PASS'''
*{{done|}} [VladG] Mac OS X 10.6: '''PASS'''
*{{done|}} [VladG] Mac OS X 10.7: '''PASS'''
*{{done|}} [Ioana] Ubuntu 11.04: '''PASS'''
*{{done|}} [Virgil] Ubuntu 11.04 64-bit: '''PASS'''
*'''Litmus''' [https://litmus.mozilla.org/run_tests.cgi?test_run_id=355 testrun], [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=355 report]
*'''Firefox 8.0b2''' [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/8.0b2-candidates/build1 build1]
 
;Exploratory Tests
 
The following are the detailed results of the exploratory testing - Web App compatibility
 
*{{done|}} [Simona] Windows 2000: '''PASS'''
*{{done|}} [Ioana] Windows XP: '''PASS'''
*{{done|}} [Simona] Windows Vista: '''PASS'''
*{{done|}} [Mihaela] Windows 7: '''PASS'''
*{{done|}} [Mihaela] Windows 7 64-bit: '''PASS'''
*{{done|}} [VladG] Mac OS X 10.6: '''PASS'''
*{{done|}} [VladG] Mac OS X 10.7: '''PASS'''
*{{done|}} [Ioana] Ubuntu 11.04: '''PASS'''
*{{done|}} [Virgil] Ubuntu 11.04 64-bit: '''PASS'''
*'''Litmus''' [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=355 report]
 
;Issues Found
 
*{{bug|692418}} -Print error is triggered the first time when attempting to print a yahoo mail message (New)
*{{bug|692446}} -Firefox prompts to install windows media player plugin even though it is already installed (New)
 
=== Bug Fix Verification  ===
 
*'''Release Driver:''' Triage these [http://bit.ly/pvrNS5 FIXED] bugs to build the [http://bit.ly/qLoCqW QA+] query
*'''Release Testers:''' Verify these [http://bit.ly/qLoCqW QA+] bugs 100%
*'''Results:''' [http://bit.ly/qm2viL spreadsheet]
 
=== Updates  ===
 
The following are details of update verifications for Firefox 8 beta 2
 
'''Betatest''':
 
*run some manual exploratory tests around updating with add-ons, plugins, session/profile data, etc
*How to set update channel to betatest:
**Find the defaults/prefs/channel-prefs.js file in your Firefox application folder
**Open it with a text editor and change the "beta" channel to "betatest", save and exit
**Start Firefox and check app.update.channel in about:config to verify it changed
**'''NOTE:''' On Windows Vista and 7 will not let you save the changes unless you run your text editor as an Administrator -- do so by right clicking the launcher for the text editor and select "Run as Administrator"
*What to test
**Build a realistic amount of profile and session data on one of the previous betas (4.0b8 through 8.0b1):
**try installing several add-ons (some out of date)
**try installing several plugins (some out of date)
**go to various top sites like Youtube, Banking sites, Social networks, news sites, games, webmail etc
**put some of the tabs in App Tabs and Panorama groupings
**'''Ultimately''' just play around with your browser for an hour or so like you would on a day to day basis
**After a while, check for and install the Firefox update to 8.0b2 and restart
*Result -- check after restart:
**no loss of session data
**no loss of profile data
**no loss of history, bookmarks
**no loss of add-ons
**no obvious breakage with Firefox and the sites you use most often
*What to report
**File bugs using the [8b2] whiteboard tag
 
<br>
 
'''Releasetest:''' [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=releasetest&from=2011-10-06&to=2011-10-06&target=8.0 report]
 
*{{done|}} [ashughes] Windows 2000: '''PASS'''
*{{done|}} [ashughes] Windows XP: '''PASS'''
*{{done|}} [ashughes] Windows Vista: '''PASS'''
*{{done|}} [ashughes] Windows 7: '''PASS'''
*{{done|}} [ashughes] Windows 7 64-bit: '''PASS'''
*{{done|}} [ashughes] Mac OS X 10.6: '''PASS'''
*{{done|}} [ashughes] Mac OS X 10.7: '''PASS'''
*{{done|}} [ashughes] Ubuntu 11.04: '''PASS'''
*{{done|}} [ashughes] Ubuntu 11.04 64-bit: '''PASS'''
 
'''Beta:''' [ report]
 
*{{ok|}} [tester] Windows 2000: '''result'''
*{{ok|}} [tester] Windows XP: '''result'''
*{{ok|}} [tester] Windows Vista: '''result'''
*{{ok|}} [tester] Windows 7: '''result'''
*{{ok|}} [tester] Windows 7 64-bit: '''result'''
*{{ok|}} [tester] Mac OS X 10.6: '''result'''
*{{ok|}} [tester] Mac OS X 10.7: '''result'''
*{{ok|}} [tester] Ubuntu 11.04: '''result'''
*{{ok|}} [tester] Ubuntu 11.04 64-bit: '''result'''
 
;Issues Found
 
== Beta 2 (build 2)  ==
 
The following tasks need to be completed to sign-off on this beta milestone.
 
*{{ok|}} [ashughes] Automated Tests: [[#Automated_Tests_3|details]]
*{{ok|}} [softvision] Manual Tests: [[#Manual_Tests_3|details]]
*{{ok|}} [softvision] Bug fix verifications [[#Bug_Fix_Verification|details]]
*{{ok|}} [ashughes] Updates: [[#Updates_3|details]]
 
'''Builds''': [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/8.0b2-candidates/build2 Firefox 8.0b2(build 2)]<br> '''Litmus''':[https://litmus.mozilla.org/run_tests.cgi?test_run_id=356 testrun]<br>
 
=== Automated Tests  ===
 
The following are the detailed results of the automated BFT test runs.
 
*{{done|}} [ashughes] Windows 2000: '''RESULT'''
*{{done|}} [ashughes] Windows XP: '''RESULT'''
*{{done|}} [ashughes] Windows Vista: '''RESULT'''
*{{done|}} [ashughes] Windows 7: '''RESULT'''
*{{done|}} [ashughes] Windows 7 64-bit: '''RESULT'''
*{{done|}} [ashughes] Mac OS X 10.6: '''RESULT'''
*{{done|}} [ashughes] Mac OS X 10.7: '''RESULT'''
*{{done|}} [ashughes] Ubuntu 11.04: '''RESULT'''
*{{done|}} [ashughes] Ubuntu 11.04 64-bit: '''RESULT'''
*'''Reports''': [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=356 Litmus], [http://mozmill-release.brasstacks.mozilla.com/#/functional/reports?branch=8.0&platform=All&from=2011-10-07&to=2011-10-07 Mozmill]
 
;Issues Found
 
*/testSecurity/testSubmitUnencryptedInfoWarning.js failed on Mac 10.7 and Windows 2000
*/restartTests/testAddons_installMultipleExtensions failed on Mac 10.7
*/testTabbedBrowsing/testBackgroundTabScrolling.js failed on Windows Vista
 
=== Manual Tests  ===
 
;Smoketests
 
The following are the detailed results of the manual smoketests.
 
*{{done|}} [Simona] Windows 2000: '''RESULT'''
*{{done|}} [Ioana] Windows XP: '''RESULT'''
*{{done|}} [Simona] Windows Vista: '''RESULT'''
*{{done|}} [Mihaela] Windows 7: '''RESULT'''
*{{done|}} [Mihaela] Windows 7 64-bit: '''RESULT'''
*{{done|}} [VladG] Mac OS X 10.6: '''RESULT'''
*{{done|}} [VladG] Mac OS X 10.7: '''RESULT'''
*{{done|}} [Ioana] Ubuntu 11.04: '''RESULT'''
*{{done|}} [Virgil] Ubuntu 11.04 64-bit: '''RESULT'''
*'''Litmus''' [https://litmus.mozilla.org/run_tests.cgi?test_run_id=356 testrun], [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=356 report]
*'''Firefox 8.0b2''' [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/8.0b2-candidates/build2 build2]


'''Latest Build: [ftp://ftp.mozilla.org/pub/firefox/nightly/latest-mozilla-beta/ ftp], [http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/latest-mozilla-beta/ http], [http://www.mozilla.com/en-US/firefox/channel/ web]'''
;Exploratory Tests


The following is the test plan for Firefox 8 from Nightly through to Release. Use this document as a reference for what is being tested to validate the quality of Firefox 8. After the release this document will be used as an archive of what was done to validate this release.
The following are the detailed results of the exploratory testing - Web App compatibility


''If you have some free time, please pick a task below and get in touch with one of the leads.''
*{{done|}} [Simona] Windows 2000: '''RESULT'''
*{{done|}} [Ioana] Windows XP: '''RESULT'''
*{{done|}} [Simona] Windows Vista: '''RESULT'''
*{{done|}} [Mihaela] Windows 7: '''RESULT'''
*{{done|}} [Mihaela] Windows 7 64-bit: '''RESULT'''
*{{done|}} [VladG] Mac OS X 10.6: '''RESULT'''
*{{done|}} [VladG] Mac OS X 10.7: '''RESULT'''
*{{done|}} [Ioana] Ubuntu 11.04: '''RESULT'''  
*{{done|}} [Virgil] Ubuntu 11.04 64-bit: '''RESULT'''
*'''Litmus''' [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=356 report]


== Details ==
;Issues Found
The following is a description of the tasks which need to be completed throughout this release.
; Daily Tasks
* {{ok|}} [softvision] [[#Automation | Automation]]: Check dashboards for new failures
* {{ok|}} [softvision] [[#Bug_Triage | Bug Triage]]: Check Bugzilla for regressions
* {{ok|}} [softvision] [[#Features | Features]]: Test features and triage feature bugs targeted for this releases
* {{ok|}} [softvision] [[#Input | Input]]: Triage Input.MO for prevalent issues and feature requests


; One-time-only Tasks
*{{bug|692418}} -Print error is triggered the first time when attempting to print a yahoo mail message (New)
* {{done|}} [juanb] [[#Nightly_Merge | Nightly Merge]]: Sign-off initial merge to Nightly
*{{bug|692446}} -Firefox prompts to install windows media player plugin even though it is already installed (New)
* {{ok|}} [ashughes] [[#Aurora_Merge | Aurora Merge]]: Sign-off merge from Nightly to Aurora
* {{ok|}} [iBeta] [[#Full_Functional_Tests | Full Functional Tests]]: Run the full suite of full functional tests on Aurora
* {{ok|}} [uTest] [[#Website_Compatibility | Website Compatibility]]: Run suite of Aurora website compatibility tests
* {{ok|}} [ashughes] [[#Beta_Merge | Beta Merge]]: Sign-off merge from Aurora to Beta
* {{ok|}} [uTest] [[#Website_Compatibility | Website Compatibility]]: Run suite of Beta website compatibility tests
* {{ok|}} [ashughes] [[#Release | Release]]: Sign-off final release


== Automation ==
=== Bug Fix Verification  ===
=== BFTs ===
Triage the [http://mozmill-release.brasstacks.mozilla.com/#/functional/top?branch=8.0&platform=All Mozmill dashboard] for test failures and debug for potential Firefox regressions.
* '''Lead''': [mailto:vlad.maniac@softvision.ro Vlad Maniac] (Softvision)
* '''Peer''': [mailto:alex.lakatos@softvision.ro Alex Lakatos] (Softvision)
* '''Failure Status''': [http://bit.ly/q7Vm95 NEW] (12) | [http://bit.ly/oTmHo2 ASSIGNED] (7) | [http://bit.ly/q1sH6a FIXED] (3) | REGRESSIONS (0)
* '''Tasks''':
** Check the [http://mozmill-release.brasstacks.mozilla.com/#/functional/reports?branch=7.0&platform=All Mozmill dashboard] for failing tests for the day
** Cross reference any failure to the list of [http://bit.ly/q7Vm95 NEW] and [http://bit.ly/oTmHo2 ASSIGNED] bugs
*** If the bug is NEW, assign it to yourself and try to fix it
*** If the bug is ASSIGNED and there has been no activity on the bug in over a week, offer your assistance to fix the bug
*** If there is NO bug on file, file it using [https://bugzilla.mozilla.org/enter_bug.cgi?alias=&assigned_to=nobody%40mozilla.org&blocked=&bug_file_loc=&bug_severity=normal&bug_status=NEW&comment=-----%20INSTRUCTIONS%20FOR%20FILING%20A%20MOZMILL%20FAILURE%20BUG%20-----%0D%0ANOTE%3A%20REMOVE%20THIS%20SECTION%20BEFORE%20FILING%20THE%20BUG%0D%0A%0D%0A1.%20Include%20a%20URL%20above%20for%20the%20dashboard%20report%20where%20the%20failure%20occurs%0D%0A%0D%0AEXAMPLE%3A%0D%0Ahttp%3A%2F%2Fmozmill-release.brasstacks.mozilla.com%2F%23%2Ffunctional%2Ffailure%3Ftest%3D%252FtestSecurity%252FtestGreenLarry.js%26func%3DtestLarryGreen%0D%0A%0D%0A2.%20Include%20the%20test%20and%20failure%20type%20in%20the%20SUMMARY%20field%0D%0A%0D%0AEXAMPLE%3A%0D%0A%22Failure%20in%20%2FtestSecurity%2FtestGreenLarry.js%20%7C%20Timeout%20waiting%20for%20page%20loaded.%22%0D%0A%0D%0A3.%20Add%20%22%5Bmozmill-test-failure%5D%22%20to%20the%20whiteboard%20field%20below%0D%0A%0D%0A4.%20Include%20the%20test%20function%2C%20error%20message%2C%20date%20when%20the%20error%20occurred%2C%20date%20with%20the%20error%20first%20occurred%2C%20and%20number%20of%20times%20the%20error%20has%20been%20reported%20in%20the%20DESCRIPTION%20field%0D%0A%0D%0AEXAMPLE%3A%0D%0ATEST%3A%20testSecurity%2FtestGreenLarry.js%3AtestLarryGreen%28%29%0D%0AERROR%3A%20controller.waitForPageLoad%28%29%3A%20Timeout%20waiting%20for%20page%20loaded.%20%0D%0AWHEN%3A%202011-07-01%0D%0AFIRST%3A%202011-06-25%0D%0AFREQ%3A%205%0D%0A%0D%0A5.%20Remove%20these%20instructions%0D%0A%0D%0A6.%20Click%20SUBMIT%20BUG%0D%0A-----%20END%20INSTRUCTIONS%20-----%0D%0A%0D%0ATEST%3A%20%0D%0AERROR%3A%20%0D%0AWHEN%3A%20%0D%0AFIRST%3A%20%0D%0AFREQ%3A%20%0D%0A&component=Mozmill%20Tests&contenttypeentry=&contenttypemethod=autodetect&contenttypeselection=text%2Fplain&data=&dependson=&description=&flag_type-37=X&flag_type-4=X&flag_type-607=X&form_name=enter_bug&keywords=&maketemplate=Remember%20values%20as%20bookmarkable%20template&op_sys=All&priority=--&product=Mozilla%20QA&qa_contact=mozmill-tests%40mozilla-qa.bugs&rep_platform=All&requestee_type-325=&requestee_type-4=&requestee_type-607=&short_desc=&status_whiteboard=&target_milestone=---&version=unspecified this template]
** If you need assistance, ask ashughes in the [irc://irc.mozilla.org/#mozmill #mozmill] channel


=== Endurance ===
Verify 100% QA+ bugs, as many as possible FIXED bugs
; Performed during NIGHTLY phase only
Triage and report the performance numbers from the daily Endurance tests.
* '''Lead''': [mailto:vlad.maniac@softvision.ro Vlad Maniac] (Softvision)
* '''Peer''': [mailto:alex.lakatos@softvision.ro Alex Lakatos] (Softvision)
* Endurance [http://mozmill-release.brasstacks.mozilla.com/#/endurance/reports reports]
* Spreadsheet for tracking [https://spreadsheets.google.com/spreadsheet/ccc?key=0AsTwehGIbXUkdE5CSEFqTTI1Tm9HY0RWOF80dDhsVWc#gid=0 results]
* '''NOTE''': Report any spikes in performance degradation to the QA release driver


; Analysis (20110722 - 20110815)
*'''Bugs:''' [http://bit.ly/qTLvQZ QA+], [http://bit.ly/pvrNS5 FIXED]
* Windows Memory Usage: +15.58% (77MB -> 89MB)
*Fixed bugs verification spreadsheet [http://bit.ly/qm2viL Link]
* Mac Memory Usage: +3.27% (153MB -> 158MB)
* Linux Memory Usage: +0.00% (84MB -> 84MB)


; Issues Found
=== Updates  ===


== Bug Triage ==
The following are details of update verifications for Firefox 8 beta 2
Check UNCONFIRMED, NEW, FIXED, REOPEN, and tracking/status bugs
* '''Lead''': [mailto:vlad.maniac@softvision.ro Vlad Maniac] (Softvision)
* '''Peer''': [mailto:alex.lakatos@softvision.ro Alex Lakatos] (Softvision)
* '''Bugs:''' [http://bit.ly/qTLvQZ QA+], [http://bit.ly/pvrNS5 FIXED]
* '''Results:''' [http://bit.ly/pSkOvh VERIFIED], [http://bit.ly/osNACX REOPENED]
* '''Tips''':
** If you don't know how to verify a bug, just skip it, move onto the next bug
** Ignore code-level bugs, bugs in tests, build issues


; Notes
'''Betatest''':


== Features ==
*run some manual exploratory tests around updating with add-ons, plugins, session/profile data, etc
Track features which have [[Firefox/Flight_Tracking#Firefox_9|landed]] in Firefox 8 and are ready to be tested ([https://docs.google.com/spreadsheet/ccc?key=0AoWKqsW66shRdFhoU3ZGYVRMMG1JN3djaXF0d3pyTXc&hl=en_US#gid=0 spreadsheet])
*How to set update channel to betatest:
**Find the defaults/prefs/channel-prefs.js file in your Firefox application folder
**Open it with a text editor and change the "beta" channel to "betatest", save and exit
**Start Firefox and check app.update.channel in about:config to verify it changed
**'''NOTE:''' On Windows Vista and 7 will not let you save the changes unless you run your text editor as an Administrator -- do so by right clicking the launcher for the text editor and select "Run as Administrator"
*What to test
**Build a realistic amount of profile and session data on one of the previous betas (4.0b8 through 8.0b1):  
**try installing several add-ons (some out of date)
**try installing several plugins (some out of date)
**go to various top sites like Youtube, Banking sites, Social networks, news sites, games, webmail etc
**put some of the tabs in App Tabs and Panorama groupings
**'''Ultimately''' just play around with your browser for an hour or so like you would on a day to day basis
**After a while, check for and install the Firefox update to 8.0b2 and restart
*Result -- check after restart:
**no loss of session data
**no loss of profile data
**no loss of history, bookmarks
**no loss of add-ons
**no obvious breakage with Firefox and the sites you use most often
*What to report
**File bugs using the [8b2] whiteboard tag


=== Feature ===
'''Exploratory testing'''  
Description of feature
* '''Leads''': Person (role)
* '''QA Owner:''' Owner
* '''Status:''' Status
* '''Links:''' Feature page, test plan, tracking bug, etc
* '''Notes:'''


=== [[Firefox/Features/Tab_move_detach_animations|Tab move detach animations]] ===
*{{done|}} [Simona] Windows XP:'''PASS'''  
When dragging tabs on the tab bar, we should show the tab and animate when you rearrange them, instead of showing a placeholder indicator like we currently do. We should also show a thumbnail of the page on detach operations, and make sure we have a good threshold, so this isn't triggered accidentally.
*{{done|}} [Virgil] Ubuntu 11.04 x64:'''PASS'''  
* '''Leads''': Asa Dotzler (Product), Alex Limi (Feature, UX lead), Frank Yan (Lead Engineer),
*{{done|}} [Ioana] Windows 7:'''PASS'''  
* '''QA Owner:''' [mailto:andrei.domuta@softvision.ro AndreiD]
*{{done|}} [VladG] MacOS X 10.6:'''PASS'''  
* '''Status:''' '''Landed, Complete''' - Currently at risk
**Exploratory work spreadsheet [http://bit.ly/qYqe5S Link]
* '''Links:''' [https://wiki.mozilla.org/Firefox/Features/Tab_move_detach_animations Feature Page], [https://bugzilla.mozilla.org/show_bug.cgi?id=455694 Tracking Bug]
* '''Notes:''' [https://wiki.mozilla.org/Firefox/Features/Tab_move_detach_animations/TestPlan Feature Test Plan]
There are regressions and the team backed this change out for Firefox 8.


=== [[Extension Manager:Projects:Third Party Add-on Warnings|Third Party Add-on Warnings]] ===
'''Releasetest:''' [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=releasetest&from=2011-10-07&to=2011-10-08&target=8.0 report]  
We currently do not provide adequate warning to users that new third-party provided add-ons have been installed. This project will ensure that users opt-in to all add-ons that aren't installed through the Firefox UI.
This feature falls primarily in the Experience category (from the "Discover, Experience, and Connect" vision statement.)
* '''Leads''': Asa Dotzler (Product), Dave Townsend (Feature, Lead), Curtis Koenig (Security lead), Jennifer Boriss (UX Lead)
* '''QA Owner: Vlad Maniac (:vladmaniac)'''
* '''Status:''' '''Complete. Health: OK''' - Feature Landed.
* '''Links:''' [https://wiki.mozilla.org/Extension_Manager:Projects:Third_Party_Add-on_Warnings Feature Page], [https://bugzilla.mozilla.org/show_bug.cgi?id=476430 Tracking Bug] [https://wiki.mozilla.org/Extension_Manager/QA/Feature_Test_Plans/Extension_Manager:Projects:Third_Party_Add-on_Warnings Test Plan]
* '''Notes:'''


=== [[Features/Desktop/People Search|People Search]] ===
*{{done|}} [ashughes] Windows 2000: '''PASS'''
Users can currently search for general web content, ecommerce items, and reference material, but they cannot search for people. We should add some form of People search to our search list.
*{{done|}} [ashughes] Windows XP: '''PASS'''  
Twitter search is probably a good first step.
*{{done|}} [ashughes] Windows Vista: '''PASS'''  
* '''Leads''': Chris Lee (Product)
*{{done|}} [ashughes] Windows 7: '''PASS'''
* '''QA Owner:''' Ioana Budnar
*{{done|}} [ashughes] Windows 7 64-bit: '''PASS'''  
* '''Status:''' '''Landed. Health: OK'''
*{{done|}} [ashughes] Mac OS X 10.6: '''PASS'''  
* '''Links:''' [https://wiki.mozilla.org/Features/Desktop/People_Search Feature Page] [https://bugzilla.mozilla.org/show_bug.cgi?id=671307 Tracking Bug] [https://wiki.mozilla.org/Features/Desktop/People_Search/TestPlan#People_Search Test Plan]
*{{done|}} [ashughes] Mac OS X 10.7: '''PASS'''  
* '''Notes:''' '''Signed off'''
*{{done|}} [ashughes] Ubuntu 11.04: '''PASS'''  
*{{done|}} [ashughes] Ubuntu 11.04 64-bit: '''PASS'''


=== [[Features/Firefox/In-content UI Visual Unification|In-content UI Visual Unification]] ===
'''Beta:''' [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=beta&from=2011-10-03&to=2011-10-10&target=8.0 report]
Do preparation work for having new in-content UI have a consistent and unified visual appearance.
* '''Leads''': Asa Dotzler (Product), Blair McBride (Feature, Lead Engineer), Jennifer Boriss (UX Lead)
* '''QA Owner:''' Virgil Dicu, Ioana Budnar
* '''Status:''' '''In progress. Health: OK''' - Feature in development stage
* '''Links:''' [https://wiki.mozilla.org/Features/Firefox/In-content_UI_Visual_Unification Feature Page]
* '''Notes:Initial work done & landed, in process of getting reviews and converting additional pages. The feature here is to create a unified template so that future pages (add-ons, permission, etc.) have a consistent look and feel. This will not include user facing changes.'''


=== [[Extension Manager:Projects:Confirm on Upgrade |Confirm add-ons on upgrade]] ===
*{{ok|}} [tester] Windows 2000: '''PASS'''
Then next time existing users upgrade Firefox they should be presented with a list of add-ons they have installed where they can choose to disable them. By default add-ons from third-parties which may have been installed without the users' knowledge will be disabled. This replaces the compatibility wizard for that one time upgrade, subsequent upgrades use the compatibility wizard still.<br>
*{{ok|}} [tester] Windows XP: '''PASS'''  
This feature falls primarily in the Experience category (from the "Discover, Experience, and Connect" vision statement.)
*{{ok|}} [tester] Windows Vista: '''PASS'''  
* '''Leads''': Justin Scott (Product), Dave Townsend (Feature, Lead), Curtis Koenig (Security lead), Alex Faaborg (UX Lead)
*{{ok|}} [tester] Windows 7: '''PASS'''
* '''QA Owner: Vlad Maniac (:vladmaniac)'''  
*{{ok|}} [tester] Windows 7 64-bit: '''PASS'''  
* '''Status:''' '''Complete. Health: OK''' - Feature Landed.
*{{ok|}} [tester] Mac OS X 10.6: '''PASS'''
* '''Links:''' [https://wiki.mozilla.org/Extension_Manager:Projects:Confirm_on_Upgrade Feature Page], [https://bugzilla.mozilla.org/show_bug.cgi?id=596343 Tracking Bug], [https://wiki.mozilla.org/Extension_Manager/QA/Feature_Test_Plans/Extension_Manager:Projects:Confirm_on_Upgrade Test Plan]
*{{ok|}} [tester] Mac OS X 10.7: '''PASS'''  
* '''Notes:'''
*{{ok|}} [tester] Ubuntu 11.04: '''PASS'''
*{{ok|}} [tester] Ubuntu 11.04 64-bit: '''PASS'''


=== [[Features/Desktop/Expose prefs for tabs-on-demand | Expose prefs for tabs-on-demand]] ===
;Issues Found
Firefox 4 has the hidden ability to load tabs on-demand by setting the maximum number of concurrent tabs being restored to "0" — now that the feature has been in the wild for a while, we'd like to expose it as the default behavior for session restore. It makes startup a lot faster, and uses a lot less memory.<br>
This feature falls primarily in the Experience category (from the "Discover, Experience, and Connect" vision statement.)
* '''Leads''': Asa Dotzler (Product), Alex Limi (Feature), Paul O'Shannessy (Lead Engineer)
* '''QA Owner: ''' Mihaela Velimiroviciu
* '''Status:''' '''Complete. Health: OK''' - Feature Landed.
* '''Links:''' [https://wiki.mozilla.org/Extension_Manager:Projects:Confirm_on_Upgrade Feature Page], [https://bugzilla.mozilla.org/show_bug.cgi?id=648683 Tracking Bug], [https://wiki.mozilla.org/Features/Desktop/Expose_prefs_for_tabs-on-demand/TestPlan#Expose_prefs_for_tabs-on-demand Test Plan]
* '''Notes:'''


=== [[Firefox/Features/Lessen App Update Displayed UI|Silent Update: Reduce Displayed UI]] ===
*There were three failures in the automation, which I wasn't able to reproduce manually (juanb).
To reduce update fatigue, don't display application update download and notifications user interface unless necessary.
<br>
Twelve hours after an update is downloaded the user is told to restart Firefox by the display of the application update user interface. Instead of always notifying after twelve hours and possibly interrupting the user the notification should only be displayed when it is important for the user to apply the update (e.g. when the update contains an important security fix the user should be notified). From analyzing crashes (questionable source), approximately 15% of users run Firefox longer than 12 hours and would be affected (see bug 659425 for details).
<br>
This feature falls primarily in the Experience category (from the "Discover, Experience, and Connect" vision statement.)
* '''Leads''': Chris Lee (Product), Lawrence Mandel (Directly Responsible individual), Tim Taubert (Lead Engineer), Lucas Adamki (Security Lead), Alex Limi (UX Lead)
* '''QA Owner:''' Paul Silaghi
* '''Status:''' '''In progress. Health: OK'''
* '''Links:''' [https://wiki.mozilla.org/Firefox/Features/Lessen_App_Update_Displayed_UI Feature Page]
* '''Notes:'''


== Input ==
== Beta 3  ==
The following are the details of daily triage conducted on '''http://input.mozilla.org'''.
* '''Lead''': Simona Badau, irc:simonab (Softvision)
* '''Tasks''':
** Go to http://input.mozilla.org
** Filter the results by Firefox version
** Put your results here: [https://docs.google.com/spreadsheet/ccc?key=0AmkRt0ylPb8zdDFpZjZRTkt4QzlWdjZ5VmxQRmRzYUE&hl=en_US#gid=2 spreadsheet]
** Any feedback which is spiking should listed below and escalated to the QA release driver


; Popular Feedback
The following tasks need to be completed to sign-off the Beta merge
* Results: [https://docs.google.com/spreadsheet/ccc?key=0AmkRt0ylPb8zdDFpZjZRTkt4QzlWdjZ5VmxQRmRzYUE&hl=en_US#gid=0 spreadsheet]


== Full Functional Tests ==
*{{ok|}} [ashughes] Automated Tests: [[#Automated_Tests_3|details]]
The following tracks testing done by iBeta for full functional test coverage. This task is performed once during '''Aurora only'''.
*{{ok|}} [softvision] Manual Tests: [[#Manual_Tests_3|details]]  
* '''Lead''': [mailto:jbecerra@mozilla.com Juan Becerra]
*{{ok|}} [softvision] Bug fix verifications [[#Bug_Fix_Verification|details]]  
* [ link to test suite]
*{{ok|}} [ashughes] Updates: [[#Updates_3|details]]
* [ link to results of testing]
* [ link to bugs filed by iBeta]


== Website Compatibility ==
'''Builds''': [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/8.0b3-candidates/build1 Firefox 8.0b3(build1)]<br> '''Litmus''':[https://litmus.mozilla.org/run_tests.cgi?test_run_id=360 testrun]<br>
The following tracks testing done by uTest for website compatibility. This task is performed after '''every merge'''.
* '''Lead''': [mailto:jbecerra@mozilla.com Juan Becerra]
* Link to test suite
* Link to report for Aurora Web Compatibility
* Link to report for Beta Web Compatibility
* Link to bugs filed


== Aurora Merge ==
=== Automated Tests  ===
Verify that the builds generated from the merge to Aurora have updated properly.


; Auroratest
The following are the detailed results of the automated BFT test runs.  
* {{done|}} [ashughes] Windows XP: '''PASS'''
** Source: Mozilla/5.0 (Windows NT 5.1; rv:7.0a2) Gecko/20110813 Firefox/7.0a2
** Target: Mozilla/5.0 (Windows NT 5.1; rv:8.0a2) Gecko/20110817 Firefox/8.0a2
* {{done|}} [ashughes] Windows 7: '''PASS'''
** Source: Mozilla/5.0 (Windows NT 6.1; rv:7.0a2) Gecko/20110814 Firefox/7.0a2
** Target: Mozilla/5.0 (Windows NT 6.1; rv:8.0a2) Gecko/20110817 Firefox/8.0a2
* {{done|}} [ashughes] Mac OS X 10.6: '''PASS'''
** Source: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:7.0a2) Gecko/20110812 Firefox/7.0a2
** Target: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:8.0a2) Gecko/20110817 Firefox/8.0a2
* {{done|}} [ashughes] Ubuntu 11.04: '''PASS'''
** Source: Mozilla/5.0 (X11; Linux i686 on x86_64; rv:7.0a2) Gecko/20110814 Firefox/7.0a2
** Target: Mozilla/5.0 (X11; Linux i686 on x86_64; rv:8.0a2) Gecko/20110817 Firefox/8.0a2


; Aurora
*{{done|}} [ashughes] Windows 2000: '''PASS'''  
* {{done|}} [ashughes] Windows XP: '''PASS'''
*{{done|}} [ashughes] Windows XP: '''PASS'''
** Source: Mozilla/5.0 (Windows NT 5.1; rv:7.0a2) Gecko/20110813 Firefox/7.0a2
*{{done|}} [ashughes] Windows Vista: '''PASS'''
** Target: Mozilla/5.0 (Windows NT 5.1; rv:8.0a2) Gecko/20110819 Firefox/8.0a2
*{{done|}} [ashughes] Windows 7: '''PASS'''  
* {{done|}} [ashughes] Windows 7: '''PASS'''
*{{done|}} [ashughes] Windows 7 64-bit: '''PASS'''
** Source: Mozilla/5.0 (Windows NT 6.1; rv:7.0a2) Gecko/20110814 Firefox/7.0a2
*{{done|}} [ashughes] Mac OS X 10.6: '''PASS'''  
** Target: Mozilla/5.0 (Windows NT 6.1; rv:8.0a2) Gecko/20110819 Firefox/8.0a2
*{{done|}} [ashughes] Mac OS X 10.7: '''PASS'''
* {{done|}} [ashughes] Mac OS X 10.6: '''PASS'''
*{{done|}} [ashughes] Ubuntu 11.04: '''PASS'''
** Source: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:7.0a2) Gecko/20110812 Firefox/7.0a2
*{{done|}} [ashughes] Ubuntu 11.04 64-bit: '''PASS'''  
** Target: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:8.0a2) Gecko/20110819 Firefox/8.0a2
*'''Reports''': [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=360 Litmus], [http://mozmill-release.brasstacks.mozilla.com/#/functional/reports?branch=8.0&platform=All&from=2011-10-12&to=2011-10-12 Mozmill]
* {{done|}} [ashughes] Ubuntu 11.04: '''PASS'''
** Source: Mozilla/5.0 (X11; Linux i686 on x86_64; rv:7.0a2) Gecko/20110814 Firefox/7.0a2
** Target: Mozilla/5.0 (X11; Linux i686 on x86_64; rv:8.0a2) Gecko/20110819 Firefox/8.0a2


; Issues Found
;Issues Found


== Beta 1 ==
=== Manual Tests ===
The following tasks need to be completed to sign-off the Beta merge
* {{ok|}} [ashughes] Automated Tests: [[#Automated_Tests_2|details]]
* {{ok|}} [softvision] Manual Tests: [[#Manual_Tests_2|details]]
* {{ok|}} [ashughes] Updates: [[#Updates_2|details]]


'''Builds''': [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/8.0b1-candidates/build1 Firefox 8.0b1(1)]<br>
;Smoketests
'''Litmus''':[https://litmus.mozilla.org/run_tests.cgi?test_run_id=351 testrun]<br>


=== Automated Tests ===
The following are the detailed results of the manual smoketests.  
The following are the detailed results of the automated BFT test runs.
* {{done|}} [ashughes] Windows 2000: '''PASS'''
* {{done|}} [ashughes] Windows XP: '''PASS'''
* {{done|}} [ashughes] Windows Vista: '''PASS'''
* {{done|}} [ashughes] Windows 7: '''PASS'''
* {{done|}} [ashughes] Windows 7 64-bit: '''PASS'''
* {{done|}} [ashughes] Mac OS X 10.6: '''PASS'''
* {{done|}} [ashughes] Mac OS X 10.7: '''PASS'''
* {{done|}} [ashughes] Ubuntu 11.04: '''PASS'''
* {{done|}} [ashughes] Ubuntu 11.04 64-bit: '''PASS'''
* '''Reports''': [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=351 Litmus], [http://mozmill-release.brasstacks.mozilla.com/#/functional/reports?branch=8.0&platform=All&from=2011-09-28&to=2011-09-30 Mozmill]


; Issues Found
*{{done|}} [Simona] Windows 2000: '''PASS'''
* Two tests are constantly failing and which need to be fixed as soon as possible.
*{{done|}} [AndreiD] Windows XP: '''PASS'''
*{{done|}} [Simona] Windows Vista: '''PASS'''
*{{done|}} [Mihaela] Windows 7: '''PASS'''
*{{done|}} [AndreiD] Windows 7 64-bit: '''PASS'''
*{{done|}} [VladG] Mac OS X 10.6: '''PASS'''
*{{done|}} [VladG] Mac OS X 10.7: '''PASS'''
*{{done|}} [Ioana] Ubuntu 11.04: '''PASS'''
*{{done|}} [Mihaela] Ubuntu 11.04 64-bit: '''PASS'''
*'''Litmus''' [https://litmus.mozilla.org/run_tests.cgi?test_run_id=360 testrun], [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=360 report]
*'''Firefox 8.0b3''' [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/8.0b3-candidates/build1 build1]


=== Manual Tests ===
;Exploratory Tests
; Smoketests
The following are the detailed results of the manual smoketests.
* {{done|}} [Simona] Windows 2000: '''PASS'''
* {{done|}} [Ioana] Windows XP: '''PASS'''
* {{done|}} [Simona] Windows Vista: '''PASS'''
* {{done|}} [Mihaela] Windows 7: '''PASS'''
* {{done|}} [Andrei] Windows 7 64-bit: '''PASS'''
* {{done|}} [VladG] Mac OS X 10.6: '''PASS'''
* {{done|}} [VladG] Mac OS X 10.7: '''PASS'''
* {{done|}} [Ioana] Ubuntu 11.04: '''PASS'''
* {{done|}} [Virgil] Ubuntu 11.04 64-bit: '''PASS'''
* '''Litmus''' [https://litmus.mozilla.org/run_tests.cgi?test_run_id=351 testrun], [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=351 report]
* '''Firefox 8.0b1''' [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/8.0b1-candidates/build1 build1]


; Exploratory Tests
The following are the detailed results of the exploratory testing - Web App compatibility  
The following are the detailed results of the exploratory testing - Web App compatibility
* {{done|}} [Simona] Windows 2000: '''PASS'''
* {{done|}} [Ioana] Windows XP: '''PASS'''
* {{done|}} [Simona] Windows Vista: '''PASS'''
* {{done|}} [Mihaela] Windows 7: '''PASS''' 
* {{done|}} [Andrei] Windows 7 64-bit: '''PASS'''
* {{done|}} [VladG] Mac OS X 10.6: '''PASS'''
* {{done|}} [VladG] Mac OS X 10.7: '''PASS'''
* {{done|}} [Ioana] Ubuntu 11.04: '''PASS'''
* {{done|}} [Virgil] Ubuntu 11.04 64-bit '''PASS'''
* '''Litmus''' [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=351 report]


; Issues Found
*{{done|}} [Simona] Windows 2000: '''PASS'''
* Html5
*{{done|}} [AndreiD] Windows XP: '''PASS'''
** {{Bug|690356}} - Lower half of html5 youtube videos flickers in full screen
*{{done|}} [Simona] Windows Vista: '''PASS'''
* Tab animation
*{{done|}} [Mihaela] Windows 7: '''PASS'''
** {{Bug|689554}} - The use of closing browser window shortcut key (ctrl+shift+w) while dnd a tab disturbs tab animation [NEW]
*{{done|}} [AndreiD] Windows 7 64-bit: '''PASS'''
** {{Bug|689566}} -  Keyboard shortcut cmd+shift+w disturbs tab animation - dnd a tab from a window to another window [mac] [NEW]
*{{done|}} [VladG] Mac OS X 10.6: '''PASS'''
** {{Bug|689575}} - Disable keyboard shortcuts while tab animation is active [NEW]
*{{done|}} [VladG] Mac OS X 10.7: '''PASS'''
** {{Bug|690341}} - Using the close tab option from the menu opens a new tab when dragging a tab [NEW]
*{{done|}} [Ioana] Ubuntu 11.04: '''PASS'''
*{{done|}} [Mihaela] Ubuntu 11.04 64-bit: '''PASS'''
*'''Litmus''' [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=360 report]


=== Updates ===
;Issues Found
The following are details of update verifications for Firefox 8 beta 1


'''Releasetest:''' [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=releasetest&from=2011-09-29&to=2011-09-29&target=8.0 report]
*{{bug|694288}} - Vimeo.com - embedded video player is not displayed on Windows 2000 (New)
* {{done|}} [ashughes] Windows 2000: '''PASS'''
* {{done|}} [ashughes] Windows XP: '''PASS'''
* {{done|}} [ashughes] Windows Vista: '''PASS'''
* {{done|}} [ashughes] Windows 7: '''PASS'''
* {{done|}} [ashughes] Windows 7 64-bit: '''PASS'''
* {{done|}} [ashughes] Mac OS X 10.6: '''PASS'''
* {{done|}} [ashughes] Mac OS X 10.7: '''PASS'''
* {{done|}} [ashughes] Ubuntu 11.04: '''PASS'''
* {{done|}} [ashughes] Ubuntu 11.04 64-bit: '''PASS'''


'''Beta:''' [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=beta&from=2011-09-29&to=2011-09-30&target=8.0 report]
;Dark Matter Addons
* {{done|}} [ashughes] Windows 2000: '''PASS'''
* {{done|}} [ashughes] Windows XP: '''PASS'''
* {{done|}} [ashughes] Windows Vista: '''PASS'''
* {{done|}} [ashughes] Windows 7: '''PASS'''
* {{done|}} [ashughes] Windows 7 64-bit: '''PASS'''
* {{done|}} [ashughes] Mac OS X 10.6: '''PASS'''
* {{done|}} [ashughes] Mac OS X 10.7: '''PASS'''
* {{done|}} [ashughes] Ubuntu 11.04: '''PASS'''
* {{done|}} [ashughes] Ubuntu 11.04 64-bit: '''PASS'''


; Issues Found
''(re: {{bug|693698}})'' -- Using this [https://docs.google.com/spreadsheet/ccc?key=0AhYIQk822ZJkdDZmczlmWllZWTVhby0xdjdtWC16bnc#gid=0 spreadsheet] -- test on 32-bit Windows only -- use this [https://etherpad.mozilla.org/dark-matter-addons etherpad] to record your results


== Beta 2 (build1) ==
*Pick an add-on and record it's name and URL from the spreadsheet to the etherpad
The following tasks need to be completed to sign-off the Beta merge
*Go to the URL and install the software package
* {{ok|}} [ashughes] Automated Tests: [[#Automated_Tests_2|details]]
**The notes will give you a hint of what to look for
* {{ok|}} [softvision] Manual Tests: [[#Manual_Tests_2|details]]
**There's some non-free software there, so we won't be able to get to all of them
* {{ok|}} [softvision] Bug fix verifications [[#Bug_Fix_Verification|details]]
*Once the software is installed, start Firefox
* {{ok|}} [ashughes] Updates: [[#Updates_2|details]]
**Firefox may need to be closed to install some of the software packages
*Open about:support and look for the name and ID of the new add-ons
**They should be recorded in the GUID section
*Look for the registry keys specified in [https://developer.mozilla.org/en/Adding_Extensions_using_the_Windows_Registry this article]  
**If there are registry keys for the add-on, enter ''Registry'' in the ''Installed in'' column
**If not, look in ''Program Files/Mozilla Firefox/extensions'' -- if the add-on is there, enter ''App Dir'' in the ''Installed in'' column
**If not, look in ''%Profile-Folder%/extensions'' -- if the add-on is there, enter ''Profile'' in the ''Installed in'' column


'''Builds''': [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/8.0b2-candidates/build1 Firefox 8.0b2(1)]<br>
Add notes if you have any problems getting to the extension or getting it installed in Firefox, or if additional add-ons are being installed by a single package. Anything that gives us an idea of why an add-on couldn't be tested, or other add-ons we should be concerned about.  
'''Litmus''':[https://litmus.mozilla.org/run_tests.cgi?test_run_id=355 testrun]<br>


=== Automated Tests ===
If you have any questions, please contact Andrew Williamson (eviljeff) on IRC in the #amo or #amo-editors channel.  
The following are the detailed results of the automated BFT test runs.
* {{done|}} [ashughes] Windows 2000: '''PASS'''
* {{done|}} [ashughes] Windows XP: '''PASS'''
* {{done|}} [ashughes] Windows Vista: '''PASS'''
* {{done|}} [ashughes] Windows 7: '''PASS'''
* {{done|}} [ashughes] Windows 7 64-bit: '''PASS'''
* {{done|}} [ashughes] Mac OS X 10.6: '''PASS'''
* {{done|}} [ashughes] Mac OS X 10.7: '''PASS'''
* {{done|}} [ashughes] Ubuntu 11.04: '''PASS'''
* {{done|}} [ashughes] Ubuntu 11.04 64-bit: '''PASS'''
* '''Reports''': [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=355 Litmus], [http://mozmill-release.brasstacks.mozilla.com/#/functional/reports?branch=8.0&platform=All&from=2011-10-06&to=2011-10-06 Mozmill]


; Issues Found
=== Bug Fix Verification  ===
* /restartTests/testAddons_installMultipleExtensions/test1.js is failing on Win XP


=== Manual Tests ===
Verify 100% QA+ bugs, as many as possible FIXED bugs
; Smoketests
The following are the detailed results of the manual smoketests.
* {{done|}} [Simona] Windows 2000: '''PASS'''
* {{done|}} [Ioana] Windows XP: '''PASS'''
* {{done|}} [Simona] Windows Vista: '''PASS'''
* {{done|}} [Mihaela] Windows 7: '''PASS'''
* {{done|}} [Mihaela] Windows 7 64-bit: '''PASS'''
* {{done|}} [VladG] Mac OS X 10.6: '''PASS'''
* {{done|}} [VladG] Mac OS X 10.7: '''PASS'''
* {{done|}} [Ioana] Ubuntu 11.04: '''PASS'''
* {{done|}} [Virgil] Ubuntu 11.04 64-bit: '''PASS'''
* '''Litmus''' [https://litmus.mozilla.org/run_tests.cgi?test_run_id=355 testrun], [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=355 report]
* '''Firefox 8.0b2''' [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/8.0b2-candidates/build1 build1]


; Exploratory Tests
*'''Bugs:''' [http://bit.ly/qTLvQZ QA+], [http://bit.ly/r4spto FIXED]  
The following are the detailed results of the exploratory testing - Web App compatibility
*Fixed bugs verification spreadsheet [http://bit.ly/qm2viL Link]
* {{done|}} [Simona] Windows 2000: '''PASS'''
* {{done|}} [Ioana] Windows XP: '''PASS'''
* {{done|}} [Simona] Windows Vista: '''PASS'''
* {{done|}} [Mihaela] Windows 7: '''PASS'''
* {{done|}} [Mihaela] Windows 7 64-bit: '''PASS'''
* {{done|}} [VladG] Mac OS X 10.6: '''PASS'''
* {{done|}} [VladG] Mac OS X 10.7: '''PASS'''
* {{done|}} [Ioana] Ubuntu 11.04: '''PASS'''
* {{done|}} [Virgil] Ubuntu 11.04 64-bit: '''PASS'''
* '''Litmus''' [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=355 report]


; Issues Found
=== Updates  ===
* {{bug|692418}} -Print error is triggered the first time when attempting to print a yahoo mail message (New)
* {{bug|692446}} -Firefox prompts to install windows media player plugin even though it is already installed (New)


=== Bug Fix Verification ===
The following are details of update verifications for Firefox 8 beta 3
* '''Release Driver:''' Triage these [http://bit.ly/pvrNS5 FIXED] bugs to build the [http://bit.ly/qLoCqW QA+] query
* '''Release Testers:''' Verify these [http://bit.ly/qLoCqW QA+] bugs 100%
* '''Results:''' [http://bit.ly/qm2viL spreadsheet]


=== Updates ===
'''Betatest''':
The following are details of update verifications for Firefox 8 beta 2


'''Betatest''':
*run some manual exploratory tests around updating with add-ons, plugins, session/profile data, etc  
* run some manual exploratory tests around updating with add-ons, plugins, session/profile data, etc
*How to set update channel to betatest:  
* How to set update channel to betatest:
**Find the defaults/prefs/channel-prefs.js file in your Firefox application folder  
** Find the defaults/prefs/channel-prefs.js file in your Firefox application folder
**Open it with a text editor and change the "beta" channel to "betatest", save and exit  
** Open it with a text editor and change the "beta" channel to "betatest", save and exit
**Start Firefox and check app.update.channel in about:config to verify it changed  
** Start Firefox and check app.update.channel in about:config to verify it changed
**'''NOTE:''' On Windows Vista and 7 will not let you save the changes unless you run your text editor as an Administrator -- do so by right clicking the launcher for the text editor and select "Run as Administrator"  
** '''NOTE:''' On Windows Vista and 7 will not let you save the changes unless you run your text editor as an Administrator -- do so by right clicking the launcher for the text editor and select "Run as Administrator"
*What to test  
* What to test
**Build a realistic amount of profile and session data on one of the previous betas (4.0b8 through 8.0b1):  
** Build a realistic amount of profile and session data on one of the previous betas (4.0b8 through 8.0b1):
**try installing several add-ons (some out of date)  
** try installing several add-ons (some out of date)
**try installing several plugins (some out of date)  
** try installing several plugins (some out of date)
**go to various top sites like Youtube, Banking sites, Social networks, news sites, games, webmail etc  
** go to various top sites like Youtube, Banking sites, Social networks, news sites, games, webmail etc
**put some of the tabs in App Tabs and Panorama groupings  
** put some of the tabs in App Tabs and Panorama groupings
**'''Ultimately''' just play around with your browser for an hour or so like you would on a day to day basis  
** '''Ultimately''' just play around with your browser for an hour or so like you would on a day to day basis
**After a while, check for and install the Firefox update to 8.0b2 and restart  
** After a while, check for and install the Firefox update to 8.0b2 and restart
*Result -- check after restart:  
* Result -- check after restart:
**no loss of session data  
** no loss of session data
**no loss of profile data  
** no loss of profile data
**no loss of history, bookmarks  
** no loss of history, bookmarks
**no loss of add-ons  
** no loss of add-ons
**no obvious breakage with Firefox and the sites you use most often  
** no obvious breakage with Firefox and the sites you use most often
*What to report  
* What to report
**File bugs using the [8b3] whiteboard tag
** File bugs using the [8b2] whiteboard tag


'''Exploratory testing'''


*{{done|}} [Simona] Windows XP:'''PASS'''
*{{done|}} [Ioana] Ubuntu 11.04 x86:'''PASS''' - with known issues: {{Bug|658913}}
*{{done|}} [Mihaela] Windows 7:'''PASS'''
*{{done|}} [VladG] MacOS X 10.6:'''PASS'''
**Exploratory work spreadsheet [http://bit.ly/qYqe5S Link]


'''Releasetest:''' [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=releasetest&from=2011-10-06&to=2011-10-06&target=8.0 report]
<br>
* {{done|}} [ashughes] Windows 2000: '''PASS'''
* {{done|}} [ashughes] Windows XP: '''PASS'''
* {{done|}} [ashughes] Windows Vista: '''PASS'''
* {{done|}} [ashughes] Windows 7: '''PASS'''
* {{done|}} [ashughes] Windows 7 64-bit: '''PASS'''
* {{done|}} [ashughes] Mac OS X 10.6: '''PASS'''
* {{done|}} [ashughes] Mac OS X 10.7: '''PASS'''
* {{done|}} [ashughes] Ubuntu 11.04: '''PASS'''
* {{done|}} [ashughes] Ubuntu 11.04 64-bit: '''PASS'''


'''Beta:''' [ report]
'''Releasetest:''' [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=releasetest&from=2011-10-13&to=2011-10-13&target=8.0 report]
* {{ok|}} [tester] Windows 2000: '''result'''
* {{ok|}} [tester] Windows XP: '''result'''
* {{ok|}} [tester] Windows Vista: '''result'''
* {{ok|}} [tester] Windows 7: '''result'''
* {{ok|}} [tester] Windows 7 64-bit: '''result'''
* {{ok|}} [tester] Mac OS X 10.6: '''result'''
* {{ok|}} [tester] Mac OS X 10.7: '''result'''
* {{ok|}} [tester] Ubuntu 11.04: '''result'''
* {{ok|}} [tester] Ubuntu 11.04 64-bit: '''result'''


; Issues Found
*{{done|}} [ashughes] Windows 2000: '''PASS'''
*{{done|}} [ashughes] Windows XP: '''PASS'''
*{{done|}} [ashughes] Windows Vista: '''PASS'''
*{{done|}} [ashughes] Windows 7: '''PASS'''
*{{done|}} [ashughes] Windows 7 64-bit: '''PASS'''
*{{done|}} [ashughes] Mac OS X 10.6: '''PASS'''
*{{done|}} [ashughes] Mac OS X 10.7: '''PASS'''
*{{done|}} [ashughes] Ubuntu 11.04: '''PASS'''
*{{done|}} [ashughes] Ubuntu 11.04 64-bit: '''PASS'''


== Beta 2 (build 2) ==
'''Beta:''' [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=beta&from=2011-10-07&to=2011-10-14&target=8.0 report]  
The following tasks need to be completed to sign-off on this beta milestone.
* {{ok|}} [ashughes] Automated Tests: [[#Automated_Tests_3|details]]
* {{ok|}} [softvision] Manual Tests: [[#Manual_Tests_3|details]]
* {{ok|}} [softvision] Bug fix verifications [[#Bug_Fix_Verification|details]]
* {{ok|}} [ashughes] Updates: [[#Updates_3|details]]


'''Builds''': [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/8.0b2-candidates/build2 Firefox 8.0b2(build 2)]<br>
*{{done|}} [ashughes] Windows 2000: '''PASS'''  
'''Litmus''':[https://litmus.mozilla.org/run_tests.cgi?test_run_id=356 testrun]<br>
*{{done|}} [ashughes] Windows XP: '''PASS'''
*{{done|}} [ashughes] Windows Vista: '''PASS'''
*{{done|}} [ashughes] Windows 7: '''PASS'''
*{{done|}} [ashughes] Windows 7 64-bit: '''PASS'''  
*{{done|}} [ashughes] Mac OS X 10.6: '''PASS'''
*{{done|}} [ashughes] Mac OS X 10.7: '''PASS'''
*{{done|}} [ashughes] Ubuntu 11.04: '''PASS'''
*{{done|}} [ashughes] Ubuntu 11.04 64-bit: '''PASS'''


=== Automated Tests ===
;Issues Found
The following are the detailed results of the automated BFT test runs.
* {{done|}} [ashughes] Windows 2000: '''RESULT'''
* {{done|}} [ashughes] Windows XP: '''RESULT'''
* {{done|}} [ashughes] Windows Vista: '''RESULT'''
* {{done|}} [ashughes] Windows 7: '''RESULT'''
* {{done|}} [ashughes] Windows 7 64-bit: '''RESULT'''
* {{done|}} [ashughes] Mac OS X 10.6: '''RESULT'''
* {{done|}} [ashughes] Mac OS X 10.7: '''RESULT'''
* {{done|}} [ashughes] Ubuntu 11.04: '''RESULT'''
* {{done|}} [ashughes] Ubuntu 11.04 64-bit: '''RESULT'''
* '''Reports''': [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=356 Litmus], [http://mozmill-release.brasstacks.mozilla.com/#/functional/reports?branch=8.0&platform=All&from=2011-10-07&to=2011-10-07 Mozmill]


; Issues Found
== Beta 4 ==
* /testSecurity/testSubmitUnencryptedInfoWarning.js failed on Mac 10.7 and Windows 2000
* /restartTests/testAddons_installMultipleExtensions failed on Mac 10.7
* /testTabbedBrowsing/testBackgroundTabScrolling.js failed on Windows Vista


=== Manual Tests ===
The following tasks need to be completed to sign-off the Beta merge
; Smoketests
The following are the detailed results of the manual smoketests.
* {{done|}} [Simona] Windows 2000: '''RESULT'''
* {{done|}} [Ioana] Windows XP: '''RESULT'''
* {{done|}} [Simona] Windows Vista: '''RESULT'''
* {{done|}} [Mihaela] Windows 7: '''RESULT'''
* {{done|}} [Mihaela] Windows 7 64-bit: '''RESULT'''
* {{done|}} [VladG] Mac OS X 10.6: '''RESULT'''
* {{done|}} [VladG] Mac OS X 10.7: '''RESULT'''
* {{done|}} [Ioana] Ubuntu 11.04: '''RESULT'''
* {{done|}} [Virgil] Ubuntu 11.04 64-bit: '''RESULT'''
* '''Litmus''' [https://litmus.mozilla.org/run_tests.cgi?test_run_id=356 testrun], [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=356 report]
* '''Firefox 8.0b2''' [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/8.0b2-candidates/build2 build2]


; Exploratory Tests
*{{ok|}} [ashughes] Automated Tests: [[#Automated_Tests_4|details]]  
The following are the detailed results of the exploratory testing - Web App compatibility
*{{ok|}} [softvision] Manual Tests: [[#Manual_Tests_4|details]]  
* {{done|}} [Simona] Windows 2000: '''RESULT'''
*{{ok|}} [softvision] Bug fix verifications [[#Bug_Fix_Verification|details]]  
* {{done|}} [Ioana] Windows XP: '''RESULT'''
*{{ok|}} [ashughes] Updates: [[#Updates_4|details]]
* {{done|}} [Simona] Windows Vista: '''RESULT'''
* {{done|}} [Mihaela] Windows 7: '''RESULT'''
* {{done|}} [Mihaela] Windows 7 64-bit: '''RESULT'''
* {{done|}} [VladG] Mac OS X 10.6: '''RESULT'''
* {{done|}} [VladG] Mac OS X 10.7: '''RESULT'''
* {{done|}} [Ioana] Ubuntu 11.04: '''RESULT'''
* {{done|}} [Virgil] Ubuntu 11.04 64-bit: '''RESULT'''
* '''Litmus''' [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=356 report]


; Issues Found
'''Builds''': [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/8.0b4-candidates/build1 Firefox 8.0b4(build1)]<br> '''Litmus''':[https://litmus.mozilla.org/run_tests.cgi?test_run_id=361 testrun]<br>
* {{bug|692418}} -Print error is triggered the first time when attempting to print a yahoo mail message (New)
* {{bug|692446}} -Firefox prompts to install windows media player plugin even though it is already installed (New)


=== Bug Fix Verification ===
=== Automated Tests  ===
Verify 100% QA+ bugs, as many as possible FIXED bugs
* '''Bugs:''' [http://bit.ly/qTLvQZ QA+], [http://bit.ly/pvrNS5 FIXED]
* Fixed bugs verification spreadsheet [http://bit.ly/qm2viL Link]


=== Updates ===
The following are the detailed results of the automated BFT test runs.
The following are details of update verifications for Firefox 8 beta 2


'''Betatest''':
*{{done|}} [ashughes] Windows 2000: '''PASS'''  
* run some manual exploratory tests around updating with add-ons, plugins, session/profile data, etc
*{{done|}} [ashughes] Windows XP: '''PASS'''
* How to set update channel to betatest:
*{{done|}} [ashughes] Windows Vista: '''PASS'''
** Find the defaults/prefs/channel-prefs.js file in your Firefox application folder
*{{done|}} [ashughes] Windows 7: '''PASS'''
** Open it with a text editor and change the "beta" channel to "betatest", save and exit
*{{done|}} [ashughes] Windows 7 64-bit: '''PASS'''
** Start Firefox and check app.update.channel in about:config to verify it changed
*{{done|}} [ashughes] Mac OS X 10.6: '''PASS'''
** '''NOTE:''' On Windows Vista and 7 will not let you save the changes unless you run your text editor as an Administrator -- do so by right clicking the launcher for the text editor and select "Run as Administrator"
*{{done|}} [ashughes] Mac OS X 10.7: '''PASS'''  
* What to test
*{{done|}} [ashughes] Ubuntu 11.04: '''PASS'''
** Build a realistic amount of profile and session data on one of the previous betas (4.0b8 through 8.0b1):
*{{done|}} [ashughes] Ubuntu 11.04 64-bit: '''PASS'''
** try installing several add-ons (some out of date)
*'''Reports''': [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=361 Litmus], [http://mozmill-release.brasstacks.mozilla.com/#/functional/reports?branch=8.0&platform=All&from=2011-10-19&to=2011-10-20 Mozmill]
** try installing several plugins (some out of date)
** go to various top sites like Youtube, Banking sites, Social networks, news sites, games, webmail etc
** put some of the tabs in App Tabs and Panorama groupings
** '''Ultimately''' just play around with your browser for an hour or so like you would on a day to day basis
** After a while, check for and install the Firefox update to 8.0b2 and restart
* Result -- check after restart:
** no loss of session data
** no loss of profile data
** no loss of history, bookmarks
** no loss of add-ons
** no obvious breakage with Firefox and the sites you use most often
* What to report
** File bugs using the [8b2] whiteboard tag


'''Exploratory testing'''
;Issues Found
* {{done|}} [Simona] Windows XP:'''PASS'''
* {{done|}} [Virgil] Ubuntu 11.04 x64:'''PASS'''
* {{done|}} [Ioana] Windows 7:'''PASS'''
* {{done|}} [VladG] MacOS X 10.6:'''PASS'''
** Exploratory work spreadsheet [http://bit.ly/qYqe5S Link]


'''Releasetest:''' [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=releasetest&from=2011-10-07&to=2011-10-08&target=8.0 report]
=== Manual Tests  ===
* {{done|}} [ashughes] Windows 2000: '''PASS'''
* {{done|}} [ashughes] Windows XP: '''PASS'''
* {{done|}} [ashughes] Windows Vista: '''PASS'''
* {{done|}} [ashughes] Windows 7: '''PASS'''
* {{done|}} [ashughes] Windows 7 64-bit: '''PASS'''
* {{done|}} [ashughes] Mac OS X 10.6: '''PASS'''
* {{done|}} [ashughes] Mac OS X 10.7: '''PASS'''
* {{done|}} [ashughes] Ubuntu 11.04: '''PASS'''
* {{done|}} [ashughes] Ubuntu 11.04 64-bit: '''PASS'''


'''Beta:''' [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=beta&from=2011-10-03&to=2011-10-10&target=8.0 report]
;Smoketests
* {{ok|}} [tester] Windows 2000: '''PASS'''
* {{ok|}} [tester] Windows XP: '''PASS'''
* {{ok|}} [tester] Windows Vista: '''PASS'''
* {{ok|}} [tester] Windows 7: '''PASS'''
* {{ok|}} [tester] Windows 7 64-bit: '''PASS'''
* {{ok|}} [tester] Mac OS X 10.6: '''PASS'''
* {{ok|}} [tester] Mac OS X 10.7: '''PASS'''
* {{ok|}} [tester] Ubuntu 11.04: '''PASS'''
* {{ok|}} [tester] Ubuntu 11.04 64-bit: '''PASS'''


; Issues Found
The following are the detailed results of the manual smoketests.  
* There were three failures in the automation, which I wasn't able to reproduce manually (juanb).


== Beta 3 ==
*{{done|}} [Simona] Windows 2000: '''PASS'''
The following tasks need to be completed to sign-off the Beta merge
*{{done|}} [AndreiD] Windows XP: '''PASS'''
* {{ok|}} [ashughes] Automated Tests: [[#Automated_Tests_3|details]]
*{{done|}} [Simona] Windows Vista: '''PASS'''
* {{ok|}} [softvision] Manual Tests: [[#Manual_Tests_3|details]]
*{{done|}} [Mihaela] Windows 7: '''PASS'''
* {{ok|}} [softvision] Bug fix verifications [[#Bug_Fix_Verification|details]]
*{{done|}} [Paul] Windows 7 64-bit: '''PASS'''
* {{ok|}} [ashughes] Updates: [[#Updates_3|details]]
*{{done|}} [VladG] Mac OS X 10.6: '''PASS'''
*{{done|}} [VladG] Mac OS X 10.7: '''PASS'''
*{{done|}} [Virgil] Ubuntu 11.04: '''PASS'''
*{{done|}} [Virgil] Ubuntu 11.10 64-bit: '''PASS'''
*'''Litmus''' [https://litmus.mozilla.org/run_tests.cgi?test_run_id=361 testrun], [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=361 report]  
*'''Firefox 8.0b4''' [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/8.0b4-candidates/build1 build1]


'''Builds''': [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/8.0b3-candidates/build1 Firefox 8.0b3(build1)]<br>
;Exploratory Tests
'''Litmus''':[https://litmus.mozilla.org/run_tests.cgi?test_run_id=360 testrun]<br>


=== Automated Tests ===
The following are the detailed results of the exploratory testing - Web App compatibility
The following are the detailed results of the automated BFT test runs.
* {{done|}} [ashughes] Windows 2000: '''PASS'''
* {{done|}} [ashughes] Windows XP: '''PASS'''
* {{done|}} [ashughes] Windows Vista: '''PASS'''
* {{done|}} [ashughes] Windows 7: '''PASS'''
* {{done|}} [ashughes] Windows 7 64-bit: '''PASS'''
* {{done|}} [ashughes] Mac OS X 10.6: '''PASS'''
* {{done|}} [ashughes] Mac OS X 10.7: '''PASS'''
* {{done|}} [ashughes] Ubuntu 11.04: '''PASS'''
* {{done|}} [ashughes] Ubuntu 11.04 64-bit: '''PASS'''
* '''Reports''': [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=360 Litmus], [http://mozmill-release.brasstacks.mozilla.com/#/functional/reports?branch=8.0&platform=All&from=2011-10-12&to=2011-10-12 Mozmill]


; Issues Found
*{{done|}} [Simona] Windows 2000: '''PASS'''
*{{done|}} [AndreiD] Windows XP: '''PASS'''
*{{done|}} [Simona] Windows Vista: '''PASS'''
*{{done|}} [Mihaela] Windows 7: '''PASS'''
*{{done|}} [Paul] Windows 7 64-bit: '''PASS'''
*{{done|}} [VladG] Mac OS X 10.6: '''PASS'''
*{{done|}} [VladG] Mac OS X 10.7: '''PASS'''
*{{done|}} [Virgil] Ubuntu 11.04: '''PASS'''
*{{done|}} [Virgil] Ubuntu 11.10 64-bit: '''PASS'''
*'''Litmus''' [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=361 report]


=== Manual Tests ===
;Issues Found
; Smoketests
The following are the detailed results of the manual smoketests.
* {{done|}} [Simona] Windows 2000: '''PASS'''
* {{done|}} [AndreiD] Windows XP: '''PASS'''
* {{done|}} [Simona] Windows Vista: '''PASS'''
* {{done|}} [Mihaela] Windows 7: '''PASS'''
* {{done|}} [AndreiD] Windows 7 64-bit: '''PASS'''
* {{done|}} [VladG] Mac OS X 10.6: '''PASS'''
* {{done|}} [VladG] Mac OS X 10.7: '''PASS'''
* {{done|}} [Ioana] Ubuntu 11.04: '''PASS'''
* {{done|}} [Mihaela] Ubuntu 11.04 64-bit: '''PASS'''
* '''Litmus''' [https://litmus.mozilla.org/run_tests.cgi?test_run_id=360 testrun], [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=360 report]
* '''Firefox 8.0b3''' [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/8.0b3-candidates/build1 build1]


; Exploratory Tests
{{bug|696096}} Items are not shown correctly in shopping cart [NEW]  
The following are the detailed results of the exploratory testing - Web App compatibility
* {{done|}} [Simona] Windows 2000: '''PASS'''
* {{done|}} [AndreiD] Windows XP: '''PASS'''
* {{done|}} [Simona] Windows Vista: '''PASS'''
* {{done|}} [Mihaela] Windows 7: '''PASS'''
* {{done|}} [AndreiD] Windows 7 64-bit: '''PASS'''
* {{done|}} [VladG] Mac OS X 10.6: '''PASS'''
* {{done|}} [VladG] Mac OS X 10.7: '''PASS'''
* {{done|}} [Ioana] Ubuntu 11.04: '''PASS'''
* {{done|}} [Mihaela] Ubuntu 11.04 64-bit: '''PASS'''
* '''Litmus''' [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=360 report]


; Issues Found
=== Bug Fix Verification  ===
* {{bug|694288}} - Vimeo.com - embedded video player is not displayed on Windows 2000 (New)


; Dark Matter Addons
Verify 100% QA+ bugs, as many as possible FIXED bugs
''(re: {{bug|693698}})'' -- Using this [https://docs.google.com/spreadsheet/ccc?key=0AhYIQk822ZJkdDZmczlmWllZWTVhby0xdjdtWC16bnc#gid=0 spreadsheet] -- test on 32-bit Windows only -- use this [https://etherpad.mozilla.org/dark-matter-addons etherpad] to record your results
* Pick an add-on and record it's name and URL from the spreadsheet to the etherpad
* Go to the URL and install the software package
** The notes will give you a hint of what to look for
** There's some non-free software there, so we won't be able to get to all of them
* Once the software is installed, start Firefox
** Firefox may need to be closed to install some of the software packages
* Open about:support and look for the name and ID of the new add-ons
** They should be recorded in the GUID section
* Look for the registry keys specified in [https://developer.mozilla.org/en/Adding_Extensions_using_the_Windows_Registry this article]
** If there are registry keys for the add-on, enter ''Registry'' in the ''Installed in'' column
** If not, look in ''Program Files/Mozilla Firefox/extensions'' -- if the add-on is there, enter ''App Dir'' in the ''Installed in'' column
** If not, look in ''%Profile-Folder%/extensions'' -- if the add-on is there, enter ''Profile'' in the ''Installed in'' column


Add notes if you have any problems getting to the extension or getting it installed in Firefox, or if additional add-ons are being installed by a single package. Anything that gives us an idea of why an add-on couldn't be tested, or other add-ons we should be concerned about.
*'''Bugs:''' [http://bit.ly/qTLvQZ QA+], [http://bit.ly/pvrNS5 FIXED]
*Fixed bugs verification spreadsheet [http://bit.ly/oPfcrp Link]


If you have any questions, please contact Andrew Williamson (eviljeff) on IRC in the #amo or #amo-editors channel.
=== Updates  ===


=== Bug Fix Verification ===
The following are details of update verifications for Firefox 8 beta 4
Verify 100% QA+ bugs, as many as possible FIXED bugs
* '''Bugs:''' [http://bit.ly/qTLvQZ QA+], [http://bit.ly/r4spto FIXED]
* Fixed bugs verification spreadsheet [http://bit.ly/qm2viL Link]


=== Updates ===
'''Betatest''':
The following are details of update verifications for Firefox 8 beta 3


'''Betatest''':
*run some manual exploratory tests around updating with add-ons, plugins, session/profile data, etc  
* run some manual exploratory tests around updating with add-ons, plugins, session/profile data, etc
*How to set update channel to betatest:  
* How to set update channel to betatest:
**Find the defaults/prefs/channel-prefs.js file in your Firefox application folder  
** Find the defaults/prefs/channel-prefs.js file in your Firefox application folder
**Open it with a text editor and change the "beta" channel to "betatest", save and exit  
** Open it with a text editor and change the "beta" channel to "betatest", save and exit
**Start Firefox and check app.update.channel in about:config to verify it changed  
** Start Firefox and check app.update.channel in about:config to verify it changed
**'''NOTE:''' On Windows Vista and 7 will not let you save the changes unless you run your text editor as an Administrator -- do so by right clicking the launcher for the text editor and select "Run as Administrator"  
** '''NOTE:''' On Windows Vista and 7 will not let you save the changes unless you run your text editor as an Administrator -- do so by right clicking the launcher for the text editor and select "Run as Administrator"
*What to test  
* What to test
**Build a realistic amount of profile and session data on one of the previous betas (4.0b8 through 8.0b4):  
** Build a realistic amount of profile and session data on one of the previous betas (4.0b8 through 8.0b1):
**try installing several add-ons (some out of date)  
** try installing several add-ons (some out of date)
**try installing several plugins (some out of date)  
** try installing several plugins (some out of date)
**go to various top sites like Youtube, Banking sites, Social networks, news sites, games, webmail etc  
** go to various top sites like Youtube, Banking sites, Social networks, news sites, games, webmail etc
**put some of the tabs in App Tabs and Panorama groupings  
** put some of the tabs in App Tabs and Panorama groupings
**'''Ultimately''' just play around with your browser for an hour or so like you would on a day to day basis  
** '''Ultimately''' just play around with your browser for an hour or so like you would on a day to day basis
**After a while, check for and install the Firefox update to 8.0b4 and restart  
** After a while, check for and install the Firefox update to 8.0b2 and restart
*Result -- check after restart:  
* Result -- check after restart:
**no loss of session data  
** no loss of session data
**no loss of profile data  
** no loss of profile data
**no loss of history, bookmarks  
** no loss of history, bookmarks
**no loss of add-ons  
** no loss of add-ons
**no obvious breakage with Firefox and the sites you use most often  
** no obvious breakage with Firefox and the sites you use most often
*What to report  
* What to report
**File bugs using the [8b4] whiteboard tag
** File bugs using the [8b3] whiteboard tag
'''Exploratory testing'''
* {{done|}} [Simona] Windows XP:'''PASS'''
* {{done|}} [Ioana] Ubuntu 11.04 x86:'''PASS''' - with known issues: {{Bug|658913}}
* {{done|}} [Mihaela] Windows 7:'''PASS'''
* {{done|}} [VladG] MacOS X 10.6:'''PASS'''
** Exploratory work spreadsheet [http://bit.ly/qYqe5S Link]


'''Exploratory testing'''


*{{done|}} [Andrei] Windows XP:'''PASS'''
*{{done|}} [Virgil] Ubuntu 11.04 x86:'''PASS'''
*{{done|}} [Mihaela] Windows 7:'''PASS'''
*{{done|}} [VladG] MacOS X 10.6:'''PASS'''
**Exploratory work spreadsheet [http://bit.ly/oh5gNU Link]


'''Releasetest:''' [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=releasetest&from=2011-10-13&to=2011-10-13&target=8.0 report]
<br>
* {{done|}} [ashughes] Windows 2000: '''PASS'''
* {{done|}} [ashughes] Windows XP: '''PASS'''
* {{done|}} [ashughes] Windows Vista: '''PASS'''
* {{done|}} [ashughes] Windows 7: '''PASS'''
* {{done|}} [ashughes] Windows 7 64-bit: '''PASS'''
* {{done|}} [ashughes] Mac OS X 10.6: '''PASS'''
* {{done|}} [ashughes] Mac OS X 10.7: '''PASS'''
* {{done|}} [ashughes] Ubuntu 11.04: '''PASS'''
* {{done|}} [ashughes] Ubuntu 11.04 64-bit: '''PASS'''


'''Beta:''' [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=beta&from=2011-10-07&to=2011-10-14&target=8.0 report]
'''Releasetest:''' [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=releasetest&from=2011-10-19&to=2011-10-20&target=8.0 report]  
* {{done|}} [ashughes] Windows 2000: '''PASS'''
* {{done|}} [ashughes] Windows XP: '''PASS'''
* {{done|}} [ashughes] Windows Vista: '''PASS'''
* {{done|}} [ashughes] Windows 7: '''PASS'''
* {{done|}} [ashughes] Windows 7 64-bit: '''PASS'''
* {{done|}} [ashughes] Mac OS X 10.6: '''PASS'''
* {{done|}} [ashughes] Mac OS X 10.7: '''PASS'''
* {{done|}} [ashughes] Ubuntu 11.04: '''PASS'''
* {{done|}} [ashughes] Ubuntu 11.04 64-bit: '''PASS'''


; Issues Found
*{{done|}} [ashughes] Windows 2000: '''PASS'''
*{{done|}} [ashughes] Windows XP: '''PASS'''
*{{done|}} [ashughes] Windows Vista: '''PASS'''
*{{done|}} [ashughes] Windows 7: '''PASS'''
*{{done|}} [ashughes] Windows 7 64-bit: '''PASS'''
*{{done|}} [ashughes] Mac OS X 10.6: '''PASS'''
*{{done|}} [ashughes] Mac OS X 10.7: '''PASS'''
*{{done|}} [ashughes] Ubuntu 11.04: '''PASS'''
*{{done|}} [ashughes] Ubuntu 11.04 64-bit: '''PASS'''


== Beta 4 ==
'''Beta:''' [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=beta&from=2011-10-19&to=2011-10-21&target=8.0 report]  
The following tasks need to be completed to sign-off the Beta merge
* {{ok|}} [ashughes] Automated Tests: [[#Automated_Tests_4|details]]
* {{ok|}} [softvision] Manual Tests: [[#Manual_Tests_4|details]]
* {{ok|}} [softvision] Bug fix verifications [[#Bug_Fix_Verification|details]]
* {{ok|}} [ashughes] Updates: [[#Updates_4|details]]


'''Builds''': [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/8.0b4-candidates/build1 Firefox 8.0b4(build1)]<br>
*{{done|}} [ashughes] Windows 2000: '''PASS'''  
'''Litmus''':[https://litmus.mozilla.org/run_tests.cgi?test_run_id=361 testrun]<br>
*{{done|}} [ashughes] Windows XP: '''PASS'''
*{{done|}} [ashughes] Windows Vista: '''PASS'''
*{{done|}} [ashughes] Windows 7: '''PASS'''
*{{done|}} [ashughes] Windows 7 64-bit: '''PASS'''  
*{{done|}} [ashughes] Mac OS X 10.6: '''PASS'''
*{{done|}} [ashughes] Mac OS X 10.7: '''PASS'''
*{{done|}} [ashughes] Ubuntu 11.04: '''PASS'''
*{{done|}} [ashughes] Ubuntu 11.04 64-bit: '''PASS'''


=== Automated Tests ===
;Issues Found
The following are the detailed results of the automated BFT test runs.
* {{done|}} [ashughes] Windows 2000: '''PASS'''
* {{done|}} [ashughes] Windows XP: '''PASS'''
* {{done|}} [ashughes] Windows Vista: '''PASS'''
* {{done|}} [ashughes] Windows 7: '''PASS'''
* {{done|}} [ashughes] Windows 7 64-bit: '''PASS'''
* {{done|}} [ashughes] Mac OS X 10.6: '''PASS'''
* {{done|}} [ashughes] Mac OS X 10.7: '''PASS'''
* {{done|}} [ashughes] Ubuntu 11.04: '''PASS'''
* {{done|}} [ashughes] Ubuntu 11.04 64-bit: '''PASS'''
* '''Reports''': [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=361 Litmus], [http://mozmill-release.brasstacks.mozilla.com/#/functional/reports?branch=8.0&platform=All&from=2011-10-19&to=2011-10-20 Mozmill]


; Issues Found
== Beta 5  ==


=== Manual Tests ===
The following tasks need to be completed to sign-off the Beta merge
; Smoketests
The following are the detailed results of the manual smoketests.
* {{done|}} [Simona] Windows 2000: '''PASS'''
* {{done|}} [AndreiD] Windows XP: '''PASS'''
* {{done|}} [Simona] Windows Vista: '''PASS'''
* {{done|}} [Mihaela] Windows 7: '''PASS'''
* {{done|}} [Paul] Windows 7 64-bit: '''PASS'''
* {{done|}} [VladG] Mac OS X 10.6: '''PASS'''
* {{done|}} [VladG] Mac OS X 10.7: '''PASS'''
* {{done|}} [Virgil] Ubuntu 11.04: '''PASS'''
* {{done|}} [Virgil] Ubuntu 11.10 64-bit: '''PASS'''
* '''Litmus''' [https://litmus.mozilla.org/run_tests.cgi?test_run_id=361 testrun], [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=361 report]
* '''Firefox 8.0b4''' [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/8.0b4-candidates/build1 build1]


; Exploratory Tests
*{{ok|}} [ashughes] Automated Tests: [[#Automated_Tests_5|details]]  
The following are the detailed results of the exploratory testing - Web App compatibility
*{{ok|}} [softvision] Manual Tests: [[#Manual_Tests_5|details]]  
* {{done|}} [Simona] Windows 2000: '''PASS'''
*{{ok|}} [softvision] Bug fix verifications [[#Bug_Fix_Verification|details]]  
* {{done|}} [AndreiD] Windows XP: '''PASS'''
*{{ok|}} [ashughes] Updates: [[#Updates_5|details]]
* {{done|}} [Simona] Windows Vista: '''PASS'''
* {{done|}} [Mihaela] Windows 7: '''PASS'''
* {{done|}} [Paul] Windows 7 64-bit: '''PASS'''
* {{done|}} [VladG] Mac OS X 10.6: '''PASS'''
* {{done|}} [VladG] Mac OS X 10.7: '''PASS'''
* {{done|}} [Virgil] Ubuntu 11.04: '''PASS'''
* {{done|}} [Virgil] Ubuntu 11.10 64-bit: '''PASS'''
* '''Litmus''' [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=361 report]
; Issues Found
{{bug|696096}} Items are not shown correctly in shopping cart [NEW]


=== Bug Fix Verification ===
'''Builds''': [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/8.0b5-candidates/build1 Firefox 8.0b5(build1)]<br> '''Litmus''':[https://litmus.mozilla.org/run_tests.cgi?test_run_id=362 testrun]<br>
Verify 100% QA+ bugs, as many as possible FIXED bugs
* '''Bugs:''' [http://bit.ly/qTLvQZ QA+], [http://bit.ly/pvrNS5 FIXED]
* Fixed bugs verification spreadsheet [http://bit.ly/oPfcrp Link]


=== Updates ===
=== Automated Tests  ===
The following are details of update verifications for Firefox 8 beta 4


'''Betatest''':
The following are the detailed results of the automated BFT test runs.  
* run some manual exploratory tests around updating with add-ons, plugins, session/profile data, etc
* How to set update channel to betatest:
** Find the defaults/prefs/channel-prefs.js file in your Firefox application folder
** Open it with a text editor and change the "beta" channel to "betatest", save and exit
** Start Firefox and check app.update.channel in about:config to verify it changed
** '''NOTE:''' On Windows Vista and 7 will not let you save the changes unless you run your text editor as an Administrator -- do so by right clicking the launcher for the text editor and select "Run as Administrator"
* What to test
** Build a realistic amount of profile and session data on one of the previous betas (4.0b8 through 8.0b4):
** try installing several add-ons (some out of date)
** try installing several plugins (some out of date)
** go to various top sites like Youtube, Banking sites, Social networks, news sites, games, webmail etc
** put some of the tabs in App Tabs and Panorama groupings
** '''Ultimately''' just play around with your browser for an hour or so like you would on a day to day basis
** After a while, check for and install the Firefox update to 8.0b4 and restart
* Result -- check after restart:
** no loss of session data
** no loss of profile data
** no loss of history, bookmarks
** no loss of add-ons
** no obvious breakage with Firefox and the sites you use most often
* What to report
** File bugs using the [8b4] whiteboard tag


'''Exploratory testing'''
*{{done|}} [ashughes] Windows 2000: '''PASS'''  
* {{done|}} [Andrei] Windows XP:'''PASS'''
*{{done|}} [ashughes] Windows XP: '''PASS'''  
* {{done|}} [Virgil] Ubuntu 11.04 x86:'''PASS'''  
*{{done|}} [ashughes] Windows Vista: '''PASS'''
* {{done|}} [Mihaela] Windows 7:'''PASS'''
*{{done|}} [ashughes] Windows 7: '''PASS'''  
* {{done|}} [VladG] MacOS X 10.6:'''PASS'''
*{{done|}} [ashughes] Windows 7 64-bit: '''PASS'''  
** Exploratory work spreadsheet [http://bit.ly/oh5gNU Link]
*{{done|}} [ashughes] Mac OS X 10.6: '''PASS'''  
*{{done|}} [ashughes] Mac OS X 10.7: '''PASS'''
*{{done|}} [ashughes] Ubuntu 11.04: '''PASS'''
*{{done|}} [ashughes] Ubuntu 11.04 64-bit: '''PASS'''
*'''Reports''': [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=362 Litmus], [http://mozmill-release.brasstacks.mozilla.com/#/functional/reports?branch=8.0&platform=All&from=2011-10-26&to=2011-10-28 Mozmill]


;Issues Found


=== Manual Tests  ===


'''Releasetest:''' [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=releasetest&from=2011-10-19&to=2011-10-20&target=8.0 report]
;Smoketests
* {{done|}} [ashughes] Windows 2000: '''PASS'''
* {{done|}} [ashughes] Windows XP: '''PASS'''
* {{done|}} [ashughes] Windows Vista: '''PASS'''
* {{done|}} [ashughes] Windows 7: '''PASS'''
* {{done|}} [ashughes] Windows 7 64-bit: '''PASS'''
* {{done|}} [ashughes] Mac OS X 10.6: '''PASS'''
* {{done|}} [ashughes] Mac OS X 10.7: '''PASS'''
* {{done|}} [ashughes] Ubuntu 11.04: '''PASS'''
* {{done|}} [ashughes] Ubuntu 11.04 64-bit: '''PASS'''


'''Beta:''' [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=beta&from=2011-10-19&to=2011-10-21&target=8.0 report]
The following are the detailed results of the manual smoketests.  
* {{done|}} [ashughes] Windows 2000: '''PASS'''
* {{done|}} [ashughes] Windows XP: '''PASS'''
* {{done|}} [ashughes] Windows Vista: '''PASS'''
* {{done|}} [ashughes] Windows 7: '''PASS'''
* {{done|}} [ashughes] Windows 7 64-bit: '''PASS'''
* {{done|}} [ashughes] Mac OS X 10.6: '''PASS'''
* {{done|}} [ashughes] Mac OS X 10.7: '''PASS'''
* {{done|}} [ashughes] Ubuntu 11.04: '''PASS'''
* {{done|}} [ashughes] Ubuntu 11.04 64-bit: '''PASS'''


; Issues Found
*{{done|}} [Simona] Windows 2000: '''PASS'''
*{{done|}} [Ioana] Windows XP: '''PASS'''
*{{done|}} [Simona] Windows Vista: '''PASS'''
*{{done|}} [AndreiD] Windows 7: '''PASS'''
*{{done|}} [AndreiD] Windows 7 64-bit: '''PASS'''
*{{done|}} [VladG] Mac OS X 10.6: '''PASS'''
*{{done|}} [VladG] Mac OS X 10.7: '''PASS'''
*{{done|}} [Mihaela] Ubuntu 11.04: '''PASS'''
*{{done|}} [Virgil] Ubuntu 11.10 64-bit: '''PASS'''
*'''Litmus''' [https://litmus.mozilla.org/run_tests.cgi?test_run_id=362 testrun], [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=362 report]
*'''Firefox 8.0b5''' [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/8.0b5-candidates/build1 build1]


== Beta 5 ==
;Exploratory Tests
The following tasks need to be completed to sign-off the Beta merge
* {{ok|}} [ashughes] Automated Tests: [[#Automated_Tests_5|details]]
* {{ok|}} [softvision] Manual Tests: [[#Manual_Tests_5|details]]
* {{ok|}} [softvision] Bug fix verifications [[#Bug_Fix_Verification|details]]
* {{ok|}} [ashughes] Updates: [[#Updates_5|details]]


'''Builds''': [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/8.0b5-candidates/build1 Firefox 8.0b5(build1)]<br>
The following are the detailed results of the exploratory testing - Web App compatibility
'''Litmus''':[https://litmus.mozilla.org/run_tests.cgi?test_run_id=362 testrun]<br>


=== Automated Tests ===
*{{done|}} [Simona] Windows 2000: '''PASS'''  
The following are the detailed results of the automated BFT test runs.
*{{done|}} [Ioana] Windows XP: '''PASS'''  
* {{done|}} [ashughes] Windows 2000: '''PASS'''
*{{done|}} [Simona] Windows Vista: '''PASS'''  
* {{done|}} [ashughes] Windows XP: '''PASS'''
*{{done|}} [AndreiD] Windows 7: '''PASS'''  
* {{done|}} [ashughes] Windows Vista: '''PASS'''
*{{done|}} [AndreiD] Windows 7 64-bit: '''PASS'''  
* {{done|}} [ashughes] Windows 7: '''PASS'''
*{{done|}} [VladG] Mac OS X 10.6: '''PASS'''  
* {{done|}} [ashughes] Windows 7 64-bit: '''PASS'''
*{{done|}} [VladG] Mac OS X 10.7: '''PASS'''  
* {{done|}} [ashughes] Mac OS X 10.6: '''PASS'''
*{{done|}} [Mihaela] Ubuntu 11.04: '''PASS'''  
* {{done|}} [ashughes] Mac OS X 10.7: '''PASS'''
*{{done|}} [Virgil] Ubuntu 11.04 64-bit: '''PASS'''  
* {{done|}} [ashughes] Ubuntu 11.04: '''PASS'''
*'''Litmus''' [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=362 report]
* {{done|}} [ashughes] Ubuntu 11.04 64-bit: '''PASS'''
* '''Reports''': [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=362 Litmus], [http://mozmill-release.brasstacks.mozilla.com/#/functional/reports?branch=8.0&platform=All&from=2011-10-26&to=2011-10-28 Mozmill]


; Issues Found
*{{done|}} [gmontagu] Windows 7, es-AR: '''PASS'''


=== Manual Tests ===
;Issues Found
; Smoketests
The following are the detailed results of the manual smoketests.
* {{done|}} [Simona] Windows 2000: '''PASS'''
* {{done|}} [Ioana] Windows XP: '''PASS'''
* {{done|}} [Simona] Windows Vista: '''PASS'''
* {{done|}} [AndreiD] Windows 7: '''PASS'''
* {{done|}} [AndreiD] Windows 7 64-bit: '''PASS'''
* {{done|}} [VladG] Mac OS X 10.6: '''PASS'''
* {{done|}} [VladG] Mac OS X 10.7: '''PASS'''
* {{done|}} [Mihaela] Ubuntu 11.04: '''PASS'''
* {{done|}} [Virgil] Ubuntu 11.10 64-bit: '''PASS'''
* '''Litmus''' [https://litmus.mozilla.org/run_tests.cgi?test_run_id=362 testrun], [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=362 report]
* '''Firefox 8.0b5''' [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/8.0b5-candidates/build1 build1]


; Exploratory Tests
*{{Bug|697696}} - Highlight issue in amazon's password box [NEW]  
The following are the detailed results of the exploratory testing - Web App compatibility
*{{Bug|697698}} - Pdf pages no longer loads if changing application handling pref on Linux [NEW]  
* {{done|}} [Simona] Windows 2000: '''PASS'''
*{{Bug|697725}} - Amazon tab favicon flickers when page is loading [NEW]
* {{done|}} [Ioana] Windows XP: '''PASS'''
* {{done|}} [Simona] Windows Vista: '''PASS'''
* {{done|}} [AndreiD] Windows 7: '''PASS'''
* {{done|}} [AndreiD] Windows 7 64-bit: '''PASS'''
* {{done|}} [VladG] Mac OS X 10.6: '''PASS'''
* {{done|}} [VladG] Mac OS X 10.7: '''PASS'''
* {{done|}} [Mihaela] Ubuntu 11.04: '''PASS'''
* {{done|}} [Virgil] Ubuntu 11.04 64-bit: '''PASS'''
* '''Litmus''' [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=362 report]


* {{done|}} [gmontagu] Windows 7, es-AR: '''PASS'''
=== Bug Fix Verification  ===


; Issues Found
Verify 100% QA+ bugs, as many as possible FIXED bugs
* {{Bug|697696}} - Highlight issue in amazon's password box [NEW]
* {{Bug|697698}} - Pdf pages no longer loads if changing application handling pref on Linux [NEW]
* {{Bug|697725}} - Amazon tab favicon flickers when page is loading [NEW]


=== Bug Fix Verification ===
*'''Bugs:''' [http://bit.ly/qTLvQZ QA+], [http://bit.ly/pvrNS5 FIXED]  
Verify 100% QA+ bugs, as many as possible FIXED bugs
*Fixed bugs verification spreadsheet [http://bit.ly/qm2viL Link]  
* '''Bugs:''' [http://bit.ly/qTLvQZ QA+], [http://bit.ly/pvrNS5 FIXED]
*Highlights  
* Fixed bugs verification spreadsheet [http://bit.ly/qm2viL Link]
*Highlights
**Tab Animation has been backed out from all branches. This is visible in [https://bugzilla.mozilla.org/show_bug.cgi?id=690227 bug 690227]
**Tab Animation has been backed out from all branches. This is visible in [https://bugzilla.mozilla.org/show_bug.cgi?id=690227 bug 690227]


=== Updates ===
=== Updates ===
The following are details of update verifications for Firefox 8 beta 5
 
The following are details of update verifications for Firefox 8 beta 5  
 
'''Betatest''':
 
*run some manual exploratory tests around updating with add-ons, plugins, session/profile data, etc
*How to set update channel to betatest:
**Find the defaults/prefs/channel-prefs.js file in your Firefox application folder
**Open it with a text editor and change the "beta" channel to "betatest", save and exit
**Start Firefox and check app.update.channel in about:config to verify it changed
**'''NOTE:''' On Windows Vista and 7 will not let you save the changes unless you run your text editor as an Administrator -- do so by right clicking the launcher for the text editor and select "Run as Administrator"
*What to test
**Build a realistic amount of profile and session data on one of the previous betas (4.0b8 through 8.0b5):
**try installing several add-ons (some out of date)
**try installing several plugins (some out of date)
**go to various top sites like Youtube, Banking sites, Social networks, news sites, games, webmail etc
**put some of the tabs in App Tabs and Panorama groupings
**'''Ultimately''' just play around with your browser for an hour or so like you would on a day to day basis
**After a while, check for and install the Firefox update to 8.0b5 and restart
*Result -- check after restart:
**no loss of session data
**no loss of profile data
**no loss of history, bookmarks
**no loss of add-ons
**no obvious breakage with Firefox and the sites you use most often
*What to report
**File bugs using the [8b5] whiteboard tag
 
'''Exploratory testing'''
 
*{{done|}} [Ioana] Windows XP:'''PASS'''
*{{done|}} [Virgil] Ubuntu 11.10 x86_64:'''PASS'''
*{{done|}} [Andrei] Windows 7:'''PASS'''
*{{done|}} [VladG] MacOS X 10.6:'''PASS'''
**Exploratory work spreadsheet [http://bit.ly/vyDuxM Link]
 
'''Releasetest:''' [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=releasetest&from=2011-10-26&to=2011-10-28&target=8.0 report]
 
*{{done|}} [ashughes] Windows 2000: '''PASS'''
*{{done|}} [ashughes] Windows XP: '''PASS'''
*{{done|}} [ashughes] Windows Vista: '''PASS'''
*{{done|}} [ashughes] Windows 7: '''PASS'''
*{{done|}} [ashughes] Windows 7 64-bit: '''PASS'''
*{{done|}} [ashughes] Mac OS X 10.6: '''PASS'''
*{{done|}} [ashughes] Mac OS X 10.7: '''PASS'''
*{{done|}} [ashughes] Ubuntu 11.04: '''PASS'''
*{{done|}} [ashughes] Ubuntu 11.04 64-bit: '''PASS'''
 
'''Beta:''' [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=beta&from=2011-10-26&to=2011-10-28&target=8.0 report]
 
*{{done|}} [juanb] Windows 2000: '''Pass'''
*{{done|}} [juanb] Windows XP: '''Pass'''
*{{ok|}} [tester] Windows Vista: '''result'''
*{{done|}} [juanb] Windows 7: '''Pass'''
*{{done|}} [tester] Windows 7 64-bit: '''Pass'''
*{{done|}} [juanb] Mac OS X 10.6: '''Pass'''
*{{done|}} [juanb] Mac OS X 10.7: '''Pass'''
*{{done|}} [juanb] Ubuntu 11.04: '''Pass'''
*{{done|}} [juanb] Ubuntu 11.04 64-bit: '''Pass'''
 
*Notes: [juanb] - I ran these manually, maximizing coverage such that I covered OS, partials, completes, fallbacks, and locales with the paths that I tried.
 
;Issues Found
 
== Beta 6  ==
 
The following tasks need to be completed to sign-off the Beta merge
 
*{{ok|}} [automation] Automated Tests: [[#Automated_Tests_6|details]]
*{{ok|}} [softvision] Manual Tests: [[#Manual_Tests_6|details]]
*{{ok|}} [softvision] Bug fix verifications [[#Bug_Fix_Verification|details]]
*{{ok|}} [automation] Updates: [[#Updates_6|details]]
 
'''Builds''': [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/8.0b6-candidates/build1 Firefox 8.0b6(build1)]<br> '''Litmus''':[https://litmus.mozilla.org/run_tests.cgi?test_run_id=363 testrun]<br>
 
=== Automated Tests  ===
 
The following are the detailed results of the automated BFT test runs.
 
*{{done|}} [ashughes] Windows 2000: '''PASS'''
*{{done|}} [ashughes] Windows XP: '''PASS'''
*{{done|}} [ashughes] Windows Vista: '''PASS'''
*{{done|}} [ashughes] Windows 7: '''PASS'''
*{{done|}} [ashughes] Windows 7 64-bit: '''PASS'''
*{{done|}} [ashughes] Mac OS X 10.6: '''PASS'''
*{{done|}} [ashughes] Mac OS X 10.7: '''PASS'''
*{{done|}} [ashughes] Ubuntu 11.04: '''PASS'''
*{{done|}} [ashughes] Ubuntu 11.04 64-bit: '''PASS'''
*'''Reports''': [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=363 Litmus], [http://mozmill-release.brasstacks.mozilla.com/#/functional/reports?branch=8.0&platform=All&from=2011-10-31&to=2011-11-05 Mozmill]
 
;Issues Found
 
*/testSecurity/testGreyLarry.js fails on all platforms
*/testSecurity/testIdentityPopupOpenClose.js fails on Windows 2000
 
=== Manual Tests  ===
 
;Smoketests
 
The following are the detailed results of the manual smoketests.
 
*{{done|}} [Simona] Windows 2000: '''PASS'''
*{{done|}} [Simona] Windows XP: '''PASS'''
*{{done|}} [Paul] Windows Vista: '''PASS'''
*{{done|}} [Mihaela] Windows 7: '''PASS'''
*{{done|}} [Paul] Windows 7 64-bit: '''PASS'''
*{{done|}} [VladG] Mac OS X 10.6: '''PASS'''
*{{done|}} [VladG] Mac OS X 10.7: '''PASS'''
*{{done|}} [Ioana] Ubuntu 11.10: '''PASS'''
*{{done|}} [Virgil] Ubuntu 11.10 64-bit: '''PASS'''
*'''Litmus''' [https://litmus.mozilla.org/run_tests.cgi?test_run_id=363 testrun], [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=363 report]
*'''Firefox 8.0b6''' [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/8.0b6-candidates/build1 build1]
 
;Exploratory Tests
 
The following are the detailed results of the exploratory testing - Web App compatibility
 
*{{done|}} [Simona] Windows 2000: '''PASS'''
*{{done|}} [Simona] Windows XP: '''PASS'''
*{{done|}} [Paul] Windows Vista: '''PASS'''
*{{done|}} [Mihaela] Windows 7: '''PASS'''
*{{done|}} [Paul] Windows 7 64-bit: '''PASS'''
*{{done|}} [VladG] Mac OS X 10.6: '''PASS'''
*{{done|}} [VladG] Mac OS X 10.7: '''PASS'''
*{{done|}} [Ioana] Ubuntu 11.10: '''PASS'''
*{{done|}} [Virgil] Ubuntu 11.10 64-bit: '''PASS'''
*'''Litmus''' [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=363 report]
 
*{{done|}} [gmontagu] Windows 7, es-AR (daily websites): '''PASS'''
 
;Issues Found


'''Betatest''':
=== Bug Fix Verification  ===
* run some manual exploratory tests around updating with add-ons, plugins, session/profile data, etc
* How to set update channel to betatest:
** Find the defaults/prefs/channel-prefs.js file in your Firefox application folder
** Open it with a text editor and change the "beta" channel to "betatest", save and exit
** Start Firefox and check app.update.channel in about:config to verify it changed
** '''NOTE:''' On Windows Vista and 7 will not let you save the changes unless you run your text editor as an Administrator -- do so by right clicking the launcher for the text editor and select "Run as Administrator"
* What to test
** Build a realistic amount of profile and session data on one of the previous betas (4.0b8 through 8.0b5):
** try installing several add-ons (some out of date)
** try installing several plugins (some out of date)
** go to various top sites like Youtube, Banking sites, Social networks, news sites, games, webmail etc
** put some of the tabs in App Tabs and Panorama groupings
** '''Ultimately''' just play around with your browser for an hour or so like you would on a day to day basis
** After a while, check for and install the Firefox update to 8.0b5 and restart
* Result -- check after restart:
** no loss of session data
** no loss of profile data
** no loss of history, bookmarks
** no loss of add-ons
** no obvious breakage with Firefox and the sites you use most often
* What to report
** File bugs using the [8b5] whiteboard tag


'''Exploratory testing'''
Verify 100% QA+ bugs, as many as possible FIXED bugs
* {{done|}} [Ioana] Windows XP:'''PASS'''
* {{done|}} [Virgil] Ubuntu 11.10 x86_64:'''PASS'''
* {{done|}} [Andrei] Windows 7:'''PASS'''
* {{done|}} [VladG] MacOS X 10.6:'''PASS'''
** Exploratory work spreadsheet [http://bit.ly/vyDuxM Link]


'''Releasetest:''' [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=releasetest&from=2011-10-26&to=2011-10-28&target=8.0 report]
*'''Bugs:''' [http://bit.ly/qTLvQZ QA+], [http://bit.ly/pvrNS5 FIXED]  
* {{done|}} [ashughes] Windows 2000: '''PASS'''
*Fixed bugs verification spreadsheet [http://bit.ly/qm2viL Link]
* {{done|}} [ashughes] Windows XP: '''PASS'''
* {{done|}} [ashughes] Windows Vista: '''PASS'''
* {{done|}} [ashughes] Windows 7: '''PASS'''
* {{done|}} [ashughes] Windows 7 64-bit: '''PASS'''
* {{done|}} [ashughes] Mac OS X 10.6: '''PASS'''
* {{done|}} [ashughes] Mac OS X 10.7: '''PASS'''
* {{done|}} [ashughes] Ubuntu 11.04: '''PASS'''
* {{done|}} [ashughes] Ubuntu 11.04 64-bit: '''PASS'''


'''Beta:''' [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=beta&from=2011-10-26&to=2011-10-28&target=8.0 report]
=== Updates  ===
* {{done|}} [juanb] Windows 2000: '''Pass'''
* {{done|}} [juanb] Windows XP: '''Pass'''
* {{ok|}} [tester] Windows Vista: '''result'''
* {{done|}} [juanb] Windows 7: '''Pass'''
* {{done|}} [tester] Windows 7 64-bit: '''Pass'''
* {{done|}} [juanb] Mac OS X 10.6: '''Pass'''
* {{done|}} [juanb] Mac OS X 10.7: '''Pass'''
* {{done|}} [juanb] Ubuntu 11.04: '''Pass'''
* {{done|}} [juanb] Ubuntu 11.04 64-bit: '''Pass'''


* Notes: [juanb] - I ran these manually, maximizing coverage such that I covered OS, partials, completes, fallbacks, and locales with the paths that I tried.  
The following are details of update verifications for Firefox 8 beta 6. '''This is the last beta (RC) before shipping, so update scenarios must be exercised thoroughly before we ship.'''


; Issues Found
'''UPDATE SCENARIOS TESTING RESULTS''' - [http://bit.ly/s7khbq Link]


== Beta 6 ==
'''Issues found'''
The following tasks need to be completed to sign-off the Beta merge
* {{ok|}} [automation] Automated Tests: [[#Automated_Tests_6|details]]
* {{ok|}} [softvision] Manual Tests: [[#Manual_Tests_6|details]]
* {{ok|}} [softvision] Bug fix verifications [[#Bug_Fix_Verification|details]]
* {{ok|}} [automation] Updates: [[#Updates_6|details]]


'''Builds''': [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/8.0b6-candidates/build1 Firefox 8.0b6(build1)]<br>
*[http://bit.ly/uDjE2I Bug 699125] - Error message received when attempting to resume a download after upgrading to a new Firefox version [NEW]  
'''Litmus''':[https://litmus.mozilla.org/run_tests.cgi?test_run_id=363 testrun]<br>
*[http://bit.ly/t8nxfM Bug 699175] - The current theme is not active when updating from Firefox 7.0b6 to Firefox 8.0b6 [NEW]


=== Automated Tests ===
'''Betatest''':  
The following are the detailed results of the automated BFT test runs.
* {{done|}} [ashughes] Windows 2000: '''PASS'''
* {{done|}} [ashughes] Windows XP: '''PASS'''
* {{done|}} [ashughes] Windows Vista: '''PASS'''
* {{done|}} [ashughes] Windows 7: '''PASS'''
* {{done|}} [ashughes] Windows 7 64-bit: '''PASS'''
* {{done|}} [ashughes] Mac OS X 10.6: '''PASS'''
* {{done|}} [ashughes] Mac OS X 10.7: '''PASS'''
* {{done|}} [ashughes] Ubuntu 11.04: '''PASS'''
* {{done|}} [ashughes] Ubuntu 11.04 64-bit: '''PASS'''
* '''Reports''': [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=363 Litmus], [http://mozmill-release.brasstacks.mozilla.com/#/functional/reports?branch=8.0&platform=All&from=2011-10-31&to=2011-11-05 Mozmill]


; Issues Found
*run some manual exploratory tests around updating with add-ons, plugins, session/profile data, etc
* /testSecurity/testGreyLarry.js fails on all platforms
*How to set update channel to betatest:
* /testSecurity/testIdentityPopupOpenClose.js fails on Windows 2000
**Find the defaults/prefs/channel-prefs.js file in your Firefox application folder
**Open it with a text editor and change the "beta" channel to "betatest", save and exit
**Start Firefox and check app.update.channel in about:config to verify it changed
**'''NOTE:''' On Windows Vista and 7 will not let you save the changes unless you run your text editor as an Administrator -- do so by right clicking the launcher for the text editor and select "Run as Administrator"
*What to test
**Build a realistic amount of profile and session data on one of the previous betas (4.0b8 through 8.0b6):
**try installing several add-ons (some out of date)
**try installing several plugins (some out of date)
**go to various top sites like Youtube, Banking sites, Social networks, news sites, games, webmail etc
**put some of the tabs in App Tabs and Panorama groupings
**'''Ultimately''' just play around with your browser for an hour or so like you would on a day to day basis
**After a while, check for and install the Firefox update to 8.0b6 and restart
*Result -- check after restart:
**no loss of session data
**no loss of profile data
**no loss of history, bookmarks
**no loss of add-ons
**no obvious breakage with Firefox and the sites you use most often
*What to report
**File bugs using the [8b6] whiteboard tag


=== Manual Tests ===
=== Feature Sign-Off  ===
; Smoketests
The following are the detailed results of the manual smoketests.
* {{done|}} [Simona] Windows 2000: '''PASS'''
* {{done|}} [Simona] Windows XP: '''PASS'''
* {{done|}} [Paul] Windows Vista: '''PASS'''
* {{done|}} [Mihaela] Windows 7: '''PASS'''
* {{done|}} [Paul] Windows 7 64-bit: '''PASS'''
* {{done|}} [VladG] Mac OS X 10.6: '''PASS'''
* {{done|}} [VladG] Mac OS X 10.7: '''PASS'''
* {{done|}} [Ioana] Ubuntu 11.10: '''PASS'''
* {{done|}} [Virgil] Ubuntu 11.10 64-bit: '''PASS'''
* '''Litmus''' [https://litmus.mozilla.org/run_tests.cgi?test_run_id=363 testrun], [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=363 report]
* '''Firefox 8.0b6''' [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/8.0b6-candidates/build1 build1]


; Exploratory Tests
'''Releasetest:''' [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=releasetest&from=2011-10-31&to=2011-11-05&target=8.0 report]  
The following are the detailed results of the exploratory testing - Web App compatibility
* {{done|}} [Simona] Windows 2000: '''PASS'''
* {{done|}} [Simona] Windows XP: '''PASS'''
* {{done|}} [Paul] Windows Vista: '''PASS'''
* {{done|}} [Mihaela] Windows 7: '''PASS'''
* {{done|}} [Paul] Windows 7 64-bit: '''PASS'''
* {{done|}} [VladG] Mac OS X 10.6: '''PASS'''
* {{done|}} [VladG] Mac OS X 10.7: '''PASS'''
* {{done|}} [Ioana] Ubuntu 11.10: '''PASS'''
* {{done|}} [Virgil] Ubuntu 11.10 64-bit: '''PASS'''
* '''Litmus''' [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=363 report]


* {{done|}} [gmontagu] Windows 7, es-AR (daily websites): '''PASS'''
*{{ok|}} [ashughes] Windows 2000: '''RESULT'''
*{{ok|}} [ashughes] Windows XP: '''RESULT'''
*{{ok|}} [ashughes] Windows Vista: '''RESULT'''
*{{ok|}} [ashughes] Windows 7: '''RESULT'''
*{{ok|}} [ashughes] Windows 7 64-bit: '''RESULT'''
*{{ok|}} [ashughes] Mac OS X 10.6: '''RESULT'''
*{{ok|}} [ashughes] Mac OS X 10.7: '''RESULT'''
*{{ok|}} [ashughes] Ubuntu 11.04: '''RESULT'''
*{{ok|}} [ashughes] Ubuntu 11.04 64-bit: '''RESULT'''


; Issues Found
'''Beta:''' [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=beta&from=2011-10-31&to=2011-11-05&target=8.0 report]


=== Bug Fix Verification ===
*{{ok|}} [tester] Windows 2000: '''result'''
Verify 100% QA+ bugs, as many as possible FIXED bugs
*{{ok|}} [tester] Windows XP: '''result'''
* '''Bugs:''' [http://bit.ly/qTLvQZ QA+], [http://bit.ly/pvrNS5 FIXED]
*{{ok|}} [tester] Windows Vista: '''result'''  
* Fixed bugs verification spreadsheet [http://bit.ly/qm2viL Link]
*{{ok|}} [tester] Windows 7: '''result'''
*{{ok|}} [tester] Windows 7 64-bit: '''result'''
*{{ok|}} [tester] Mac OS X 10.6: '''result'''
*{{ok|}} [tester] Mac OS X 10.7: '''result'''
*{{ok|}} [tester] Ubuntu 11.04: '''result'''
*{{ok|}} [tester] Ubuntu 11.04 64-bit: '''result'''


=== Updates ===
;Issues Found
The following are details of update verifications for Firefox 8 beta 6. '''This is the last beta (RC) before shipping, so update scenarios must be exercised thoroughly before we ship.'''


'''UPDATE SCENARIOS TESTING RESULTS''' - [http://bit.ly/s7khbq Link]
== Beta 6 (build2)  ==


'''Issues found'''
The following tasks need to be completed to sign-off the Beta merge
* [http://bit.ly/uDjE2I Bug 699125] - Error message received when attempting to resume a download after upgrading to a new Firefox version [NEW]
* [http://bit.ly/t8nxfM Bug 699175] - The current theme is not active when updating from Firefox 7.0b6 to Firefox 8.0b6 [NEW]
'''Betatest''':
* run some manual exploratory tests around updating with add-ons, plugins, session/profile data, etc
* How to set update channel to betatest:
** Find the defaults/prefs/channel-prefs.js file in your Firefox application folder
** Open it with a text editor and change the "beta" channel to "betatest", save and exit
** Start Firefox and check app.update.channel in about:config to verify it changed
** '''NOTE:''' On Windows Vista and 7 will not let you save the changes unless you run your text editor as an Administrator -- do so by right clicking the launcher for the text editor and select "Run as Administrator"
* What to test
** Build a realistic amount of profile and session data on one of the previous betas (4.0b8 through 8.0b6):
** try installing several add-ons (some out of date)
** try installing several plugins (some out of date)
** go to various top sites like Youtube, Banking sites, Social networks, news sites, games, webmail etc
** put some of the tabs in App Tabs and Panorama groupings
** '''Ultimately''' just play around with your browser for an hour or so like you would on a day to day basis
** After a while, check for and install the Firefox update to 8.0b6 and restart
* Result -- check after restart:
** no loss of session data
** no loss of profile data
** no loss of history, bookmarks
** no loss of add-ons
** no obvious breakage with Firefox and the sites you use most often
* What to report
** File bugs using the [8b6] whiteboard tag


=== Feature Sign-Off ===
*{{ok|}} [softvision] Manual Tests: [[#Manual_Tests_7|details]]
*{{ok|}} [softvision] Bug fix verifications [[#Bug_Fix_Verification|details]]
*{{ok|}} [geo] Updates: [[#Updates_5|details]]


'''Builds''': [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/8.0b6-candidates/build2 Firefox 8.0b6(build2)]<br> '''Litmus''':[https://litmus.mozilla.org/run_tests.cgi?test_run_id=368 testrun]<br>


'''Releasetest:''' [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=releasetest&from=2011-10-31&to=2011-11-05&target=8.0 report]
=== Manual Tests  ===
* {{ok|}} [ashughes] Windows 2000: '''RESULT'''
* {{ok|}} [ashughes] Windows XP: '''RESULT'''
* {{ok|}} [ashughes] Windows Vista: '''RESULT'''
* {{ok|}} [ashughes] Windows 7: '''RESULT'''
* {{ok|}} [ashughes] Windows 7 64-bit: '''RESULT'''
* {{ok|}} [ashughes] Mac OS X 10.6: '''RESULT'''
* {{ok|}} [ashughes] Mac OS X 10.7: '''RESULT'''
* {{ok|}} [ashughes] Ubuntu 11.04: '''RESULT'''
* {{ok|}} [ashughes] Ubuntu 11.04 64-bit: '''RESULT'''


'''Beta:''' [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=beta&from=2011-10-31&to=2011-11-05&target=8.0 report]
;Smoketests
* {{ok|}} [tester] Windows 2000: '''result'''
* {{ok|}} [tester] Windows XP: '''result'''
* {{ok|}} [tester] Windows Vista: '''result'''
* {{ok|}} [tester] Windows 7: '''result'''
* {{ok|}} [tester] Windows 7 64-bit: '''result'''
* {{ok|}} [tester] Mac OS X 10.6: '''result'''
* {{ok|}} [tester] Mac OS X 10.7: '''result'''
* {{ok|}} [tester] Ubuntu 11.04: '''result'''
* {{ok|}} [tester] Ubuntu 11.04 64-bit: '''result'''


; Issues Found
The following are the detailed results of the manual smoketests.


== Beta 6 (build2) ==
*{{ok|}} [Simona] Windows 2000: '''RESULT'''
The following tasks need to be completed to sign-off the Beta merge
*{{ok|}} [Ioana] Windows XP: '''RESULT'''
* {{ok|}} [softvision] Manual Tests: [[#Manual_Tests_7|details]]
*{{ok|}} [Simona] Windows Vista: '''RESULT'''
* {{ok|}} [softvision] Bug fix verifications [[#Bug_Fix_Verification|details]]
*{{ok|}} [Mihaela] Windows 7: '''RESULT'''
* {{ok|}} [geo] Updates: [[#Updates_5|details]]
*{{ok|}} [Mihaela] Windows 7 64-bit: '''RESULT'''
*{{ok|}} [VladG] Mac OS X 10.6: '''RESULT'''
*{{ok|}} [VladG] Mac OS X 10.7: '''RESULT'''
*{{ok|}} [Ioana] Ubuntu 11.04: '''RESULT'''
*{{ok|}} [Virgil] Ubuntu 11.04 64-bit: '''RESULT'''
*'''Litmus''' [https://litmus.mozilla.org/run_tests.cgi?test_run_id=368 testrun], [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=368 report]  
*'''Firefox 8.0b6''' [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/8.0b6-candidates/build2 build2]


'''Builds''': [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/8.0b6-candidates/build2 Firefox 8.0b6(build2)]<br>
;Exploratory Tests
'''Litmus''':[https://litmus.mozilla.org/run_tests.cgi?test_run_id=368 testrun]<br>


=== Manual Tests ===
Focus on add-ons and web compatibility.  
; Smoketests
The following are the detailed results of the manual smoketests.
* {{ok|}} [Simona] Windows 2000: '''RESULT'''
* {{ok|}} [Ioana] Windows XP: '''RESULT'''
* {{ok|}} [Simona] Windows Vista: '''RESULT'''
* {{ok|}} [Mihaela] Windows 7: '''RESULT'''
* {{ok|}} [Mihaela] Windows 7 64-bit: '''RESULT'''
* {{ok|}} [VladG] Mac OS X 10.6: '''RESULT'''
* {{ok|}} [VladG] Mac OS X 10.7: '''RESULT'''
* {{ok|}} [Ioana] Ubuntu 11.04: '''RESULT'''
* {{ok|}} [Virgil] Ubuntu 11.04 64-bit: '''RESULT'''
* '''Litmus''' [https://litmus.mozilla.org/run_tests.cgi?test_run_id=368 testrun], [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=368 report]
* '''Firefox 8.0b6''' [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/8.0b6-candidates/build2 build2]


; Exploratory Tests
*{{ok|}} [Simona] Windows 2000: '''RESULT'''  
Focus on add-ons and web compatibility.
*{{ok|}} [Ioana] Windows XP: '''RESULT'''  
* {{ok|}} [Simona] Windows 2000: '''RESULT'''
*{{ok|}} [Simona] Windows Vista: '''RESULT'''  
* {{ok|}} [Ioana] Windows XP: '''RESULT'''
*{{ok|}} [Mihaela] Windows 7: '''RESULT'''  
* {{ok|}} [Simona] Windows Vista: '''RESULT'''
*{{ok|}} [Mihaela] Windows 7 64-bit: '''RESULT'''  
* {{ok|}} [Mihaela] Windows 7: '''RESULT'''
*{{ok|}} [VladG] Mac OS X 10.6: '''RESULT'''  
* {{ok|}} [Mihaela] Windows 7 64-bit: '''RESULT'''
*{{ok|}} [VladG] Mac OS X 10.7: '''RESULT'''  
* {{ok|}} [VladG] Mac OS X 10.6: '''RESULT'''
*{{ok|}} [Ioana] Ubuntu 11.04: '''RESULT'''  
* {{ok|}} [VladG] Mac OS X 10.7: '''RESULT'''
*{{ok|}} [Virgil] Ubuntu 11.04 64-bit: '''RESULT'''  
* {{ok|}} [Ioana] Ubuntu 11.04: '''RESULT'''
*'''Litmus''' [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=368 report]
* {{ok|}} [Virgil] Ubuntu 11.04 64-bit: '''RESULT'''
* '''Litmus''' [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=368 report]


; Issues Found
;Issues Found


=== Bug Fix Verifications  ===
=== Bug Fix Verifications  ===
Line 1,102: Line 1,247:
*'''Bugs''':
*'''Bugs''':


{{bug|680802}} - VERIFIED FIXED
{{bug|680802}} - VERIFIED FIXED  


{{bug|689375}} - VERIFIED FIXED
{{bug|689375}} - VERIFIED FIXED  


{{bug|698753}} - VERIFIED FIXED  
{{bug|698753}} - VERIFIED FIXED  
Line 1,112: Line 1,257:
*Fixed bugs verification spreadsheet [http://bit.ly/qm2viL Link]
*Fixed bugs verification spreadsheet [http://bit.ly/qm2viL Link]


=== Manual spot checks ===
=== Manual spot checks ===
* Exploratory work spreadsheet - [http://bit.ly/uyVz7P Link]
 
*Exploratory work spreadsheet - [http://bit.ly/uyVz7P Link]
 
'''Issues found'''
 
{{bug|699435}} - The third party add-on warning message is misplaced when using a theme [NEW]
 
=== Updates  ===
 
'''Releasetest:''' [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=releasetest&from=2011-11-02&to=2011-11-05&target=8.0 report]
 
*{{ok|}} [ashughes] Windows 2000: '''PASS'''
*{{ok|}} [ashughes] Windows XP: '''PASS'''
*{{ok|}} [ashughes] Windows Vista: '''PASS'''
*{{ok|}} [ashughes] Windows 7: '''PASS'''
*{{ok|}} [ashughes] Windows 7 64-bit: '''PASS'''
*{{ok|}} [ashughes] Mac OS X 10.6: '''PASS'''
*{{ok|}} [ashughes] Mac OS X 10.7: '''PASS'''
*{{ok|}} [ashughes] Ubuntu 11.04: '''PASS'''
*{{ok|}} [ashughes] Ubuntu 11.04 64-bit: '''PASS'''
 
'''Beta:''' [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=beta&from=2011-11-02&to=2011-11-05&target=8.0 report]
 
*{{ok|}} [tester] Windows 2000: '''PASS'''
*{{ok|}} [tester] Windows XP: '''PASS'''
*{{ok|}} [tester] Windows Vista: '''PASS'''
*{{ok|}} [tester] Windows 7: '''PASS'''
*{{ok|}} [tester] Windows 7 64-bit: '''PASS'''
*{{ok|}} [tester] Mac OS X 10.6: '''PASS'''
*{{ok|}} [tester] Mac OS X 10.7: '''PASS'''
*{{ok|}} [tester] Ubuntu 11.04: '''PASS'''
*{{ok|}} [tester] Ubuntu 11.04 64-bit: '''PASS'''
 
;Issues Found
 
== Firefox 8 Final  ==
 
The following tasks need to be completed to sign-off before final release.
 
*{{ok|}} [automation] Automated Tests: [[#Automated_Tests_8|details]]
*{{ok|}} [geo] Updates: [[#Updates_8|details]]
 
'''Builds''': [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/releases/8.0/ Firefox 8.0 RC]<br> '''Litmus''':[https://litmus.mozilla.org/run_tests.cgi?test_run_id=371 testrun]<br>
 
=== Automated Tests  ===
 
*[ok] [automation] Windows 2000: PASS
*[ok] [automation] Windows XP: PASS
*[ok] [automation] Windows Vista: PASS
*[ok] [automation] Windows 7: PASS
*[ok] [automation] Windows 7 64-bit: PASS
*[ok] [automation] Mac OS X 10.6: PASS
*[ok] [automation] Mac OS X 10.7: PASS
*[ok] [automation] Ubuntu 11.04: PASS
*[ok] [automation] Ubuntu 11.04 64-bit: PASS
*Reports: [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=371 Litmus], [http://mozmill-release.brasstacks.mozilla.com/#/functional/reports?branch=8.0&platform=All&from=2011-11-05&to=2011-11-08 Mozmill]
 
;Issues Found
 
=== Bug Fix Verifications  ===
 
Verify 100% QA+ bugs, as many as possible FIXED bugs
 
*'''Bugs''': {{bug|689375}}, {{bug|698753}}, and {{bug|687367}}
*Fixed bugs verification spreadsheet [http://bit.ly/qm2viL Link]
 
=== Updates  ===
 
'''Releasetest:''' [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=releasetest&from=2011-11-05&to=2011-11-08&target=8.0 report]
 
*{{ok|}} [automation] Windows 2000: '''PASS'''
*{{ok|}} [automation] Windows XP: '''PASS'''
*{{ok|}} [automation] Windows Vista: '''PASS'''
*{{ok|}} [automation] Windows 7: '''PASS'''
*{{ok|}} [automation] Windows 7 64-bit: '''PASS'''
*{{ok|}} [automation] Mac OS X 10.6: '''PASS'''
*{{ok|}} [automation] Mac OS X 10.7: '''PASS'''
*{{ok|}} [automation] Ubuntu 11.04: '''PASS'''
*{{ok|}} [automation] Ubuntu 11.04 64-bit: '''PASS'''
 
'''Release:''' [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=beta&from=2011-11-05&to=2011-11-08&target=8.0 report]
 
*{{ok|}} [tester] Windows 2000: '''result'''
*{{ok|}} [tester] Windows XP: '''result'''
*{{ok|}} [tester] Windows Vista: '''result'''
*{{ok|}} [tester] Windows 7: '''result'''
*{{ok|}} [tester] Windows 7 64-bit: '''result'''
*{{ok|}} [tester] Mac OS X 10.6: '''result'''
*{{ok|}} [tester] Mac OS X 10.7: '''result'''
*{{ok|}} [tester] Ubuntu 11.04: '''result'''
*{{ok|}} [tester] Ubuntu 11.04 64-bit: '''result'''
 
;Issues Found
 
== Firefox 8.0.1  ==
As of 11-20 we have build2 candidates. The results from build1 will be reset, but a new testrun will be created for it.
 
=== Automated Tests  ===
We will run the automated tests using Mozmill as soon as we get build candidates.
 
* {{done|}} [ashughes] Windows 2000: '''PASS'''
* {{done|}} [ashughes] Windows XP: '''PASS'''
* {{done|}} [ashughes] Windows Vista: '''PASS'''
* {{done|}} [ashughes] Windows 7: '''PASS'''
* {{done|}} [ashughes] Windows 7 64-bit: '''PASS'''
* {{done|}} [ashughes] Mac OS X 10.6: '''PASS'''
* {{done|}} [ashughes] Mac OS X 10.7: '''PASS'''
* {{done|}} [ashughes] Ubuntu 11.04: '''PASS'''
* {{done|}} [ashughes] Ubuntu 11.04 64-bit: '''PASS'''
* Reports: [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=381 Litmus], [http://mozmill-release.brasstacks.mozilla.com/#/functional/reports?branch=8.0&platform=All&from=2011-11-21&to=2011-11-21 Mozmill]
 
'''Issues Found'''
 
=== Manual Tests ===
;Smoketests
 
Manual smoketests were skipped in favor of focused testing around the fixes, including exploratory testing.
 
*{{ok|}} [Simona] Windows 2000: '''result'''
*{{ok|}} [Ioana] Windows XP: '''result'''
*{{ok|}} [Simona] Windows Vista: '''result'''
*{{ok|}} [Mihaela] Windows 7: '''result'''
*{{ok|}} [Paul] Windows 7 64-bit: '''result'''
*{{ok|}} [VladG] Mac OS X 10.6: '''result'''
*{{ok|}} [VladG] Mac OS X 10.7: '''result'''
*{{ok|}} [Virgil] Ubuntu 11.10: '''result'''
*{{ok|}} [Virgil] Ubuntu 11.10 64-bit: '''result'''
*'''Litmus''' [https://litmus.mozilla.org/run_tests.cgi?test_run_id=381 testrun], [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=381 report]
*'''Firefox 8.0.1 (build2)''' [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/8.0.1-candidates/build2 build2]
 
;Exploratory Tests
 
The following are the detailed results of the exploratory testing - Web App compatibility
 
*{{ok|}} [Simona] Windows 2000: '''result'''
*{{done|}} [Ioana] Windows XP: '''PASS'''
*{{done|}} [Simona] Windows Vista: '''PASS'''
*{{done|}} [Mihaela] Windows 7: '''PASS'''
*{{done|}} [Paul] Windows 7 64-bit: '''PASS'''
*{{done|}} [VladG] Mac OS X 10.6: '''PASS'''
*{{ok|}} [VladG] Mac OS X 10.7: '''result'''
*{{ok|}} [Virgil] Ubuntu 11.10: '''result'''
*{{done|}} [Virgil] Ubuntu 11.10 64-bit: '''PASS'''
*'''Litmus''' [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=381 report]


'''Issues found'''
'''Issues Found'''
*{{bug|704133}} - Shockwave player is not working anymore with Firefox [NEW]


{{bug|699435}} - The third party add-on warning message is misplaced when using a theme [NEW]
=== Bug Verifications  ===


=== Updates ===
The following bugs need verification on all platforms:  
'''Releasetest:''' [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=releasetest&from=2011-11-02&to=2011-11-05&target=8.0 report]
* {{ok|}} [ashughes] Windows 2000: '''PASS'''
* {{ok|}} [ashughes] Windows XP: '''PASS'''
* {{ok|}} [ashughes] Windows Vista: '''PASS'''
* {{ok|}} [ashughes] Windows 7: '''PASS'''
* {{ok|}} [ashughes] Windows 7 64-bit: '''PASS'''
* {{ok|}} [ashughes] Mac OS X 10.6: '''PASS'''
* {{ok|}} [ashughes] Mac OS X 10.7: '''PASS'''
* {{ok|}} [ashughes] Ubuntu 11.04: '''PASS'''
* {{ok|}} [ashughes] Ubuntu 11.04 64-bit: '''PASS'''


'''Beta:''' [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=beta&from=2011-11-02&to=2011-11-05&target=8.0 report]
[https://mozqa.etherpad.mozilla.org/8 '''Link to etherpad with our testing efforts''']
* {{ok|}} [tester] Windows 2000: '''PASS'''
* {{ok|}} [tester] Windows XP: '''PASS'''
* {{ok|}} [tester] Windows Vista: '''PASS'''
* {{ok|}} [tester] Windows 7: '''PASS'''
* {{ok|}} [tester] Windows 7 64-bit: '''PASS'''
* {{ok|}} [tester] Mac OS X 10.6: '''PASS'''
* {{ok|}} [tester] Mac OS X 10.7: '''PASS'''
* {{ok|}} [tester] Ubuntu 11.04: '''PASS'''
* {{ok|}} [tester] Ubuntu 11.04 64-bit: '''PASS'''


; Issues Found
==== Blockers ====
*{{done|}} - [https://bugzilla.mozilla.org/show_bug.cgi?id=700835 Bug 700835] - Mac crash with Apple's Java update<br>
**[https://bugzilla.mozilla.org/show_bug.cgi?id=700835#c67 Steps to Reproduce and Verify]
** IMO VERIFIED FIXED - I haven't change the status of this bug.
*{{done|}} - [https://bugzilla.mozilla.org/show_bug.cgi?id=699134 Bug 699134] - Block request for Roboform<br>
** We are blocking all versions, below 7.6.2. Only 7.6.3 and 7.6.2 should be allowed.
**All versions of RoboForm downloads [http://www.oldapps.com/roboform.php here]
** IMO VERIFIED FIXED - I haven't change the status of this bug.


== Firefox 8 Final ==
'''Results'''
The following tasks need to be completed to sign-off before final release.
* {{ok|}} [automation] Automated Tests: [[#Automated_Tests_8|details]]
* {{ok|}} [geo] Updates: [[#Updates_8|details]]


'''Builds''': [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/releases/8.0/ Firefox 8.0 RC]<br>
'''Issues Found'''
'''Litmus''':[https://litmus.mozilla.org/run_tests.cgi?test_run_id=371 testrun]<br>


=== Automated Tests ===
=== Updates  ===
* [ok] [automation] Windows 2000: PASS
'''READ:''' For 8.0.1, the following applies:
* [ok] [automation] Windows XP: PASS
* Windows/Linux users already in version 8.0 will NOT be offered updates to 8.0.1
* [ok] [automation] Windows Vista: PASS
* All Mac users will be offered updates to 8.0.1: 4...8 -> 8.0.1
* [ok] [automation] Windows 7: PASS
* Windows/Linux users in 4...7.0.1 will be offered updates to 8.0.1
* [ok] [automation] Windows 7 64-bit: PASS
* [ok] [automation] Mac OS X 10.6: PASS
* [ok] [automation] Mac OS X 10.7: PASS
* [ok] [automation] Ubuntu 11.04: PASS
* [ok] [automation] Ubuntu 11.04 64-bit: PASS
* Reports: [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=371 Litmus], [http://mozmill-release.brasstacks.mozilla.com/#/functional/reports?branch=8.0&platform=All&from=2011-11-05&to=2011-11-08 Mozmill]


; Issues Found
'''Betatest:''' '''PASS''' ([http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=betatest&from=2011-11-21&to=2011-11-21&target=8.0.1 report])
* Win XP (no updates should be offered)
** 8.0 - en-US, es-ES, it: No updates offered, as expected.
* Linux (no updates should be offered)
** 8.0 - en-US, fr, ja: No updates offered, as expected.
* Win2000 (no updates should be offered)
** 8.0 - en-US, ru: No updates offered, as expected.
* Win7
** 8.0 - en-US: No updates offered, as expected.


=== Bug Fix Verifications ===
'''Releasetest:''' '''PASS''' ([http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=releasetest&from=2011-11-21&to=2011-11-21&target=8.0.1 report])
Verify 100% QA+ bugs, as many as possible FIXED bugs
* [juanb] - I did the type of manual checks as above (same platforms, same paths), but on the releasetest channel. In addition, I checked that older versions did get an update to 8.0.1
* '''Bugs''': {{bug|689375}}, {{bug|698753}}, and {{bug|687367}}
* Fixed bugs verification spreadsheet [http://bit.ly/qm2viL Link]


=== Updates ===
'''Release:''' '''PASS''' ([http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=release&from=2011-11-21&to=2011-11-22&target=8.0.1 report])
'''Releasetest:''' [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=releasetest&from=2011-11-05&to=2011-11-08&target=8.0 report]
* [juanb] - Again, similar types of checks on release. No problems found.
* {{ok|}} [automation] Windows 2000: '''PASS'''
* [ashughes] - some gaps in results caused by slow mirrors triggering timeout
* {{ok|}} [automation] Windows XP: '''PASS'''
'''Issues Found:'''
* {{ok|}} [automation] Windows Vista: '''PASS'''
 
* {{ok|}} [automation] Windows 7: '''PASS'''
==== 3.6.24 Major Update ====
* {{ok|}} [automation] Windows 7 64-bit: '''PASS'''
{| class="querytable"
* {{ok|}} [automation] Mac OS X 10.6: '''PASS'''
|-
* {{ok|}} [automation] Mac OS X 10.7: '''PASS'''
| class="header" | Tester: ashughes
* {{ok|}} [automation] Ubuntu 11.04: '''PASS'''
| class="header" | Releasetest: [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=releasetest&from=2011-11-29&to=2011-11-29&target=8.0.1 report]
* {{ok|}} [automation] Ubuntu 11.04 64-bit: '''PASS'''
| class="header" | Beta: [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=beta&from=2011-11-30&to=2011-12-01&target=8.0.1 report]
| class="header" | Release: [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=release&from=2011-11-30&to=2011-12-01&target=8.0.1 report]
|-
| Windows XP
| '''PASS''' - 2011-11-29
| '''PASS''' - 2011-11-30
| '''PASS''' - 2011-11-30
|-
| Windows 7
| '''PASS''' - 2011-11-29
| '''PASS''' - 2011-11-30
| '''PASS''' - 2011-11-30
|-
| Mac OS X 10.6
| '''PASS''' - 2011-11-29
| '''PASS''' - 2011-11-30
| '''PASS''' - 2011-11-30
|-
| Ubuntu 11.04
| '''PASS''' - 2011-11-29
| '''PASS''' - 2011-11-30
| '''PASS''' - 2011-11-30
|-
|}


'''Release:''' [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=8.0&channel=beta&from=2011-11-05&to=2011-11-08&target=8.0 report]
''NOTE: single failure on each testrun is expected due to changing branches of mozmill-tests''
* {{ok|}} [tester] Windows 2000: '''result'''
* {{ok|}} [tester] Windows XP: '''result'''
* {{ok|}} [tester] Windows Vista: '''result'''
* {{ok|}} [tester] Windows 7: '''result'''
* {{ok|}} [tester] Windows 7 64-bit: '''result'''
* {{ok|}} [tester] Mac OS X 10.6: '''result'''
* {{ok|}} [tester] Mac OS X 10.7: '''result'''
* {{ok|}} [tester] Ubuntu 11.04: '''result'''
* {{ok|}} [tester] Ubuntu 11.04 64-bit: '''result'''


; Issues Found
== Post-Mortem Notes ==

Latest revision as of 01:00, 1 December 2011

« Firefox 7 | Firefox 8 | Firefox 9 »

Firefox 8 Test Plan

Summary

Milestone Firefox 8
Status Currently in Beta -- Releasing on November 8th, 2011
Lead Juan Becerra (irc: juanb)
2nd Anthony Hughes (irc: ashughes)

Latest Build: ftp, http, web

The following is the test plan for Firefox 8 from Nightly through to Release. Use this document as a reference for what is being tested to validate the quality of Firefox 8. After the release this document will be used as an archive of what was done to validate this release.

If you have some free time, please pick a task below and get in touch with one of the leads.

Details

The following is a description of the tasks which need to be completed throughout this release.

Daily Tasks
  • [ON TRACK] [softvision] Automation: Check dashboards for new failures
  • [ON TRACK] [softvision] Bug Triage: Check Bugzilla for regressions
  • [ON TRACK] [softvision] Features: Test features and triage feature bugs targeted for this releases
  • [ON TRACK] [softvision] Input: Triage Input.MO for prevalent issues and feature requests
One-time-only Tasks
  • [DONE] [juanb] Nightly Merge: Sign-off initial merge to Nightly
  • [ON TRACK] [ashughes] Aurora Merge: Sign-off merge from Nightly to Aurora
  • [ON TRACK] [iBeta] Full Functional Tests: Run the full suite of full functional tests on Aurora
  • [ON TRACK] [uTest] Website Compatibility: Run suite of Aurora website compatibility tests
  • [ON TRACK] [ashughes] Beta Merge: Sign-off merge from Aurora to Beta
  • [ON TRACK] [uTest] Website Compatibility: Run suite of Beta website compatibility tests
  • [ON TRACK] [ashughes] Release: Sign-off final release

Automation

BFTs

Triage the Mozmill dashboard for test failures and debug for potential Firefox regressions.

  • Lead: Vlad Maniac (Softvision)
  • Peer: Alex Lakatos (Softvision)
  • Failure Status: NEW (12) | ASSIGNED (7) | FIXED (3) | REGRESSIONS (0)
  • Tasks:
    • Check the Mozmill dashboard for failing tests for the day
    • Cross reference any failure to the list of NEW and ASSIGNED bugs
      • If the bug is NEW, assign it to yourself and try to fix it
      • If the bug is ASSIGNED and there has been no activity on the bug in over a week, offer your assistance to fix the bug
      • If there is NO bug on file, file it using this template
    • If you need assistance, ask ashughes in the #mozmill channel

Endurance

Performed during NIGHTLY phase only

Triage and report the performance numbers from the daily Endurance tests.

  • Lead: Vlad Maniac (Softvision)
  • Peer: Alex Lakatos (Softvision)
  • Endurance reports
  • Spreadsheet for tracking results
  • NOTE: Report any spikes in performance degradation to the QA release driver
Analysis (20110722 - 20110815)
  • Windows Memory Usage: +15.58% (77MB -> 89MB)
  • Mac Memory Usage: +3.27% (153MB -> 158MB)
  • Linux Memory Usage: +0.00% (84MB -> 84MB)
Issues Found

Bug Triage

Check UNCONFIRMED, NEW, FIXED, REOPEN, and tracking/status bugs

  • Lead: Vlad Maniac (Softvision)
  • Peer: Alex Lakatos (Softvision)
  • Bugs: QA+, FIXED
  • Results: VERIFIED, REOPENED
  • Tips:
    • If you don't know how to verify a bug, just skip it, move onto the next bug
    • Ignore code-level bugs, bugs in tests, build issues
Notes

Features

Track features which have landed in Firefox 8 and are ready to be tested (spreadsheet)

Feature

Description of feature

  • Leads: Person (role)
  • QA Owner: Owner
  • Status: Status
  • Links: Feature page, test plan, tracking bug, etc
  • Notes:

Tab move detach animations

When dragging tabs on the tab bar, we should show the tab and animate when you rearrange them, instead of showing a placeholder indicator like we currently do. We should also show a thumbnail of the page on detach operations, and make sure we have a good threshold, so this isn't triggered accidentally.

There are regressions and the team backed this change out for Firefox 8. The changes have been verified. The feature was backed out without other regressions.

Third Party Add-on Warnings

We currently do not provide adequate warning to users that new third-party provided add-ons have been installed. This project will ensure that users opt-in to all add-ons that aren't installed through the Firefox UI. This feature falls primarily in the Experience category (from the "Discover, Experience, and Connect" vision statement.)

  • Leads: Asa Dotzler (Product), Dave Townsend (Feature, Lead), Curtis Koenig (Security lead), Jennifer Boriss (UX Lead)
  • QA Owner: Vlad Maniac (:vladmaniac)
  • Status: Complete. Health: OK - Feature Landed.
  • Links: Feature Page, Tracking Bug Test Plan
  • Notes:

People Search

Users can currently search for general web content, ecommerce items, and reference material, but they cannot search for people. We should add some form of People search to our search list. Twitter search is probably a good first step.

Confirm add-ons on upgrade

Then next time existing users upgrade Firefox they should be presented with a list of add-ons they have installed where they can choose to disable them. By default add-ons from third-parties which may have been installed without the users' knowledge will be disabled. This replaces the compatibility wizard for that one time upgrade, subsequent upgrades use the compatibility wizard still.
This feature falls primarily in the Experience category (from the "Discover, Experience, and Connect" vision statement.)

  • Leads: Justin Scott (Product), Dave Townsend (Feature, Lead), Curtis Koenig (Security lead), Alex Faaborg (UX Lead)
  • QA Owner: Vlad Maniac (:vladmaniac)
  • Status: Complete. Health: OK - Feature Landed.
  • Links: Feature Page, Tracking Bug, Test Plan
  • Notes:

Expose prefs for tabs-on-demand

Firefox 4 has the hidden ability to load tabs on-demand by setting the maximum number of concurrent tabs being restored to "0" — now that the feature has been in the wild for a while, we'd like to expose it as the default behavior for session restore. It makes startup a lot faster, and uses a lot less memory.
This feature falls primarily in the Experience category (from the "Discover, Experience, and Connect" vision statement.)

  • Leads: Asa Dotzler (Product), Alex Limi (Feature), Paul O'Shannessy (Lead Engineer)
  • QA Owner: Mihaela Velimiroviciu
  • Status: Complete. Health: OK - Feature Landed.
  • Links: Feature Page, Tracking Bug, Test Plan
  • Notes:

Silent Update: Reduce Displayed UI

To reduce update fatigue, don't display application update download and notifications user interface unless necessary.
Twelve hours after an update is downloaded the user is told to restart Firefox by the display of the application update user interface. Instead of always notifying after twelve hours and possibly interrupting the user the notification should only be displayed when it is important for the user to apply the update (e.g. when the update contains an important security fix the user should be notified). From analyzing crashes (questionable source), approximately 15% of users run Firefox longer than 12 hours and would be affected (see bug 659425 for details).
This feature falls primarily in the Experience category (from the "Discover, Experience, and Connect" vision statement.)

  • Leads: Chris Lee (Product), Lawrence Mandel (Directly Responsible individual), Tim Taubert (Lead Engineer), Lucas Adamki (Security Lead), Alex Limi (UX Lead)
  • QA Owner: Paul Silaghi
  • Status: In progress. Health: OK
  • Links: Feature Page, Test Plan, Tracking Bug
  • Notes:

Input

The following are the details of daily triage conducted on http://input.mozilla.org.

  • Lead: Simona Badau, irc:simonab (Softvision)
  • Tasks:
    • Go to http://input.mozilla.org
    • Filter the results by Firefox version
    • Put your results here: spreadsheet
    • Any feedback which is spiking should listed below and escalated to the QA release driver
Popular Feedback

Full Functional Tests

The following tracks testing done by iBeta for full functional test coverage. This task is performed once during Aurora only.

  • Lead: Juan Becerra
  • [ link to test suite]
  • [ link to results of testing]
  • [ link to bugs filed by iBeta]

Website Compatibility

The following tracks testing done by uTest for website compatibility. This task is performed after every merge.

  • Lead: Juan Becerra
  • Link to test suite
  • Link to report for Aurora Web Compatibility
  • Link to report for Beta Web Compatibility
  • Link to bugs filed

Aurora Merge

Verify that the builds generated from the merge to Aurora have updated properly.

Auroratest
  • [DONE] [ashughes] Windows XP: PASS
    • Source: Mozilla/5.0 (Windows NT 5.1; rv:7.0a2) Gecko/20110813 Firefox/7.0a2
    • Target: Mozilla/5.0 (Windows NT 5.1; rv:8.0a2) Gecko/20110817 Firefox/8.0a2
  • [DONE] [ashughes] Windows 7: PASS
    • Source: Mozilla/5.0 (Windows NT 6.1; rv:7.0a2) Gecko/20110814 Firefox/7.0a2
    • Target: Mozilla/5.0 (Windows NT 6.1; rv:8.0a2) Gecko/20110817 Firefox/8.0a2
  • [DONE] [ashughes] Mac OS X 10.6: PASS
    • Source: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:7.0a2) Gecko/20110812 Firefox/7.0a2
    • Target: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:8.0a2) Gecko/20110817 Firefox/8.0a2
  • [DONE] [ashughes] Ubuntu 11.04: PASS
    • Source: Mozilla/5.0 (X11; Linux i686 on x86_64; rv:7.0a2) Gecko/20110814 Firefox/7.0a2
    • Target: Mozilla/5.0 (X11; Linux i686 on x86_64; rv:8.0a2) Gecko/20110817 Firefox/8.0a2
Aurora
  • [DONE] [ashughes] Windows XP: PASS
    • Source: Mozilla/5.0 (Windows NT 5.1; rv:7.0a2) Gecko/20110813 Firefox/7.0a2
    • Target: Mozilla/5.0 (Windows NT 5.1; rv:8.0a2) Gecko/20110819 Firefox/8.0a2
  • [DONE] [ashughes] Windows 7: PASS
    • Source: Mozilla/5.0 (Windows NT 6.1; rv:7.0a2) Gecko/20110814 Firefox/7.0a2
    • Target: Mozilla/5.0 (Windows NT 6.1; rv:8.0a2) Gecko/20110819 Firefox/8.0a2
  • [DONE] [ashughes] Mac OS X 10.6: PASS
    • Source: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:7.0a2) Gecko/20110812 Firefox/7.0a2
    • Target: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:8.0a2) Gecko/20110819 Firefox/8.0a2
  • [DONE] [ashughes] Ubuntu 11.04: PASS
    • Source: Mozilla/5.0 (X11; Linux i686 on x86_64; rv:7.0a2) Gecko/20110814 Firefox/7.0a2
    • Target: Mozilla/5.0 (X11; Linux i686 on x86_64; rv:8.0a2) Gecko/20110819 Firefox/8.0a2
Issues Found

Beta 1

The following tasks need to be completed to sign-off the Beta merge

  • [ON TRACK] [ashughes] Automated Tests: details
  • [ON TRACK] [softvision] Manual Tests: details
  • [ON TRACK] [ashughes] Updates: details

Builds: Firefox 8.0b1(1)
Litmus:testrun

Automated Tests

The following are the detailed results of the automated BFT test runs.

  • [DONE] [ashughes] Windows 2000: PASS
  • [DONE] [ashughes] Windows XP: PASS
  • [DONE] [ashughes] Windows Vista: PASS
  • [DONE] [ashughes] Windows 7: PASS
  • [DONE] [ashughes] Windows 7 64-bit: PASS
  • [DONE] [ashughes] Mac OS X 10.6: PASS
  • [DONE] [ashughes] Mac OS X 10.7: PASS
  • [DONE] [ashughes] Ubuntu 11.04: PASS
  • [DONE] [ashughes] Ubuntu 11.04 64-bit: PASS
  • Reports: Litmus, Mozmill
Issues Found
  • Two tests are constantly failing and which need to be fixed as soon as possible.

Manual Tests

Smoketests

The following are the detailed results of the manual smoketests.

  • [DONE] [Simona] Windows 2000: PASS
  • [DONE] [Ioana] Windows XP: PASS
  • [DONE] [Simona] Windows Vista: PASS
  • [DONE] [Mihaela] Windows 7: PASS
  • [DONE] [Andrei] Windows 7 64-bit: PASS
  • [DONE] [VladG] Mac OS X 10.6: PASS
  • [DONE] [VladG] Mac OS X 10.7: PASS
  • [DONE] [Ioana] Ubuntu 11.04: PASS
  • [DONE] [Virgil] Ubuntu 11.04 64-bit: PASS
  • Litmus testrun, report
  • Firefox 8.0b1 build1
Exploratory Tests

The following are the detailed results of the exploratory testing - Web App compatibility

  • [DONE] [Simona] Windows 2000: PASS
  • [DONE] [Ioana] Windows XP: PASS
  • [DONE] [Simona] Windows Vista: PASS
  • [DONE] [Mihaela] Windows 7: PASS
  • [DONE] [Andrei] Windows 7 64-bit: PASS
  • [DONE] [VladG] Mac OS X 10.6: PASS
  • [DONE] [VladG] Mac OS X 10.7: PASS
  • [DONE] [Ioana] Ubuntu 11.04: PASS
  • [DONE] [Virgil] Ubuntu 11.04 64-bit PASS
  • Litmus report
Issues Found
  • Html5
    • bug 690356 - Lower half of html5 youtube videos flickers in full screen
  • Tab animation
    • bug 689554 - The use of closing browser window shortcut key (ctrl+shift+w) while dnd a tab disturbs tab animation [NEW]
    • bug 689566 - Keyboard shortcut cmd+shift+w disturbs tab animation - dnd a tab from a window to another window [mac] [NEW]
    • bug 689575 - Disable keyboard shortcuts while tab animation is active [NEW]
    • bug 690341 - Using the close tab option from the menu opens a new tab when dragging a tab [NEW]

Updates

The following are details of update verifications for Firefox 8 beta 1

Releasetest: report

  • [DONE] [ashughes] Windows 2000: PASS
  • [DONE] [ashughes] Windows XP: PASS
  • [DONE] [ashughes] Windows Vista: PASS
  • [DONE] [ashughes] Windows 7: PASS
  • [DONE] [ashughes] Windows 7 64-bit: PASS
  • [DONE] [ashughes] Mac OS X 10.6: PASS
  • [DONE] [ashughes] Mac OS X 10.7: PASS
  • [DONE] [ashughes] Ubuntu 11.04: PASS
  • [DONE] [ashughes] Ubuntu 11.04 64-bit: PASS

Beta: report

  • [DONE] [ashughes] Windows 2000: PASS
  • [DONE] [ashughes] Windows XP: PASS
  • [DONE] [ashughes] Windows Vista: PASS
  • [DONE] [ashughes] Windows 7: PASS
  • [DONE] [ashughes] Windows 7 64-bit: PASS
  • [DONE] [ashughes] Mac OS X 10.6: PASS
  • [DONE] [ashughes] Mac OS X 10.7: PASS
  • [DONE] [ashughes] Ubuntu 11.04: PASS
  • [DONE] [ashughes] Ubuntu 11.04 64-bit: PASS
Issues Found

Beta 2 (build1)

The following tasks need to be completed to sign-off the Beta merge

  • [ON TRACK] [ashughes] Automated Tests: details
  • [ON TRACK] [softvision] Manual Tests: details
  • [ON TRACK] [softvision] Bug fix verifications details
  • [ON TRACK] [ashughes] Updates: details

Builds: Firefox 8.0b2(1)
Litmus:testrun

Automated Tests

The following are the detailed results of the automated BFT test runs.

  • [DONE] [ashughes] Windows 2000: PASS
  • [DONE] [ashughes] Windows XP: PASS
  • [DONE] [ashughes] Windows Vista: PASS
  • [DONE] [ashughes] Windows 7: PASS
  • [DONE] [ashughes] Windows 7 64-bit: PASS
  • [DONE] [ashughes] Mac OS X 10.6: PASS
  • [DONE] [ashughes] Mac OS X 10.7: PASS
  • [DONE] [ashughes] Ubuntu 11.04: PASS
  • [DONE] [ashughes] Ubuntu 11.04 64-bit: PASS
  • Reports: Litmus, Mozmill
Issues Found
  • /restartTests/testAddons_installMultipleExtensions/test1.js is failing on Win XP

Manual Tests

Smoketests

The following are the detailed results of the manual smoketests.

  • [DONE] [Simona] Windows 2000: PASS
  • [DONE] [Ioana] Windows XP: PASS
  • [DONE] [Simona] Windows Vista: PASS
  • [DONE] [Mihaela] Windows 7: PASS
  • [DONE] [Mihaela] Windows 7 64-bit: PASS
  • [DONE] [VladG] Mac OS X 10.6: PASS
  • [DONE] [VladG] Mac OS X 10.7: PASS
  • [DONE] [Ioana] Ubuntu 11.04: PASS
  • [DONE] [Virgil] Ubuntu 11.04 64-bit: PASS
  • Litmus testrun, report
  • Firefox 8.0b2 build1
Exploratory Tests

The following are the detailed results of the exploratory testing - Web App compatibility

  • [DONE] [Simona] Windows 2000: PASS
  • [DONE] [Ioana] Windows XP: PASS
  • [DONE] [Simona] Windows Vista: PASS
  • [DONE] [Mihaela] Windows 7: PASS
  • [DONE] [Mihaela] Windows 7 64-bit: PASS
  • [DONE] [VladG] Mac OS X 10.6: PASS
  • [DONE] [VladG] Mac OS X 10.7: PASS
  • [DONE] [Ioana] Ubuntu 11.04: PASS
  • [DONE] [Virgil] Ubuntu 11.04 64-bit: PASS
  • Litmus report
Issues Found
  • bug 692418 -Print error is triggered the first time when attempting to print a yahoo mail message (New)
  • bug 692446 -Firefox prompts to install windows media player plugin even though it is already installed (New)

Bug Fix Verification

  • Release Driver: Triage these FIXED bugs to build the QA+ query
  • Release Testers: Verify these QA+ bugs 100%
  • Results: spreadsheet

Updates

The following are details of update verifications for Firefox 8 beta 2

Betatest:

  • run some manual exploratory tests around updating with add-ons, plugins, session/profile data, etc
  • How to set update channel to betatest:
    • Find the defaults/prefs/channel-prefs.js file in your Firefox application folder
    • Open it with a text editor and change the "beta" channel to "betatest", save and exit
    • Start Firefox and check app.update.channel in about:config to verify it changed
    • NOTE: On Windows Vista and 7 will not let you save the changes unless you run your text editor as an Administrator -- do so by right clicking the launcher for the text editor and select "Run as Administrator"
  • What to test
    • Build a realistic amount of profile and session data on one of the previous betas (4.0b8 through 8.0b1):
    • try installing several add-ons (some out of date)
    • try installing several plugins (some out of date)
    • go to various top sites like Youtube, Banking sites, Social networks, news sites, games, webmail etc
    • put some of the tabs in App Tabs and Panorama groupings
    • Ultimately just play around with your browser for an hour or so like you would on a day to day basis
    • After a while, check for and install the Firefox update to 8.0b2 and restart
  • Result -- check after restart:
    • no loss of session data
    • no loss of profile data
    • no loss of history, bookmarks
    • no loss of add-ons
    • no obvious breakage with Firefox and the sites you use most often
  • What to report
    • File bugs using the [8b2] whiteboard tag


Releasetest: report

  • [DONE] [ashughes] Windows 2000: PASS
  • [DONE] [ashughes] Windows XP: PASS
  • [DONE] [ashughes] Windows Vista: PASS
  • [DONE] [ashughes] Windows 7: PASS
  • [DONE] [ashughes] Windows 7 64-bit: PASS
  • [DONE] [ashughes] Mac OS X 10.6: PASS
  • [DONE] [ashughes] Mac OS X 10.7: PASS
  • [DONE] [ashughes] Ubuntu 11.04: PASS
  • [DONE] [ashughes] Ubuntu 11.04 64-bit: PASS

Beta: [ report]

  • [ON TRACK] [tester] Windows 2000: result
  • [ON TRACK] [tester] Windows XP: result
  • [ON TRACK] [tester] Windows Vista: result
  • [ON TRACK] [tester] Windows 7: result
  • [ON TRACK] [tester] Windows 7 64-bit: result
  • [ON TRACK] [tester] Mac OS X 10.6: result
  • [ON TRACK] [tester] Mac OS X 10.7: result
  • [ON TRACK] [tester] Ubuntu 11.04: result
  • [ON TRACK] [tester] Ubuntu 11.04 64-bit: result
Issues Found

Beta 2 (build 2)

The following tasks need to be completed to sign-off on this beta milestone.

  • [ON TRACK] [ashughes] Automated Tests: details
  • [ON TRACK] [softvision] Manual Tests: details
  • [ON TRACK] [softvision] Bug fix verifications details
  • [ON TRACK] [ashughes] Updates: details

Builds: Firefox 8.0b2(build 2)
Litmus:testrun

Automated Tests

The following are the detailed results of the automated BFT test runs.

  • [DONE] [ashughes] Windows 2000: RESULT
  • [DONE] [ashughes] Windows XP: RESULT
  • [DONE] [ashughes] Windows Vista: RESULT
  • [DONE] [ashughes] Windows 7: RESULT
  • [DONE] [ashughes] Windows 7 64-bit: RESULT
  • [DONE] [ashughes] Mac OS X 10.6: RESULT
  • [DONE] [ashughes] Mac OS X 10.7: RESULT
  • [DONE] [ashughes] Ubuntu 11.04: RESULT
  • [DONE] [ashughes] Ubuntu 11.04 64-bit: RESULT
  • Reports: Litmus, Mozmill
Issues Found
  • /testSecurity/testSubmitUnencryptedInfoWarning.js failed on Mac 10.7 and Windows 2000
  • /restartTests/testAddons_installMultipleExtensions failed on Mac 10.7
  • /testTabbedBrowsing/testBackgroundTabScrolling.js failed on Windows Vista

Manual Tests

Smoketests

The following are the detailed results of the manual smoketests.

  • [DONE] [Simona] Windows 2000: RESULT
  • [DONE] [Ioana] Windows XP: RESULT
  • [DONE] [Simona] Windows Vista: RESULT
  • [DONE] [Mihaela] Windows 7: RESULT
  • [DONE] [Mihaela] Windows 7 64-bit: RESULT
  • [DONE] [VladG] Mac OS X 10.6: RESULT
  • [DONE] [VladG] Mac OS X 10.7: RESULT
  • [DONE] [Ioana] Ubuntu 11.04: RESULT
  • [DONE] [Virgil] Ubuntu 11.04 64-bit: RESULT
  • Litmus testrun, report
  • Firefox 8.0b2 build2
Exploratory Tests

The following are the detailed results of the exploratory testing - Web App compatibility

  • [DONE] [Simona] Windows 2000: RESULT
  • [DONE] [Ioana] Windows XP: RESULT
  • [DONE] [Simona] Windows Vista: RESULT
  • [DONE] [Mihaela] Windows 7: RESULT
  • [DONE] [Mihaela] Windows 7 64-bit: RESULT
  • [DONE] [VladG] Mac OS X 10.6: RESULT
  • [DONE] [VladG] Mac OS X 10.7: RESULT
  • [DONE] [Ioana] Ubuntu 11.04: RESULT
  • [DONE] [Virgil] Ubuntu 11.04 64-bit: RESULT
  • Litmus report
Issues Found
  • bug 692418 -Print error is triggered the first time when attempting to print a yahoo mail message (New)
  • bug 692446 -Firefox prompts to install windows media player plugin even though it is already installed (New)

Bug Fix Verification

Verify 100% QA+ bugs, as many as possible FIXED bugs

Updates

The following are details of update verifications for Firefox 8 beta 2

Betatest:

  • run some manual exploratory tests around updating with add-ons, plugins, session/profile data, etc
  • How to set update channel to betatest:
    • Find the defaults/prefs/channel-prefs.js file in your Firefox application folder
    • Open it with a text editor and change the "beta" channel to "betatest", save and exit
    • Start Firefox and check app.update.channel in about:config to verify it changed
    • NOTE: On Windows Vista and 7 will not let you save the changes unless you run your text editor as an Administrator -- do so by right clicking the launcher for the text editor and select "Run as Administrator"
  • What to test
    • Build a realistic amount of profile and session data on one of the previous betas (4.0b8 through 8.0b1):
    • try installing several add-ons (some out of date)
    • try installing several plugins (some out of date)
    • go to various top sites like Youtube, Banking sites, Social networks, news sites, games, webmail etc
    • put some of the tabs in App Tabs and Panorama groupings
    • Ultimately just play around with your browser for an hour or so like you would on a day to day basis
    • After a while, check for and install the Firefox update to 8.0b2 and restart
  • Result -- check after restart:
    • no loss of session data
    • no loss of profile data
    • no loss of history, bookmarks
    • no loss of add-ons
    • no obvious breakage with Firefox and the sites you use most often
  • What to report
    • File bugs using the [8b2] whiteboard tag

Exploratory testing

  • [DONE] [Simona] Windows XP:PASS
  • [DONE] [Virgil] Ubuntu 11.04 x64:PASS
  • [DONE] [Ioana] Windows 7:PASS
  • [DONE] [VladG] MacOS X 10.6:PASS
    • Exploratory work spreadsheet Link

Releasetest: report

  • [DONE] [ashughes] Windows 2000: PASS
  • [DONE] [ashughes] Windows XP: PASS
  • [DONE] [ashughes] Windows Vista: PASS
  • [DONE] [ashughes] Windows 7: PASS
  • [DONE] [ashughes] Windows 7 64-bit: PASS
  • [DONE] [ashughes] Mac OS X 10.6: PASS
  • [DONE] [ashughes] Mac OS X 10.7: PASS
  • [DONE] [ashughes] Ubuntu 11.04: PASS
  • [DONE] [ashughes] Ubuntu 11.04 64-bit: PASS

Beta: report

  • [ON TRACK] [tester] Windows 2000: PASS
  • [ON TRACK] [tester] Windows XP: PASS
  • [ON TRACK] [tester] Windows Vista: PASS
  • [ON TRACK] [tester] Windows 7: PASS
  • [ON TRACK] [tester] Windows 7 64-bit: PASS
  • [ON TRACK] [tester] Mac OS X 10.6: PASS
  • [ON TRACK] [tester] Mac OS X 10.7: PASS
  • [ON TRACK] [tester] Ubuntu 11.04: PASS
  • [ON TRACK] [tester] Ubuntu 11.04 64-bit: PASS
Issues Found
  • There were three failures in the automation, which I wasn't able to reproduce manually (juanb).

Beta 3

The following tasks need to be completed to sign-off the Beta merge

  • [ON TRACK] [ashughes] Automated Tests: details
  • [ON TRACK] [softvision] Manual Tests: details
  • [ON TRACK] [softvision] Bug fix verifications details
  • [ON TRACK] [ashughes] Updates: details

Builds: Firefox 8.0b3(build1)
Litmus:testrun

Automated Tests

The following are the detailed results of the automated BFT test runs.

  • [DONE] [ashughes] Windows 2000: PASS
  • [DONE] [ashughes] Windows XP: PASS
  • [DONE] [ashughes] Windows Vista: PASS
  • [DONE] [ashughes] Windows 7: PASS
  • [DONE] [ashughes] Windows 7 64-bit: PASS
  • [DONE] [ashughes] Mac OS X 10.6: PASS
  • [DONE] [ashughes] Mac OS X 10.7: PASS
  • [DONE] [ashughes] Ubuntu 11.04: PASS
  • [DONE] [ashughes] Ubuntu 11.04 64-bit: PASS
  • Reports: Litmus, Mozmill
Issues Found

Manual Tests

Smoketests

The following are the detailed results of the manual smoketests.

  • [DONE] [Simona] Windows 2000: PASS
  • [DONE] [AndreiD] Windows XP: PASS
  • [DONE] [Simona] Windows Vista: PASS
  • [DONE] [Mihaela] Windows 7: PASS
  • [DONE] [AndreiD] Windows 7 64-bit: PASS
  • [DONE] [VladG] Mac OS X 10.6: PASS
  • [DONE] [VladG] Mac OS X 10.7: PASS
  • [DONE] [Ioana] Ubuntu 11.04: PASS
  • [DONE] [Mihaela] Ubuntu 11.04 64-bit: PASS
  • Litmus testrun, report
  • Firefox 8.0b3 build1
Exploratory Tests

The following are the detailed results of the exploratory testing - Web App compatibility

  • [DONE] [Simona] Windows 2000: PASS
  • [DONE] [AndreiD] Windows XP: PASS
  • [DONE] [Simona] Windows Vista: PASS
  • [DONE] [Mihaela] Windows 7: PASS
  • [DONE] [AndreiD] Windows 7 64-bit: PASS
  • [DONE] [VladG] Mac OS X 10.6: PASS
  • [DONE] [VladG] Mac OS X 10.7: PASS
  • [DONE] [Ioana] Ubuntu 11.04: PASS
  • [DONE] [Mihaela] Ubuntu 11.04 64-bit: PASS
  • Litmus report
Issues Found
  • bug 694288 - Vimeo.com - embedded video player is not displayed on Windows 2000 (New)
Dark Matter Addons

(re: bug 693698) -- Using this spreadsheet -- test on 32-bit Windows only -- use this etherpad to record your results

  • Pick an add-on and record it's name and URL from the spreadsheet to the etherpad
  • Go to the URL and install the software package
    • The notes will give you a hint of what to look for
    • There's some non-free software there, so we won't be able to get to all of them
  • Once the software is installed, start Firefox
    • Firefox may need to be closed to install some of the software packages
  • Open about:support and look for the name and ID of the new add-ons
    • They should be recorded in the GUID section
  • Look for the registry keys specified in this article
    • If there are registry keys for the add-on, enter Registry in the Installed in column
    • If not, look in Program Files/Mozilla Firefox/extensions -- if the add-on is there, enter App Dir in the Installed in column
    • If not, look in %Profile-Folder%/extensions -- if the add-on is there, enter Profile in the Installed in column

Add notes if you have any problems getting to the extension or getting it installed in Firefox, or if additional add-ons are being installed by a single package. Anything that gives us an idea of why an add-on couldn't be tested, or other add-ons we should be concerned about.

If you have any questions, please contact Andrew Williamson (eviljeff) on IRC in the #amo or #amo-editors channel.

Bug Fix Verification

Verify 100% QA+ bugs, as many as possible FIXED bugs

Updates

The following are details of update verifications for Firefox 8 beta 3

Betatest:

  • run some manual exploratory tests around updating with add-ons, plugins, session/profile data, etc
  • How to set update channel to betatest:
    • Find the defaults/prefs/channel-prefs.js file in your Firefox application folder
    • Open it with a text editor and change the "beta" channel to "betatest", save and exit
    • Start Firefox and check app.update.channel in about:config to verify it changed
    • NOTE: On Windows Vista and 7 will not let you save the changes unless you run your text editor as an Administrator -- do so by right clicking the launcher for the text editor and select "Run as Administrator"
  • What to test
    • Build a realistic amount of profile and session data on one of the previous betas (4.0b8 through 8.0b1):
    • try installing several add-ons (some out of date)
    • try installing several plugins (some out of date)
    • go to various top sites like Youtube, Banking sites, Social networks, news sites, games, webmail etc
    • put some of the tabs in App Tabs and Panorama groupings
    • Ultimately just play around with your browser for an hour or so like you would on a day to day basis
    • After a while, check for and install the Firefox update to 8.0b2 and restart
  • Result -- check after restart:
    • no loss of session data
    • no loss of profile data
    • no loss of history, bookmarks
    • no loss of add-ons
    • no obvious breakage with Firefox and the sites you use most often
  • What to report
    • File bugs using the [8b3] whiteboard tag

Exploratory testing

  • [DONE] [Simona] Windows XP:PASS
  • [DONE] [Ioana] Ubuntu 11.04 x86:PASS - with known issues: bug 658913
  • [DONE] [Mihaela] Windows 7:PASS
  • [DONE] [VladG] MacOS X 10.6:PASS
    • Exploratory work spreadsheet Link


Releasetest: report

  • [DONE] [ashughes] Windows 2000: PASS
  • [DONE] [ashughes] Windows XP: PASS
  • [DONE] [ashughes] Windows Vista: PASS
  • [DONE] [ashughes] Windows 7: PASS
  • [DONE] [ashughes] Windows 7 64-bit: PASS
  • [DONE] [ashughes] Mac OS X 10.6: PASS
  • [DONE] [ashughes] Mac OS X 10.7: PASS
  • [DONE] [ashughes] Ubuntu 11.04: PASS
  • [DONE] [ashughes] Ubuntu 11.04 64-bit: PASS

Beta: report

  • [DONE] [ashughes] Windows 2000: PASS
  • [DONE] [ashughes] Windows XP: PASS
  • [DONE] [ashughes] Windows Vista: PASS
  • [DONE] [ashughes] Windows 7: PASS
  • [DONE] [ashughes] Windows 7 64-bit: PASS
  • [DONE] [ashughes] Mac OS X 10.6: PASS
  • [DONE] [ashughes] Mac OS X 10.7: PASS
  • [DONE] [ashughes] Ubuntu 11.04: PASS
  • [DONE] [ashughes] Ubuntu 11.04 64-bit: PASS
Issues Found

Beta 4

The following tasks need to be completed to sign-off the Beta merge

  • [ON TRACK] [ashughes] Automated Tests: details
  • [ON TRACK] [softvision] Manual Tests: details
  • [ON TRACK] [softvision] Bug fix verifications details
  • [ON TRACK] [ashughes] Updates: details

Builds: Firefox 8.0b4(build1)
Litmus:testrun

Automated Tests

The following are the detailed results of the automated BFT test runs.

  • [DONE] [ashughes] Windows 2000: PASS
  • [DONE] [ashughes] Windows XP: PASS
  • [DONE] [ashughes] Windows Vista: PASS
  • [DONE] [ashughes] Windows 7: PASS
  • [DONE] [ashughes] Windows 7 64-bit: PASS
  • [DONE] [ashughes] Mac OS X 10.6: PASS
  • [DONE] [ashughes] Mac OS X 10.7: PASS
  • [DONE] [ashughes] Ubuntu 11.04: PASS
  • [DONE] [ashughes] Ubuntu 11.04 64-bit: PASS
  • Reports: Litmus, Mozmill
Issues Found

Manual Tests

Smoketests

The following are the detailed results of the manual smoketests.

  • [DONE] [Simona] Windows 2000: PASS
  • [DONE] [AndreiD] Windows XP: PASS
  • [DONE] [Simona] Windows Vista: PASS
  • [DONE] [Mihaela] Windows 7: PASS
  • [DONE] [Paul] Windows 7 64-bit: PASS
  • [DONE] [VladG] Mac OS X 10.6: PASS
  • [DONE] [VladG] Mac OS X 10.7: PASS
  • [DONE] [Virgil] Ubuntu 11.04: PASS
  • [DONE] [Virgil] Ubuntu 11.10 64-bit: PASS
  • Litmus testrun, report
  • Firefox 8.0b4 build1
Exploratory Tests

The following are the detailed results of the exploratory testing - Web App compatibility

  • [DONE] [Simona] Windows 2000: PASS
  • [DONE] [AndreiD] Windows XP: PASS
  • [DONE] [Simona] Windows Vista: PASS
  • [DONE] [Mihaela] Windows 7: PASS
  • [DONE] [Paul] Windows 7 64-bit: PASS
  • [DONE] [VladG] Mac OS X 10.6: PASS
  • [DONE] [VladG] Mac OS X 10.7: PASS
  • [DONE] [Virgil] Ubuntu 11.04: PASS
  • [DONE] [Virgil] Ubuntu 11.10 64-bit: PASS
  • Litmus report
Issues Found

bug 696096 Items are not shown correctly in shopping cart [NEW]

Bug Fix Verification

Verify 100% QA+ bugs, as many as possible FIXED bugs

Updates

The following are details of update verifications for Firefox 8 beta 4

Betatest:

  • run some manual exploratory tests around updating with add-ons, plugins, session/profile data, etc
  • How to set update channel to betatest:
    • Find the defaults/prefs/channel-prefs.js file in your Firefox application folder
    • Open it with a text editor and change the "beta" channel to "betatest", save and exit
    • Start Firefox and check app.update.channel in about:config to verify it changed
    • NOTE: On Windows Vista and 7 will not let you save the changes unless you run your text editor as an Administrator -- do so by right clicking the launcher for the text editor and select "Run as Administrator"
  • What to test
    • Build a realistic amount of profile and session data on one of the previous betas (4.0b8 through 8.0b4):
    • try installing several add-ons (some out of date)
    • try installing several plugins (some out of date)
    • go to various top sites like Youtube, Banking sites, Social networks, news sites, games, webmail etc
    • put some of the tabs in App Tabs and Panorama groupings
    • Ultimately just play around with your browser for an hour or so like you would on a day to day basis
    • After a while, check for and install the Firefox update to 8.0b4 and restart
  • Result -- check after restart:
    • no loss of session data
    • no loss of profile data
    • no loss of history, bookmarks
    • no loss of add-ons
    • no obvious breakage with Firefox and the sites you use most often
  • What to report
    • File bugs using the [8b4] whiteboard tag

Exploratory testing

  • [DONE] [Andrei] Windows XP:PASS
  • [DONE] [Virgil] Ubuntu 11.04 x86:PASS
  • [DONE] [Mihaela] Windows 7:PASS
  • [DONE] [VladG] MacOS X 10.6:PASS
    • Exploratory work spreadsheet Link


Releasetest: report

  • [DONE] [ashughes] Windows 2000: PASS
  • [DONE] [ashughes] Windows XP: PASS
  • [DONE] [ashughes] Windows Vista: PASS
  • [DONE] [ashughes] Windows 7: PASS
  • [DONE] [ashughes] Windows 7 64-bit: PASS
  • [DONE] [ashughes] Mac OS X 10.6: PASS
  • [DONE] [ashughes] Mac OS X 10.7: PASS
  • [DONE] [ashughes] Ubuntu 11.04: PASS
  • [DONE] [ashughes] Ubuntu 11.04 64-bit: PASS

Beta: report

  • [DONE] [ashughes] Windows 2000: PASS
  • [DONE] [ashughes] Windows XP: PASS
  • [DONE] [ashughes] Windows Vista: PASS
  • [DONE] [ashughes] Windows 7: PASS
  • [DONE] [ashughes] Windows 7 64-bit: PASS
  • [DONE] [ashughes] Mac OS X 10.6: PASS
  • [DONE] [ashughes] Mac OS X 10.7: PASS
  • [DONE] [ashughes] Ubuntu 11.04: PASS
  • [DONE] [ashughes] Ubuntu 11.04 64-bit: PASS
Issues Found

Beta 5

The following tasks need to be completed to sign-off the Beta merge

  • [ON TRACK] [ashughes] Automated Tests: details
  • [ON TRACK] [softvision] Manual Tests: details
  • [ON TRACK] [softvision] Bug fix verifications details
  • [ON TRACK] [ashughes] Updates: details

Builds: Firefox 8.0b5(build1)
Litmus:testrun

Automated Tests

The following are the detailed results of the automated BFT test runs.

  • [DONE] [ashughes] Windows 2000: PASS
  • [DONE] [ashughes] Windows XP: PASS
  • [DONE] [ashughes] Windows Vista: PASS
  • [DONE] [ashughes] Windows 7: PASS
  • [DONE] [ashughes] Windows 7 64-bit: PASS
  • [DONE] [ashughes] Mac OS X 10.6: PASS
  • [DONE] [ashughes] Mac OS X 10.7: PASS
  • [DONE] [ashughes] Ubuntu 11.04: PASS
  • [DONE] [ashughes] Ubuntu 11.04 64-bit: PASS
  • Reports: Litmus, Mozmill
Issues Found

Manual Tests

Smoketests

The following are the detailed results of the manual smoketests.

  • [DONE] [Simona] Windows 2000: PASS
  • [DONE] [Ioana] Windows XP: PASS
  • [DONE] [Simona] Windows Vista: PASS
  • [DONE] [AndreiD] Windows 7: PASS
  • [DONE] [AndreiD] Windows 7 64-bit: PASS
  • [DONE] [VladG] Mac OS X 10.6: PASS
  • [DONE] [VladG] Mac OS X 10.7: PASS
  • [DONE] [Mihaela] Ubuntu 11.04: PASS
  • [DONE] [Virgil] Ubuntu 11.10 64-bit: PASS
  • Litmus testrun, report
  • Firefox 8.0b5 build1
Exploratory Tests

The following are the detailed results of the exploratory testing - Web App compatibility

  • [DONE] [Simona] Windows 2000: PASS
  • [DONE] [Ioana] Windows XP: PASS
  • [DONE] [Simona] Windows Vista: PASS
  • [DONE] [AndreiD] Windows 7: PASS
  • [DONE] [AndreiD] Windows 7 64-bit: PASS
  • [DONE] [VladG] Mac OS X 10.6: PASS
  • [DONE] [VladG] Mac OS X 10.7: PASS
  • [DONE] [Mihaela] Ubuntu 11.04: PASS
  • [DONE] [Virgil] Ubuntu 11.04 64-bit: PASS
  • Litmus report
  • [DONE] [gmontagu] Windows 7, es-AR: PASS
Issues Found
  • bug 697696 - Highlight issue in amazon's password box [NEW]
  • bug 697698 - Pdf pages no longer loads if changing application handling pref on Linux [NEW]
  • bug 697725 - Amazon tab favicon flickers when page is loading [NEW]

Bug Fix Verification

Verify 100% QA+ bugs, as many as possible FIXED bugs

  • Bugs: QA+, FIXED
  • Fixed bugs verification spreadsheet Link
  • Highlights
    • Tab Animation has been backed out from all branches. This is visible in bug 690227

Updates

The following are details of update verifications for Firefox 8 beta 5

Betatest:

  • run some manual exploratory tests around updating with add-ons, plugins, session/profile data, etc
  • How to set update channel to betatest:
    • Find the defaults/prefs/channel-prefs.js file in your Firefox application folder
    • Open it with a text editor and change the "beta" channel to "betatest", save and exit
    • Start Firefox and check app.update.channel in about:config to verify it changed
    • NOTE: On Windows Vista and 7 will not let you save the changes unless you run your text editor as an Administrator -- do so by right clicking the launcher for the text editor and select "Run as Administrator"
  • What to test
    • Build a realistic amount of profile and session data on one of the previous betas (4.0b8 through 8.0b5):
    • try installing several add-ons (some out of date)
    • try installing several plugins (some out of date)
    • go to various top sites like Youtube, Banking sites, Social networks, news sites, games, webmail etc
    • put some of the tabs in App Tabs and Panorama groupings
    • Ultimately just play around with your browser for an hour or so like you would on a day to day basis
    • After a while, check for and install the Firefox update to 8.0b5 and restart
  • Result -- check after restart:
    • no loss of session data
    • no loss of profile data
    • no loss of history, bookmarks
    • no loss of add-ons
    • no obvious breakage with Firefox and the sites you use most often
  • What to report
    • File bugs using the [8b5] whiteboard tag

Exploratory testing

  • [DONE] [Ioana] Windows XP:PASS
  • [DONE] [Virgil] Ubuntu 11.10 x86_64:PASS
  • [DONE] [Andrei] Windows 7:PASS
  • [DONE] [VladG] MacOS X 10.6:PASS
    • Exploratory work spreadsheet Link

Releasetest: report

  • [DONE] [ashughes] Windows 2000: PASS
  • [DONE] [ashughes] Windows XP: PASS
  • [DONE] [ashughes] Windows Vista: PASS
  • [DONE] [ashughes] Windows 7: PASS
  • [DONE] [ashughes] Windows 7 64-bit: PASS
  • [DONE] [ashughes] Mac OS X 10.6: PASS
  • [DONE] [ashughes] Mac OS X 10.7: PASS
  • [DONE] [ashughes] Ubuntu 11.04: PASS
  • [DONE] [ashughes] Ubuntu 11.04 64-bit: PASS

Beta: report

  • [DONE] [juanb] Windows 2000: Pass
  • [DONE] [juanb] Windows XP: Pass
  • [ON TRACK] [tester] Windows Vista: result
  • [DONE] [juanb] Windows 7: Pass
  • [DONE] [tester] Windows 7 64-bit: Pass
  • [DONE] [juanb] Mac OS X 10.6: Pass
  • [DONE] [juanb] Mac OS X 10.7: Pass
  • [DONE] [juanb] Ubuntu 11.04: Pass
  • [DONE] [juanb] Ubuntu 11.04 64-bit: Pass
  • Notes: [juanb] - I ran these manually, maximizing coverage such that I covered OS, partials, completes, fallbacks, and locales with the paths that I tried.
Issues Found

Beta 6

The following tasks need to be completed to sign-off the Beta merge

  • [ON TRACK] [automation] Automated Tests: details
  • [ON TRACK] [softvision] Manual Tests: details
  • [ON TRACK] [softvision] Bug fix verifications details
  • [ON TRACK] [automation] Updates: details

Builds: Firefox 8.0b6(build1)
Litmus:testrun

Automated Tests

The following are the detailed results of the automated BFT test runs.

  • [DONE] [ashughes] Windows 2000: PASS
  • [DONE] [ashughes] Windows XP: PASS
  • [DONE] [ashughes] Windows Vista: PASS
  • [DONE] [ashughes] Windows 7: PASS
  • [DONE] [ashughes] Windows 7 64-bit: PASS
  • [DONE] [ashughes] Mac OS X 10.6: PASS
  • [DONE] [ashughes] Mac OS X 10.7: PASS
  • [DONE] [ashughes] Ubuntu 11.04: PASS
  • [DONE] [ashughes] Ubuntu 11.04 64-bit: PASS
  • Reports: Litmus, Mozmill
Issues Found
  • /testSecurity/testGreyLarry.js fails on all platforms
  • /testSecurity/testIdentityPopupOpenClose.js fails on Windows 2000

Manual Tests

Smoketests

The following are the detailed results of the manual smoketests.

  • [DONE] [Simona] Windows 2000: PASS
  • [DONE] [Simona] Windows XP: PASS
  • [DONE] [Paul] Windows Vista: PASS
  • [DONE] [Mihaela] Windows 7: PASS
  • [DONE] [Paul] Windows 7 64-bit: PASS
  • [DONE] [VladG] Mac OS X 10.6: PASS
  • [DONE] [VladG] Mac OS X 10.7: PASS
  • [DONE] [Ioana] Ubuntu 11.10: PASS
  • [DONE] [Virgil] Ubuntu 11.10 64-bit: PASS
  • Litmus testrun, report
  • Firefox 8.0b6 build1
Exploratory Tests

The following are the detailed results of the exploratory testing - Web App compatibility

  • [DONE] [Simona] Windows 2000: PASS
  • [DONE] [Simona] Windows XP: PASS
  • [DONE] [Paul] Windows Vista: PASS
  • [DONE] [Mihaela] Windows 7: PASS
  • [DONE] [Paul] Windows 7 64-bit: PASS
  • [DONE] [VladG] Mac OS X 10.6: PASS
  • [DONE] [VladG] Mac OS X 10.7: PASS
  • [DONE] [Ioana] Ubuntu 11.10: PASS
  • [DONE] [Virgil] Ubuntu 11.10 64-bit: PASS
  • Litmus report
  • [DONE] [gmontagu] Windows 7, es-AR (daily websites): PASS
Issues Found

Bug Fix Verification

Verify 100% QA+ bugs, as many as possible FIXED bugs

Updates

The following are details of update verifications for Firefox 8 beta 6. This is the last beta (RC) before shipping, so update scenarios must be exercised thoroughly before we ship.

UPDATE SCENARIOS TESTING RESULTS - Link

Issues found

  • Bug 699125 - Error message received when attempting to resume a download after upgrading to a new Firefox version [NEW]
  • Bug 699175 - The current theme is not active when updating from Firefox 7.0b6 to Firefox 8.0b6 [NEW]

Betatest:

  • run some manual exploratory tests around updating with add-ons, plugins, session/profile data, etc
  • How to set update channel to betatest:
    • Find the defaults/prefs/channel-prefs.js file in your Firefox application folder
    • Open it with a text editor and change the "beta" channel to "betatest", save and exit
    • Start Firefox and check app.update.channel in about:config to verify it changed
    • NOTE: On Windows Vista and 7 will not let you save the changes unless you run your text editor as an Administrator -- do so by right clicking the launcher for the text editor and select "Run as Administrator"
  • What to test
    • Build a realistic amount of profile and session data on one of the previous betas (4.0b8 through 8.0b6):
    • try installing several add-ons (some out of date)
    • try installing several plugins (some out of date)
    • go to various top sites like Youtube, Banking sites, Social networks, news sites, games, webmail etc
    • put some of the tabs in App Tabs and Panorama groupings
    • Ultimately just play around with your browser for an hour or so like you would on a day to day basis
    • After a while, check for and install the Firefox update to 8.0b6 and restart
  • Result -- check after restart:
    • no loss of session data
    • no loss of profile data
    • no loss of history, bookmarks
    • no loss of add-ons
    • no obvious breakage with Firefox and the sites you use most often
  • What to report
    • File bugs using the [8b6] whiteboard tag

Feature Sign-Off

Releasetest: report

  • [ON TRACK] [ashughes] Windows 2000: RESULT
  • [ON TRACK] [ashughes] Windows XP: RESULT
  • [ON TRACK] [ashughes] Windows Vista: RESULT
  • [ON TRACK] [ashughes] Windows 7: RESULT
  • [ON TRACK] [ashughes] Windows 7 64-bit: RESULT
  • [ON TRACK] [ashughes] Mac OS X 10.6: RESULT
  • [ON TRACK] [ashughes] Mac OS X 10.7: RESULT
  • [ON TRACK] [ashughes] Ubuntu 11.04: RESULT
  • [ON TRACK] [ashughes] Ubuntu 11.04 64-bit: RESULT

Beta: report

  • [ON TRACK] [tester] Windows 2000: result
  • [ON TRACK] [tester] Windows XP: result
  • [ON TRACK] [tester] Windows Vista: result
  • [ON TRACK] [tester] Windows 7: result
  • [ON TRACK] [tester] Windows 7 64-bit: result
  • [ON TRACK] [tester] Mac OS X 10.6: result
  • [ON TRACK] [tester] Mac OS X 10.7: result
  • [ON TRACK] [tester] Ubuntu 11.04: result
  • [ON TRACK] [tester] Ubuntu 11.04 64-bit: result
Issues Found

Beta 6 (build2)

The following tasks need to be completed to sign-off the Beta merge

  • [ON TRACK] [softvision] Manual Tests: details
  • [ON TRACK] [softvision] Bug fix verifications details
  • [ON TRACK] [geo] Updates: details

Builds: Firefox 8.0b6(build2)
Litmus:testrun

Manual Tests

Smoketests

The following are the detailed results of the manual smoketests.

  • [ON TRACK] [Simona] Windows 2000: RESULT
  • [ON TRACK] [Ioana] Windows XP: RESULT
  • [ON TRACK] [Simona] Windows Vista: RESULT
  • [ON TRACK] [Mihaela] Windows 7: RESULT
  • [ON TRACK] [Mihaela] Windows 7 64-bit: RESULT
  • [ON TRACK] [VladG] Mac OS X 10.6: RESULT
  • [ON TRACK] [VladG] Mac OS X 10.7: RESULT
  • [ON TRACK] [Ioana] Ubuntu 11.04: RESULT
  • [ON TRACK] [Virgil] Ubuntu 11.04 64-bit: RESULT
  • Litmus testrun, report
  • Firefox 8.0b6 build2
Exploratory Tests

Focus on add-ons and web compatibility.

  • [ON TRACK] [Simona] Windows 2000: RESULT
  • [ON TRACK] [Ioana] Windows XP: RESULT
  • [ON TRACK] [Simona] Windows Vista: RESULT
  • [ON TRACK] [Mihaela] Windows 7: RESULT
  • [ON TRACK] [Mihaela] Windows 7 64-bit: RESULT
  • [ON TRACK] [VladG] Mac OS X 10.6: RESULT
  • [ON TRACK] [VladG] Mac OS X 10.7: RESULT
  • [ON TRACK] [Ioana] Ubuntu 11.04: RESULT
  • [ON TRACK] [Virgil] Ubuntu 11.04 64-bit: RESULT
  • Litmus report
Issues Found

Bug Fix Verifications

Verify 100% QA+ bugs, as many as possible FIXED bugs

  • Bugs:

bug 680802 - VERIFIED FIXED

bug 689375 - VERIFIED FIXED

bug 698753 - VERIFIED FIXED

bug 687367 - Mobile

  • Fixed bugs verification spreadsheet Link

Manual spot checks

  • Exploratory work spreadsheet - Link

Issues found

bug 699435 - The third party add-on warning message is misplaced when using a theme [NEW]

Updates

Releasetest: report

  • [ON TRACK] [ashughes] Windows 2000: PASS
  • [ON TRACK] [ashughes] Windows XP: PASS
  • [ON TRACK] [ashughes] Windows Vista: PASS
  • [ON TRACK] [ashughes] Windows 7: PASS
  • [ON TRACK] [ashughes] Windows 7 64-bit: PASS
  • [ON TRACK] [ashughes] Mac OS X 10.6: PASS
  • [ON TRACK] [ashughes] Mac OS X 10.7: PASS
  • [ON TRACK] [ashughes] Ubuntu 11.04: PASS
  • [ON TRACK] [ashughes] Ubuntu 11.04 64-bit: PASS

Beta: report

  • [ON TRACK] [tester] Windows 2000: PASS
  • [ON TRACK] [tester] Windows XP: PASS
  • [ON TRACK] [tester] Windows Vista: PASS
  • [ON TRACK] [tester] Windows 7: PASS
  • [ON TRACK] [tester] Windows 7 64-bit: PASS
  • [ON TRACK] [tester] Mac OS X 10.6: PASS
  • [ON TRACK] [tester] Mac OS X 10.7: PASS
  • [ON TRACK] [tester] Ubuntu 11.04: PASS
  • [ON TRACK] [tester] Ubuntu 11.04 64-bit: PASS
Issues Found

Firefox 8 Final

The following tasks need to be completed to sign-off before final release.

  • [ON TRACK] [automation] Automated Tests: details
  • [ON TRACK] [geo] Updates: details

Builds: Firefox 8.0 RC
Litmus:testrun

Automated Tests

  • [ok] [automation] Windows 2000: PASS
  • [ok] [automation] Windows XP: PASS
  • [ok] [automation] Windows Vista: PASS
  • [ok] [automation] Windows 7: PASS
  • [ok] [automation] Windows 7 64-bit: PASS
  • [ok] [automation] Mac OS X 10.6: PASS
  • [ok] [automation] Mac OS X 10.7: PASS
  • [ok] [automation] Ubuntu 11.04: PASS
  • [ok] [automation] Ubuntu 11.04 64-bit: PASS
  • Reports: Litmus, Mozmill
Issues Found

Bug Fix Verifications

Verify 100% QA+ bugs, as many as possible FIXED bugs

Updates

Releasetest: report

  • [ON TRACK] [automation] Windows 2000: PASS
  • [ON TRACK] [automation] Windows XP: PASS
  • [ON TRACK] [automation] Windows Vista: PASS
  • [ON TRACK] [automation] Windows 7: PASS
  • [ON TRACK] [automation] Windows 7 64-bit: PASS
  • [ON TRACK] [automation] Mac OS X 10.6: PASS
  • [ON TRACK] [automation] Mac OS X 10.7: PASS
  • [ON TRACK] [automation] Ubuntu 11.04: PASS
  • [ON TRACK] [automation] Ubuntu 11.04 64-bit: PASS

Release: report

  • [ON TRACK] [tester] Windows 2000: result
  • [ON TRACK] [tester] Windows XP: result
  • [ON TRACK] [tester] Windows Vista: result
  • [ON TRACK] [tester] Windows 7: result
  • [ON TRACK] [tester] Windows 7 64-bit: result
  • [ON TRACK] [tester] Mac OS X 10.6: result
  • [ON TRACK] [tester] Mac OS X 10.7: result
  • [ON TRACK] [tester] Ubuntu 11.04: result
  • [ON TRACK] [tester] Ubuntu 11.04 64-bit: result
Issues Found

Firefox 8.0.1

As of 11-20 we have build2 candidates. The results from build1 will be reset, but a new testrun will be created for it.

Automated Tests

We will run the automated tests using Mozmill as soon as we get build candidates.

  • [DONE] [ashughes] Windows 2000: PASS
  • [DONE] [ashughes] Windows XP: PASS
  • [DONE] [ashughes] Windows Vista: PASS
  • [DONE] [ashughes] Windows 7: PASS
  • [DONE] [ashughes] Windows 7 64-bit: PASS
  • [DONE] [ashughes] Mac OS X 10.6: PASS
  • [DONE] [ashughes] Mac OS X 10.7: PASS
  • [DONE] [ashughes] Ubuntu 11.04: PASS
  • [DONE] [ashughes] Ubuntu 11.04 64-bit: PASS
  • Reports: Litmus, Mozmill

Issues Found

Manual Tests

Smoketests

Manual smoketests were skipped in favor of focused testing around the fixes, including exploratory testing.

  • [ON TRACK] [Simona] Windows 2000: result
  • [ON TRACK] [Ioana] Windows XP: result
  • [ON TRACK] [Simona] Windows Vista: result
  • [ON TRACK] [Mihaela] Windows 7: result
  • [ON TRACK] [Paul] Windows 7 64-bit: result
  • [ON TRACK] [VladG] Mac OS X 10.6: result
  • [ON TRACK] [VladG] Mac OS X 10.7: result
  • [ON TRACK] [Virgil] Ubuntu 11.10: result
  • [ON TRACK] [Virgil] Ubuntu 11.10 64-bit: result
  • Litmus testrun, report
  • Firefox 8.0.1 (build2) build2
Exploratory Tests

The following are the detailed results of the exploratory testing - Web App compatibility

  • [ON TRACK] [Simona] Windows 2000: result
  • [DONE] [Ioana] Windows XP: PASS
  • [DONE] [Simona] Windows Vista: PASS
  • [DONE] [Mihaela] Windows 7: PASS
  • [DONE] [Paul] Windows 7 64-bit: PASS
  • [DONE] [VladG] Mac OS X 10.6: PASS
  • [ON TRACK] [VladG] Mac OS X 10.7: result
  • [ON TRACK] [Virgil] Ubuntu 11.10: result
  • [DONE] [Virgil] Ubuntu 11.10 64-bit: PASS
  • Litmus report

Issues Found

  • bug 704133 - Shockwave player is not working anymore with Firefox [NEW]

Bug Verifications

The following bugs need verification on all platforms:

Link to etherpad with our testing efforts

Blockers

  • [DONE] - Bug 700835 - Mac crash with Apple's Java update
  • [DONE] - Bug 699134 - Block request for Roboform
    • We are blocking all versions, below 7.6.2. Only 7.6.3 and 7.6.2 should be allowed.
    • All versions of RoboForm downloads here
    • IMO VERIFIED FIXED - I haven't change the status of this bug.

Results

Issues Found

Updates

READ: For 8.0.1, the following applies:

  • Windows/Linux users already in version 8.0 will NOT be offered updates to 8.0.1
  • All Mac users will be offered updates to 8.0.1: 4...8 -> 8.0.1
  • Windows/Linux users in 4...7.0.1 will be offered updates to 8.0.1

Betatest: PASS (report)

  • Win XP (no updates should be offered)
    • 8.0 - en-US, es-ES, it: No updates offered, as expected.
  • Linux (no updates should be offered)
    • 8.0 - en-US, fr, ja: No updates offered, as expected.
  • Win2000 (no updates should be offered)
    • 8.0 - en-US, ru: No updates offered, as expected.
  • Win7
    • 8.0 - en-US: No updates offered, as expected.

Releasetest: PASS (report)

  • [juanb] - I did the type of manual checks as above (same platforms, same paths), but on the releasetest channel. In addition, I checked that older versions did get an update to 8.0.1

Release: PASS (report)

  • [juanb] - Again, similar types of checks on release. No problems found.
  • [ashughes] - some gaps in results caused by slow mirrors triggering timeout

Issues Found:

3.6.24 Major Update

Tester: ashughes Releasetest: report Beta: report Release: report
Windows XP PASS - 2011-11-29 PASS - 2011-11-30 PASS - 2011-11-30
Windows 7 PASS - 2011-11-29 PASS - 2011-11-30 PASS - 2011-11-30
Mac OS X 10.6 PASS - 2011-11-29 PASS - 2011-11-30 PASS - 2011-11-30
Ubuntu 11.04 PASS - 2011-11-29 PASS - 2011-11-30 PASS - 2011-11-30

NOTE: single failure on each testrun is expected due to changing branches of mozmill-tests

Post-Mortem Notes

Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_8/Test_Plan&oldid=374825"