Releases/firefox 3.6RC2/Test Plan:Major Updates

3.6RC2 Test Plan

Major Update Testing

We will track test results for major updates from Firefox 3.5.7->3.6RC2 here. These take priority over 3.0.17 >3.6RC2 for now. So far a test run and spreadsheet for the 3.5.7->3.6RC2 has been added.

Instructions

• Download Firefox 3.5.7 or 3.0.17
• Install it and change the update channel to majortest
• Restart the browser and select "Check for Updates" from the Help menu
• Run the major update 3.5.7 --> 3.6 test run or major update 3.0.17 --> 3.6 test run
• Make sure all user data is preserved or make a note of what is not.
• Use major-updated Firefox 3.6 and verify that it works as expected.
• Reference: bug 515421 - for 3.5.7; and bug 515417 - for 3.0.17

Create a Rich Profile

Tracked via Google Docs here for 3.5.7 and here for 3.0.17

• Bookmarks & Feeds
  • Bookmarks Toolbar Menu
  • Nested folders and feeds
  • Bookmarks shortcuts, descriptions, properties
• History
• Toolbar Customizations
  • Icon size
  • Buttons removed
  • Buttons added
  • Separators
  • Rezising
• Extensions, Themes, Dictionaries, Language Packs
  • Compatible
  • Incompatible
  • Requiring updates
  • Talkback disabling/removal
  • Fx3 blocklisted
• Plugins
  • Flash
  • Java
  • QT (mac)
  • Fx3.6 Blocklisted
• Search Plugin Customizations
  • Added plugins (imdb)
  • Removed plugins
  • Re-ordered
  • Search history
• Passwords
  • Master password
  • Saved passwords
  • Exceptions
• Certificates
• Cookies
• Download Manager
  • History
  • Default location
  • Download in progress
• Form Data
  • Saved form data
• Preferences
  • Default home page(s)
  • Pop-up preferences
  • Cookies
    • Exceptions
  • Form data
  • Search as you type
  • Default content handlers
    • Default feed reader
    • Default mail handler
  • Security Alerts
  • Safebrowsing
    • Preferences local vs. google's list
  • Preferred language in the preferences
  • Spellchecking
    • Spelling language
    • Word additions
  • Offline vs Online
  • FIPS Settings
• Application State
  • Windows and Tabs
  • Sizing and Position
  • Landing pages
  • Default installation desktop icons
  • Start page search provider
• Files
  • urlclassifier files
• Default vs. custom install locations
• Pave-over Install (Install 3.6 on top of existing 3.x installation)

Results

majortest

Change the update channel to majortest and check for major updates. Details pages should be localized.

• Previous Bugs
  • Bug 483843 fails Test Case 6738.
  • Bug 483843 fails Test Case 6741.
  • Bug 483053 fails Test Case 6727.
  • No Test Case Filed Yet
  • no prompt to update extensions

(3.5.7 --> 3.6) Results

• Windows XP (juanb)
  • en-US: PASS
• Windows 7 (juanb)
  • en-US: PASS
  • de: PASS
• Windows 7 64bit (juanb)
  • en-US: PASS
• Mac (tchung)
  • en-US: PASS
  • Notes
    • Upgrade window notes that no information is present about RC2
    • Link to details in update dialog points to: http://www.mozilla.com/en-US/firefox/3.6/details/index.html. This page is 404.
    • Ran through blocklist tests for extensions and plugins before MU. all good.
• Linux (juanb)
  • en-US: PASS

(3.0.17 --> 3.6) Results

• Windows XP (juanb) - Passing (Jan 29)
  • Notes: Ran extended tests in Litmus. Observed bug 542391 in this scenario as well. We shipped 3.6 with this problem, but a fix is coming soon.
• Windows 7 64bit (ashughes)
  • Notes:
• Mac OS X (aravind)
  • en-US - Pass
  • Notes:
    • bug 542391 repeats
    • bug 540595 repeats
• Linux (aravindm) -
  • en-US - Pass
  • Notes:
    • bug 542391 repeats in Extended tests.

Unsupported OSs (Make sure MU is not presented) on majortest

There haven't been changes in OS support between 3.0x and 3.6.