3.6RC2 Test Plan

Major Update Testing

We will track test results for major updates from Firefox 3.5.7->3.6RC2 here. These take priority over 3.0.17 >3.6RC2 for now. So far a test run and spreadsheet for the 3.5.7->3.6RC2 has been added.

Instructions

• Download Firefox 3.5.7 or 3.0.17
• Install it and change the update channel to majortest
• Restart the browser and select "Check for Updates" from the Help menu
• Run the major update 3.5.7 --> 3.6 test run or major update 3.0.17 --> 3.6 test run
• Make sure all user data is preserved or make a note of what is not.
• Use major-updated Firefox 3.6 and verify that it works as expected.
• Reference: bug 515421 - for 3.5.7; and bug 515417 - for 3.0.17

Create a Rich Profile

Tracked via Google Docs here for 3.5.7 and here for 3.0.17

• Bookmarks & Feeds
  • Bookmarks Toolbar Menu
  • Nested folders and feeds
  • Bookmarks shortcuts, descriptions, properties
• History
• Toolbar Customizations
  • Icon size
  • Buttons removed
  • Buttons added
  • Separators
  • Rezising
• Extensions, Themes, Dictionaries, Language Packs
  • Compatible
  • Incompatible
  • Requiring updates
  • Talkback disabling/removal
  • Fx3 blocklisted
• Plugins
  • Flash
  • Java
  • QT (mac)
  • Fx3.6 Blocklisted
• Search Plugin Customizations
  • Added plugins (imdb)
  • Removed plugins
  • Re-ordered
  • Search history
• Passwords
  • Master password
  • Saved passwords
  • Exceptions
• Certificates
• Cookies
• Download Manager
  • History
  • Default location
  • Download in progress
• Form Data
  • Saved form data
• Preferences
  • Default home page(s)
  • Pop-up preferences
  • Cookies
    • Exceptions
  • Form data
  • Search as you type
  • Default content handlers
    • Default feed reader
    • Default mail handler
  • Security Alerts
  • Safebrowsing
    • Preferences local vs. google's list
  • Preferred language in the preferences
  • Spellchecking
    • Spelling language
    • Word additions
  • Offline vs Online
  • FIPS Settings
• Application State
  • Windows and Tabs
  • Sizing and Position
  • Landing pages
  • Default installation desktop icons
  • Start page search provider
• Files
  • urlclassifier files
• Default vs. custom install locations
• Pave-over Install (Install 3.6 on top of existing 3.x installation)

Results

majortest

Change the update channel to majortest and check for major updates. Details pages should be localized.

• Previous Bugs
  • Bug 483843 fails Test Case 6738.
  • Bug 483843 fails Test Case 6741.
  • Bug 483053 fails Test Case 6727.
  • No Test Case Filed Yet
  • no prompt to update extensions

(3.5.7 --> 3.6) Results

• Windows XP (juanb)
  • en-US: PASS
• Windows 7 (juanb)
  • en-US: PASS
  • de: PASS
• Windows 7 64bit (juanb)
  • en-US: PASS
• Mac (tchung)
  • en-US: PASS
  • Notes
    • Upgrade window notes that no information is present about RC2
    • Link to details in update dialog points to: http://www.mozilla.com/en-US/firefox/3.6/details/index.html. This page is 404.
    • Ran through blocklist tests for extensions and plugins before MU. all good.
• Linux (juanb)
  • en-US: PASS

(3.0.17 --> 3.6) Results

• Windows XP (juanb) - en-US, es-ES: Passing
  • Notes: Ran extended tests in Litmus. Observed bug 542391 in this scenario as well. We shipped 3.6 with this problem.
• Windows 7 64bit (ashughes) - en-US: Passing
  • Notes: Extended Litmus tests ran. Based on the results in the spreadsheet, Addon Update dialog never appeared bug 542391. Session restore was very slow to restore (10 minutes) with some pages loading to connection error pages (not reproducible with a clean profile, only rich profile).
  • bug 543610 - Add-on Update preempted by FIPS password dialog
• Mac OS X (aravindm)
  • en-US - Pass
  • fr - Pass
  • Notes:
    • bug 542391 repeats
    • bug 540595 repeats
• Linux (aravindm) -
  • en-US - Pass
  • fr - Pass
  • Notes:
    • bug 542391 repeats in Extended tests.

Unsupported OSs (Make sure MU is not presented) on majortest

There haven't been changes in OS support between 3.0x and 3.6.