QA/Firefox3/TestPlan/MajorUpdate/Results:20014 fx3.0

From MozillaWiki
< QA‎ | Firefox3‎ | TestPlan‎ | MajorUpdate
Jump to: navigation, search

Major Update Test Results: Firefox 2.0.0.14 to Firefox 3.0 on majortest

We will track the second iteration of major updates test results in this page. The tests can be found in the Firefox 3 catchall test suite in Litmus.

Instructions

  • Download the latest Fx2.x version for which a major update is offered, see bug 394046
  • Install it and change the update channel to majortest
  • Restart the browser and select "Check for Updates" from the Help menu
  • Create a rich profile
  • Follow the Litmus test suite for major update Fx2-Fx3 Major Update list
  • Make sure all user data is preserved or make a note of what is not.
  • Use major-updated Fx3 and check all is well.
  • NOTE: This is for MU testing purposes only. Please do not modify any files if you are not actively testing with the Mozilla QA team. Thanks!

Create a Rich Profile

  • Bookmarks & Feeds
    • Bookmarks Toolbar Menu
    • Nested folders and feeds
    • Bookmarks shortcuts, descriptions, properties
  • History
  • Toolbar Customizations
    • Icon size
    • Buttons removed
    • Buttons added
    • Separators
    • Rezising
  • Extensions, Themes, Dictionaries, Language Packs
    • Compatible
    • Incompatible
    • Requiring updates
    • Talkback disabling/removal
    • Fx3 blocklisted
  • Plugins
    • Flash
    • Older Flash verions ?
    • Java
    • Older Java versions ?
    • QT (mac)
    • ...
    • Fx3 Blocklisted
  • Search Plugin Customizations
    • Added plugins (imdb)
    • Removed plugins
    • Re-ordered
    • Search history
  • Passwords
    • Master password
    • Saved passwords
      • Multiple passwords in same domain
    • Exceptions
  • Certificates
  • Cookies
  • Download Manager
    • History
    • Default location
    • Download in progress
  • Form Data
    • Saved form data
  • Preferences
    • Default home page(s)
    • Pop-up preferences
    • Cookies
      • Exceptions
    • Form data
    • Search as you type
    • Default content handlers
      • Default feed reader
      • Default mail handler
    • Security Alerts
    • Safebrowsing
      • Preferences local vs. g o o g l e's list
    • Preferred language in the preferences
    • Spellchecking
      • Spelling language
      • Word additions
    • Offline vs Online
  • Application State
    • Windows and Tabs
    • Sizing and Position
    • Landing pages
    • Default installation desktop icons
    • Start page search provider
  • Files
    • urlclassifier files
  • Default vs. custom install locations

Windows XP (Hasham)

  • en-US
    • Profile creation: DONE
    • MU Test Suite Run: DONE
    • See bug list at bottom.
  • de
    • Spotcheck
    • See bug list at bottom.
  • it
    • Spotcheck
    • See bug list at bottom.

Windows Vista (juanb)

  • en-US
    • Profile creation: Completed
    • MU Test Suite Run: Completed
    • Notes: I will note the plugins, extensions, dictionaries, etc.. that I will be testing with. And perhaps I will link to those so other people can try them, too.
      • Form data, and search plugin saved searches don't seem to be preserved in my vm across sessions (browser restarts). So this data is not being preserved after the major upate is applied. Keep an eye out for this.

Mac 10.4.x (tracy)

  • en-US
    • status: FAIL
      • see bug list below
  • ja-jp-mac
    • status: FAIL
      • no change in major update behavior from en-US
      • see bug list below
  • fr
    • status: FAIL
      • no change in major update behavior from en-US
      • see bug list below

Mac 10.5.x (tester)

  • en-US
    • Profile creation: progress%
    • MU Test Suite Run: progress%

Linux (abillings)

  • en-US
    • Profile creation: 100%
    • MU Test Suite Run: 100%
  • pl
    • Profile creation: 100%
    • MU Test Suite Run: 100%
  • nl
    • Profile creation: 100%
    • MU Test Suite Run: 100%

Win98

Make sure MU is not presented

Mac 10.3.x

Make sure MU is not presented

Detailed Results

  • Results Spreadsheet (20014 -> 3.0)
  • Open MU Bugs
  • New Bugs Found:
    • bug 446527 - MU not offered when some language packs are installed
    • bug 446671 - Fx3 defaults for Security Warning Settings (2nd and 5th "On") overwrite what is set in 2.0.0.14
    • bug 446696 - form data history not remembered across sessions when (some) plugin installed
    • bug 447047 - "AUS: Update XML File Malformed (200)" when updating with SSL/TLS disabled (not restricted to MU).
    • bug 446446 - 2.0 => 3.0 Major Update EULA links open within the EULA window.