Firefox:1.5.0.x:Major Update 1.5.0.x to 2.0.0.x:Test Results:15012-2006: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(New page: Testing results tracking page for major updates. We have tested major updates in the past by following the [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&test...)
 
 
(29 intermediate revisions by 3 users not shown)
Line 1: Line 1:
Testing results tracking page for major updates. We have tested major updates in the past by following the [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=38&subgroup_id=623 major software update test cases in Litmus], but currently we can do this type of test on "releasetest" going from 1.5.0.12->2.0.0.6.
Use the major software update [http://wiki.mozilla.org/Firefox:1.5.0.x:Major_Update_1.5.0.x_to_2.0.0.x testing strategy page] as reference. In-line Details have been translated for all locales. Eulas are not translated and they default to the en-US version.
Use the major software update [http://wiki.mozilla.org/Firefox:1.5.0.x:Major_Update_1.5.0.x_to_2.0.0.x testing strategy page] as reference. In-line Details have been translated for all locales. Eulas are not translated and they default to the en-US version.


Line 19: Line 17:


== Detailed Results ==
== Detailed Results ==
= Mac OS X (tester)=
= Mac OS X (juanb)=
* Locale: '''en-US'''
* Locale: '''en-US'''
** Channel: releasetest
** Channel: releasetest
** Update Type: complete, fallback
** Update Type: complete, fallback
** Version String:  
** Version String: Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.6) Gecko/2007072517 Firefox/2.0.0.6
** Result: '''RESULT''')
** Result: '''PASS'''
** Notes:  
** Notes: New profile, simple MU check.


* Locale: '''de'''
* Locale: '''ja-jp-mac'''
** Channel: releasetest
** Channel: releasetest
** Update Type: complete
** Update Type: complete, fallback
** Version String:  
** Version String: Mozilla/5.0 (Macintosh; U; Intel Mac OS X; ja-JP-mac; rv:1.8.1.6) Gecko/2007072517 Firefox/2.0.0.6
** Result: '''RESULT''')
** Result: '''PASS'''
** Notes:  
** Notes:  


* Locale: '''fr'''
* Locale: '''ko'''
** Channel: releasetest
** Channel: releasetest
** Update Type: complete
** Update Type: complete, fallback
** Version String:  
** Version String: Mozilla/5.0 (Macintosh; U; Intel Mac OS X; ko; rv:1.8.1.6) Gecko/2007072517 Firefox/2.0.0.6
** Result: '''RESULT''')
** Result: '''PASS'''
** Notes:
** Notes:


= Windows XP (tester) =
= Windows XP (abillings) =


* Locale: '''en-US'''
* Locale: '''en-US'''
** Channel: releasetest
** Channel: releasetest
** Update Type: complete
** Update Type: complete, fallback
** Version String:  
** Version String: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.6) Gecko/2007072518 Firefox/2.0.0.6
** Result: '''RESULT''')
** Result: '''PASS'''
** Notes:
** Notes:


* Locale: '''ca'''
* Locale: '''de'''
** Channel: releasetest
** Channel: releasetest
** Update Type: complete
** Update Type: complete
** Version String:  
** Version String: Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.6) Gecko/2007072518 Firefox/2.0.0.6
** Result: '''RESULT''')
** Result: '''PASS'''
** Notes:
** Notes:


* Locale: '''fi'''
* Locale: '''it'''
** Channel: releasetest
** Channel: releasetest
** Update Type: complete, fallback
** Update Type: complete, fallback
** Version String:  
** Version String: Mozilla/5.0 (Windows; U; Windows NT 5.1; it; rv:1.8.1.6) Gecko/2007072518 Firefox/2.0.0.6
** Result: '''RESULT''')
** Result: '''PASS'''
** Notes:
** Notes:


= Windows Vista (tester) =
= Windows Vista (stephend) =
* Locale: '''en-US'''
* Locale: '''en-US'''
** Channel: releasetest
** Channel: releasetest
** Update Type: complete
** Update Type: complete
** Version String:  
** Version String: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.8.1.6) Gecko/20070725 Firefox/2.0.0.6
** Result: '''RESULT''')
** Result: '''PASS'''
** Notes: I am also offered (on restart after the update), to upgrade to 2.0.0.7
 
* Locale: '''zh-CN'''
** Channel: releasetest
** Update Type: complete, fallback
** Version String: Mozilla/5.0 (Windows; U; Windows NT 6.0; zh-CN; rv:1.8.1.6) Gecko/20070725 Firefox/2.0.0.6
** Result: '''PASS'''
** Notes:
 
* Locale: '''fi'''
** Channel: releasetest
** Update Type: complete, fallback
** Version String: Mozilla/5.0 (Windows; U; Windows NT 6.0; fi; rv:1.8.1.6) Gecko/20070725 Firefox/2.0.0.6
** Result: '''PASS'''
** Notes:
** Notes:


Line 75: Line 87:
** NOTE: If you launch Firefox from the shortcut (without "Run as administrator"), software update will fail.  You will be able to check for updates, download the patch, and restart... but it will not be applied.)
** NOTE: If you launch Firefox from the shortcut (without "Run as administrator"), software update will fail.  You will be able to check for updates, download the patch, and restart... but it will not be applied.)


= Linux (tester) =
= Linux (abillings) =
* Locale: '''en-US'''
* Locale: '''en-US'''
** Channel: releasetest
** Channel: releasetest
** Update Type: complete, fallback
** Update Type: complete, fallback
** Version String:  
** Version String: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.6) Gecko/2007072517 Firefox/2.0.0.6
** Result: '''RESULT''')
** Result: '''PASS'''
** Notes:
** Notes:


* Locale: '''en-GB'''
* Locale: '''fr'''  
** Channel: releasetest
** Channel: releasetest, fallback
** Update Type: complete
** Update Type: complete
** Version String:  
** Version String: Mozilla/5.0 (X11; U; Linux i686; fr; rv:1.8.1.6) Gecko/2007072517 Firefox/2.0.0.6
** Result: '''RESULT''')
** Result: '''PASS'''
** Notes:
** Notes:


* Locale: '''es-ES'''
* Locale: '''pl'''
** Channel: releasetest
** Channel: releasetest
** Update Type: complete
** Update Type: complete
** Version String:  
** Version String: Mozilla/5.0 (X11; U; Linux i686; pl; rv:1.8.1.6) Gecko/2007072517 Firefox/2.0.0.6
** Result: '''RESULT''')
** Result: '''PASS'''
** Notes:
** Notes:


* Locale: '''it'''
* Locale: '''zh-TW'''
** Channel: releasetest
** Channel: releasetest
** Update Type: complete
** Update Type: complete
** Version String:  
** Version String: Mozilla/5.0 (X11; U; Linux i686; zh-TW; rv:1.8.1.6) Gecko/2007072517 Firefox/2.0.0.6
** Result: '''RESULT''')
** Result: '''PASS'''
** Notes:
** Notes:


= Focused Testing =
= Focused Testing =
Let's try to go through all of the tests in the major updates reference page and test around different kinds of profiles, containing multiple extensions and themes, compatible and incompatible with 2.0x. Keep an eye out for data loss problems, such as bookmarks, and any other preferences that should be preserved after an update.
Let's try to go through all of the tests in the major updates reference page and test around different kinds of profiles, containing multiple extensions and themes, compatible and incompatible with 2.0x. Keep an eye out for data loss problems, such as bookmarks, and any other preferences that should be preserved after an update.

Latest revision as of 20:26, 11 September 2007

Use the major software update testing strategy page as reference. In-line Details have been translated for all locales. Eulas are not translated and they default to the en-US version.

P1 Locales

Pri 1 locales need to be tested for Major Updates.

  • da
  • de
  • es-ES
  • fi
  • fr
  • it
  • ja-JP-mac (mac primarily)
  • ja
  • nl
  • pl
  • zh-CN
  • zh-TW

Detailed Results

Mac OS X (juanb)

  • Locale: en-US
    • Channel: releasetest
    • Update Type: complete, fallback
    • Version String: Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.6) Gecko/2007072517 Firefox/2.0.0.6
    • Result: PASS
    • Notes: New profile, simple MU check.
  • Locale: ja-jp-mac
    • Channel: releasetest
    • Update Type: complete, fallback
    • Version String: Mozilla/5.0 (Macintosh; U; Intel Mac OS X; ja-JP-mac; rv:1.8.1.6) Gecko/2007072517 Firefox/2.0.0.6
    • Result: PASS
    • Notes:
  • Locale: ko
    • Channel: releasetest
    • Update Type: complete, fallback
    • Version String: Mozilla/5.0 (Macintosh; U; Intel Mac OS X; ko; rv:1.8.1.6) Gecko/2007072517 Firefox/2.0.0.6
    • Result: PASS
    • Notes:

Windows XP (abillings)

  • Locale: en-US
    • Channel: releasetest
    • Update Type: complete, fallback
    • Version String: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.6) Gecko/2007072518 Firefox/2.0.0.6
    • Result: PASS
    • Notes:
  • Locale: de
    • Channel: releasetest
    • Update Type: complete
    • Version String: Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.6) Gecko/2007072518 Firefox/2.0.0.6
    • Result: PASS
    • Notes:
  • Locale: it
    • Channel: releasetest
    • Update Type: complete, fallback
    • Version String: Mozilla/5.0 (Windows; U; Windows NT 5.1; it; rv:1.8.1.6) Gecko/2007072518 Firefox/2.0.0.6
    • Result: PASS
    • Notes:

Windows Vista (stephend)

  • Locale: en-US
    • Channel: releasetest
    • Update Type: complete
    • Version String: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.8.1.6) Gecko/20070725 Firefox/2.0.0.6
    • Result: PASS
    • Notes: I am also offered (on restart after the update), to upgrade to 2.0.0.7
  • Locale: zh-CN
    • Channel: releasetest
    • Update Type: complete, fallback
    • Version String: Mozilla/5.0 (Windows; U; Windows NT 6.0; zh-CN; rv:1.8.1.6) Gecko/20070725 Firefox/2.0.0.6
    • Result: PASS
    • Notes:
  • Locale: fi
    • Channel: releasetest
    • Update Type: complete, fallback
    • Version String: Mozilla/5.0 (Windows; U; Windows NT 6.0; fi; rv:1.8.1.6) Gecko/20070725 Firefox/2.0.0.6
    • Result: PASS
    • Notes:
  • Tested under various user scenarios, results are available at http://quality.mozilla.org/vista+update+testing
    • NOTE: If you launch Firefox from the shortcut (without "Run as administrator"), software update will fail. You will be able to check for updates, download the patch, and restart... but it will not be applied.)

Linux (abillings)

  • Locale: en-US
    • Channel: releasetest
    • Update Type: complete, fallback
    • Version String: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.6) Gecko/2007072517 Firefox/2.0.0.6
    • Result: PASS
    • Notes:
  • Locale: fr
    • Channel: releasetest, fallback
    • Update Type: complete
    • Version String: Mozilla/5.0 (X11; U; Linux i686; fr; rv:1.8.1.6) Gecko/2007072517 Firefox/2.0.0.6
    • Result: PASS
    • Notes:
  • Locale: pl
    • Channel: releasetest
    • Update Type: complete
    • Version String: Mozilla/5.0 (X11; U; Linux i686; pl; rv:1.8.1.6) Gecko/2007072517 Firefox/2.0.0.6
    • Result: PASS
    • Notes:
  • Locale: zh-TW
    • Channel: releasetest
    • Update Type: complete
    • Version String: Mozilla/5.0 (X11; U; Linux i686; zh-TW; rv:1.8.1.6) Gecko/2007072517 Firefox/2.0.0.6
    • Result: PASS
    • Notes:

Focused Testing

Let's try to go through all of the tests in the major updates reference page and test around different kinds of profiles, containing multiple extensions and themes, compatible and incompatible with 2.0x. Keep an eye out for data loss problems, such as bookmarks, and any other preferences that should be preserved after an update.