Firefox:1.5.0.x:Major Update 1.5.0.x to 2.0.0.x:Test Results: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
No edit summary
 
(73 intermediate revisions by 6 users not shown)
Line 1: Line 1:
Testing results tracking page for major updates. We have tested major updates in the past by following the [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=38&subgroup_id=623 major software update test cases in Litmus], but currently we can do this type of test on "releasetest" going from 1.5.0.9->2.0.0.1. Bear in mind that the testing environment is temporary.
Testing results tracking page for major updates. We have tested major updates in the past by following the [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=38&subgroup_id=623 major software update test cases in Litmus], but currently we can do this type of test on "releasetest" going from 1.5.0.12->2.0.0.6.


Use the major software update [http://wiki.mozilla.org/Firefox:1.5.0.x:Major_Update_1.5.0.x_to_2.0.0.x testing strategy page] as reference. A majority of the locales will have localized in-line details/EULAS in place, and we should make sure those are there or if not they should default to en-us pages.
Use the major software update [http://wiki.mozilla.org/Firefox:1.5.0.x:Major_Update_1.5.0.x_to_2.0.0.x testing strategy page] as reference. In-line Details have been translated for all locales. Eulas are not translated and they default to the en-US version.


= Win XP =
[http://wiki.mozilla.org/Firefox:1.5.0.x:Major_Update_1.5.0.x_to_2.0.0.x:Test_Results:15012-2006_betatest '''15012-2006 Results on betatest channel''']
* en-US
* 1509 Build ID: - Ending 2001 Build ID:
* Version String:
* Conditions: New profile, ...
* Restult: '''PASSing'''
* Notes: After update and restart, I see two tabs open "You've updated..." and what I set as my home page.


* fr
[http://wiki.mozilla.org/Firefox:1.5.0.x:Major_Update_1.5.0.x_to_2.0.0.x:Test_Results:15012-2006 '''15012-2006 Results on releasetest''']
* 1509 Build ID: - Ending 2001 Build ID:
* Version String:
* Conditions: Profile with bookmarks, feeds, passwords saved, form field data saved, extension, search plugin added, compatible and incompatible (with 2.x) extensions, ...
* Restult: '''PASSing'''
* Notes: Details are localized.


* fi
[http://wiki.mozilla.org/Firefox:1.5.0.x:Major_Update_1.5.0.x_to_2.0.0.x:Test_Results:15012-2006_rollout '''15012-2006 Live Spot Checks''']
* 1509 Build ID: - Ending 2001 Build ID:
* Version String:
* Restult: '''PASS/FAIL'''


Tested by: tomcat on Windows x64 SP1
----


* en-US
[http://wiki.mozilla.org/Firefox:1.5.0.x:Major_Update_1.5.0.x_to_2.0.0.x:Test_Results:15012 '''15012-2004 Results on releasetest''']
* 1509 Build ID: - Ending 2001 Build ID:
* Version String: Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.1.2pre) Gecko/20070120 BonEcho/2.0.0.2pre ID:2007012003
* Result: '''PASS'''


* de
[http://wiki.mozilla.org/Firefox:1.5.0.x:Major_Update_1.5.0.x_to_2.0.0.x:Test_Results:15012_beta '''15012-2004 Results on beta channel''']
* 1509 Build ID: - Ending 2001 Build ID:
* Version String: Mozilla/5.0 (Windows; U; Windows NT 5.2; de; rv:1.8.1.2pre)Gecko/20070120 BonEcho/2.0.0.2pre ID:2007012003
* Result: '''PASS'''


* en-GB
[http://wiki.mozilla.org/Firefox:1.5.0.x:Major_Update_1.5.0.x_to_2.0.0.x:Test_Results:15012_prerollout '''15012-2004 Results on releasetest after CJKT issue fix (6/27)''']
* 1509 Build ID: - Ending 2001 Build ID:
* Version String: Mozilla/5.0 (Windows; U; Windows NT 5.2; en-GB; rv:1.8.1.1)Gecko/20061204 Firefox/2.0.0.1 ID:2006120418
* Result: '''PASS'''


* sv-SE
[http://wiki.mozilla.org/Firefox:1.5.0.x:Major_Update_1.5.0.x_to_2.0.0.x:Test_Results:15012_rollout '''15012-2004 Live Spot Checks (6/28) ~@3pm''']
* 1509 Build ID: - Ending 2001 Build ID:
* Version String:Mozilla/5.0 (Windows; U; Windows NT 5.2; sv-SE; rv:1.8.1.1)Gecko/20061204 Firefox/2.0.0.1 ID:2006120418
* Result: '''PASS'''
* Note: No localised page for this locale
 
* he
* 1509 Build ID: - Ending 2001 Build ID:
* Version String: Mozilla/5.0 (Windows; U; Windows NT 5.2; he; rv:1.8.1.1)Gecko/20061204 Firefox/2.0.0.1 ID:2006120418
* Result: '''PASS'''
* Note: L10N Site passed on the 2nd run
 
* ja
* 1509 Build ID: - Ending 2001 Build ID:
* Version String: Mozilla/5.0 (Windows; U; Windows NT 5.2; ja; rv:1.8.1.1)Gecko/20061204 Firefox/2.0.0.1 ID:2006120418
* Result: '''PASS'''
 
* nl
* 1509 Build ID: - Ending 2001 Build ID:
* Version String: Mozilla/5.0 (Windows; U; Windows NT 5.2; nl; rv:1.8.1.1)Gecko/20061204 Firefox/2.0.0.1 ID:2006120418
* Result: '''PASS'''
 
* pl
* 1509 Build ID: - Ending 2001 Build ID:
* Version String:Mozilla/5.0 (Windows; U; Windows NT 5.2; nl; rv:1.8.1.1)Gecko/20061204 Firefox/2.0.0.1 ID:2006120418
* Result: '''PASS'''
 
* zh-TW
* 1509 Build ID: - Ending 2001 Build ID:
* Version String: Mozilla/5.0 (Windows; U; Windows NT 5.2; zh-TW; rv:1.8.1.1)Gecko/20061204 Firefox/2.0.0.1 ID:2006120418
* Result: '''PASS'''
 
* zh-CN
* 1509 Build ID: - Ending 2001 Build ID:
* Version String: Mozilla/5.0 (Windows; U; Windows NT 5.2; zh-CN; rv:1.8.1.1)Gecko/20061204 Firefox/2.0.0.1 ID:2006120418
* Result: '''PASS'''
 
= Win Vista =
 
== Marcia's Testing ==
Testing as an Admin User
 
Expected:
*Must give updater.exe permission to run
 
* en-US
* 1509 Build ID: - Ending 2001 Build ID: BuildID = "2006120612"->BuildID = "2006120418"
* Version String: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.8.1.1) Gecko/20061204 Firefox/2.0.0.1
* Result:''' PASS'''
**Filed bug https://bugzilla.mozilla.org/show_bug.cgi?id=367913
 
* it
* 1509 Build ID: - Ending 2001 Build ID:BuildID = "2006120612"->BuildID = "2006120418"
* Version String:Mozilla/5.0 (Windows; U; Windows NT 6.0; it; rv:1.8.1.1) Gecko/20061204 Firefox/2.0.0.1
* Result: '''PASS'''
 
== Test of Incompatible Themes and Extensions ==
 
*Installed 1509 fr build
**Installed theme "Firefox Vista" that was only compatible with 1.5
*Performed successful update to 2.0.0.1, and received dialog warning me of incompatibility
**Note: I experience extreme network latency when applying this update, need to figure out a better way
 
== tester: tomcat ==
Testing as an Admin User
 
* fr
* 1509 Build ID: - Ending 2001 Build ID: BuildID = "2006120612"->BuildID = "2006120418"
* Version String: Mozilla/5.0 (Windows; U; Windows NT 6.0; fr; rv:1.8.0.9) Gecko/20061206 Firefox/1.5.0.9 Mnenhy/0.7.4.666 ID:2006120418
* Result:''' PASS'''
 
* de
* 1509 Build ID: - Ending 2001 Build ID:BuildID = "2006120612"->BuildID = "2006120418"
* Version String:Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1.8.0.9) Gecko/20061206 Firefox/1.5.0.9 Mnenhy/0.7.4.666 ID:2006120418
* Result: '''PASS'''
 
* nl
* 1509 Build ID: - Ending 2001 Build ID:BuildID = "2006120612"->BuildID = "2006120418"
* Version String:Mozilla/5.0 (Windows; U; Windows NT 6.0; nl; rv:1.8.0.9) Gecko/20061206 Firefox/1.5.0.9 Mnenhy/0.7.4.666 ID:2006120418
* Result: '''PASS'''
 
= Mac =
* en-US
* 1509 Build ID: - Ending 2001 Build ID:
* Version String:
* Restult: '''PASS/FAIL'''
 
* ja-JP
* 1509 Build ID: - Ending 2001 Build ID:
* Version String:
* Restult: '''PASS/FAIL'''
 
= Linux =
Tested by: tchung
* en-US
* 1509 Build ID: - Ending 2001 Build ID: 2006120612 > 2006120814
* Version String: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.1) Gecko/20061208 Firefox/2.0.0.1
* Restult: '''PASS'''
 
* pl
* 1509 Build ID: - Ending 2001 Build ID: 2006120612 > 2006120814
* Version String: Mozilla/5.0 (X11; U; Linux i686; pl; rv:1.8.1.1) Gecko/20061208 Firefox/2.0.0.1
* Restult: '''PASS'''
 
 
Tested by: tomcat - Linux Fedora FC 6
* en-US
* 1509 Build ID: - Ending 2001 Build ID: 2006120612 > 2006120814
* Version String: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.1)Gecko/20061208 Firefox/2.0.0.1 ID:2006120814
* Restult: '''PASS'''
 
* nl
* 1509 Build ID: - Ending 2001 Build ID: 2006120612 > 2006120814
* Version String: Mozilla/5.0 (X11; U; Linux i686; nl; rv:1.8.1.1)Gecko/20061208 Firefox/2.0.0.1 ID:2006120814
* Restult: '''PASS'''
 
* it
* 1509 Build ID: - Ending 2001 Build ID: 2006120612 > 2006120814
* Version String: Mozilla/5.0 (X11; U; Linux i686; it; rv:1.8.1.1)Gecko/20061208 Firefox/2.0.0.1 ID:2006120814
* Restult: '''PASS'''
 
* pl
* 1509 Build ID: - Ending 2001 Build ID: 2006120612 > 2006120814
* Version String: Mozilla/5.0 (X11; U; Linux i686; pl; rv:1.8.1.1)Gecko/20061208 Firefox/2.0.0.1 ID:2006120814
* Restult: '''PASS'''
 
* de
* 1509 Build ID: - Ending 2001 Build ID: 2006120612 > 2006120814
* Version String: Mozilla/5.0 (X11; U; Linux i686; de; rv:1.8.1.1)Gecko/20061208 Firefox/2.0.0.1 ID:2006120814
* Restult: '''PASS'''
 
* en-GB
* 1509 Build ID: - Ending 2001 Build ID: 2006120612 > 2006120814
* Version String: Mozilla/5.0 (X11; U; Linux i686; en-GB; rv:1.8.1.1)Gecko/20061208 Firefox/2.0.0.1 ID:2006120814
* Restult: '''PASS'''

Latest revision as of 00:55, 11 September 2007

Testing results tracking page for major updates. We have tested major updates in the past by following the major software update test cases in Litmus, but currently we can do this type of test on "releasetest" going from 1.5.0.12->2.0.0.6.

Use the major software update testing strategy page as reference. In-line Details have been translated for all locales. Eulas are not translated and they default to the en-US version.

15012-2006 Results on betatest channel

15012-2006 Results on releasetest

15012-2006 Live Spot Checks


15012-2004 Results on releasetest

15012-2004 Results on beta channel

15012-2004 Results on releasetest after CJKT issue fix (6/27)

15012-2004 Live Spot Checks (6/28) ~@3pm