Firefox:1.5.0.x:Major Update 1.5.0.x to 2.0.0.x:Test Results: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
No edit summary
 
(58 intermediate revisions by 5 users not shown)
Line 1: Line 1:
Testing results tracking page for major updates. We have tested major updates in the past by following the [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=38&subgroup_id=623 major software update test cases in Litmus], but currently we can do this type of test on "releasetest" going from 1.5.0.9->2.0.0.1. Bear in mind that the testing environment is temporary.
Testing results tracking page for major updates. We have tested major updates in the past by following the [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=38&subgroup_id=623 major software update test cases in Litmus], but currently we can do this type of test on "releasetest" going from 1.5.0.12->2.0.0.6.


Use the major software update [http://wiki.mozilla.org/Firefox:1.5.0.x:Major_Update_1.5.0.x_to_2.0.0.x testing strategy page] as reference. In-line Details have been translated for all locales. Eulas are not translated and they default to the en-US version.
Use the major software update [http://wiki.mozilla.org/Firefox:1.5.0.x:Major_Update_1.5.0.x_to_2.0.0.x testing strategy page] as reference. In-line Details have been translated for all locales. Eulas are not translated and they default to the en-US version.


'''Post-368082''': We need to test this fix, which adds a ''channel'' attribute in the updates.xml file when doing updates stargin with 15010. This will then fix the problem of having an ''Install Pending'' status in the software update history when going from 15010 to 2002.
[http://wiki.mozilla.org/Firefox:1.5.0.x:Major_Update_1.5.0.x_to_2.0.0.x:Test_Results:15012-2006_betatest '''15012-2006 Results on betatest channel''']


= Major Software Updtes Testing post-bug 368082 =
[http://wiki.mozilla.org/Firefox:1.5.0.x:Major_Update_1.5.0.x_to_2.0.0.x:Test_Results:15012-2006 '''15012-2006 Results on releasetest''']
== Test fix in 15010 ==


Grab a build from here: http://stage.mozilla.org/pub/mozilla.org/firefox/nightly/experimental/1.5.0.10pre-2.0.0.2pre-major-test1/older/
[http://wiki.mozilla.org/Firefox:1.5.0.x:Major_Update_1.5.0.x_to_2.0.0.x:Test_Results:15012-2006_rollout '''15012-2006 Live Spot Checks''']


Update to the newer 15010 version on releasetest and check that active-updates.xml and updates.xml has a '''channel''' attribute after checking for updates. Also make sure the software update status history is correct.
----


=== Windows XP ===
[http://wiki.mozilla.org/Firefox:1.5.0.x:Major_Update_1.5.0.x_to_2.0.0.x:Test_Results:15012 '''15012-2004 Results on releasetest''']
=== Windows Vista ===
=== Mac ===
=== Linux ===


== Test major updates from fixed 15010 ==
[http://wiki.mozilla.org/Firefox:1.5.0.x:Major_Update_1.5.0.x_to_2.0.0.x:Test_Results:15012_beta '''15012-2004 Results on beta channel''']
We need to retest the major software updates to verify that the software update history status is fixed. It should no longer say '''Install Pending''' after going from 15010 to 2002.


[http://wiki.mozilla.org/Firefox:1.5.0.x:Major_Update_1.5.0.x_to_2.0.0.x:Test_Results:15012_prerollout '''15012-2004 Results on releasetest after CJKT issue fix (6/27)''']


<font color=lightgray>
[http://wiki.mozilla.org/Firefox:1.5.0.x:Major_Update_1.5.0.x_to_2.0.0.x:Test_Results:15012_rollout '''15012-2004 Live Spot Checks (6/28) ~@3pm''']
 
= Win XP (juanb)=
* en-US
* 1509 Build ID: - Ending 2001 Build ID:
* Version String:
* Conditions: New profile
* Restult: '''PASS'''
* Notes: After update and restart, I see two tabs open "You've updated..." and what I set as my home page.
 
* fr
* 1509 Build ID: - Ending 2001 Build ID:
* Version String:
* Conditions: Profile with bookmarks, feeds, passwords saved, form field data saved, extension, search plugin added, compatible and incompatible (with 2.x) extensions
* Restult: '''PASS'''
* Notes: Details are localized.
 
* es-ES
* 1509 Build ID - Ending 2001 Build ID: 2006120612-2006120418
* Version String: Mozilla/5.0 (Windows; U; Windows NT 5.1; es-ES; rv:1.8.1.1) Gecko/20061204 Firefox/2.0.0.1
* Conditions: New profile with compatible themes and extensions, incompatible themes and extensions, and extensions and themes that could be updated so they could be compatible with 2.0x
* Restult: '''PASS'''
* Notes: Discovered [https://bugzilla.mozilla.org/show_bug.cgi?id=368082 bug 368082] Update History Status is set to "Install Pending"
 
Tested by: tomcat on Windows x64 SP1
 
* en-US
* 1509 Build ID: - Ending 2001 Build ID:
* Version String: Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.1.2pre) Gecko/20070120 BonEcho/2.0.0.2pre ID:2007012003
* Result: '''PASS'''
 
* de
* 1509 Build ID: - Ending 2001 Build ID:
* Version String: Mozilla/5.0 (Windows; U; Windows NT 5.2; de; rv:1.8.1.2pre)Gecko/20070120 BonEcho/2.0.0.2pre ID:2007012003
* Result: '''PASS'''
 
* en-GB
* 1509 Build ID: - Ending 2001 Build ID:
* Version String: Mozilla/5.0 (Windows; U; Windows NT 5.2; en-GB; rv:1.8.1.1)Gecko/20061204 Firefox/2.0.0.1 ID:2006120418
* Result: '''PASS'''
 
* sv-SE
* 1509 Build ID: - Ending 2001 Build ID:
* Version String:Mozilla/5.0 (Windows; U; Windows NT 5.2; sv-SE; rv:1.8.1.1)Gecko/20061204 Firefox/2.0.0.1 ID:2006120418
* Result: '''PASS'''
* Note: No localised page for this locale
 
* he
* 1509 Build ID: - Ending 2001 Build ID:
* Version String: Mozilla/5.0 (Windows; U; Windows NT 5.2; he; rv:1.8.1.1)Gecko/20061204 Firefox/2.0.0.1 ID:2006120418
* Result: '''PASS'''
* Note: L10N Site passed on the 2nd run
 
* ja
* 1509 Build ID: - Ending 2001 Build ID:
* Version String: Mozilla/5.0 (Windows; U; Windows NT 5.2; ja; rv:1.8.1.1)Gecko/20061204 Firefox/2.0.0.1 ID:2006120418
* Result: '''PASS'''
 
* nl
* 1509 Build ID: - Ending 2001 Build ID:
* Version String: Mozilla/5.0 (Windows; U; Windows NT 5.2; nl; rv:1.8.1.1)Gecko/20061204 Firefox/2.0.0.1 ID:2006120418
* Result: '''PASS'''
 
* pl
* 1509 Build ID: - Ending 2001 Build ID:
* Version String:Mozilla/5.0 (Windows; U; Windows NT 5.2; nl; rv:1.8.1.1)Gecko/20061204 Firefox/2.0.0.1 ID:2006120418
* Result: '''PASS'''
 
* zh-TW
* 1509 Build ID: - Ending 2001 Build ID:
* Version String: Mozilla/5.0 (Windows; U; Windows NT 5.2; zh-TW; rv:1.8.1.1)Gecko/20061204 Firefox/2.0.0.1 ID:2006120418
* Result: '''PASS'''
 
* zh-CN
* 1509 Build ID: - Ending 2001 Build ID:
* Version String: Mozilla/5.0 (Windows; U; Windows NT 5.2; zh-CN; rv:1.8.1.1)Gecko/20061204 Firefox/2.0.0.1 ID:2006120418
* Result: '''PASS'''
 
= Win Vista =
 
== Marcia's Testing ==
Testing as an Admin User
 
Expected:
*Must give updater.exe permission to run
 
* en-US
* 1509 Build ID: - Ending 2001 Build ID: BuildID = "2006120612"->BuildID = "2006120418"
* Version String: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.8.1.1) Gecko/20061204 Firefox/2.0.0.1
* Result:''' PASS'''
**Filed bug https://bugzilla.mozilla.org/show_bug.cgi?id=367913
 
* it
* 1509 Build ID: - Ending 2001 Build ID:BuildID = "2006120612"->BuildID = "2006120418"
* Version String:Mozilla/5.0 (Windows; U; Windows NT 6.0; it; rv:1.8.1.1) Gecko/20061204 Firefox/2.0.0.1
* Result: '''PASS'''
 
== Test of Incompatible Themes and Extensions ==
 
*Installed 1509 fr build
**Installed theme "Firefox Vista" that was only compatible with 1.5
*Performed successful update to 2.0.0.1, and received dialog warning me of incompatibility
**Note: I experience extreme network latency when applying this update, need to figure out a better way
 
== Test of Search Plugins ==
 
*Installed 1509 en build
**In addition to default plugins, installed the following: ESPN, IMDB, USAToday, Lonely Planet and BBC news.
*Performed a major update to 2.0.0.1
*Confirmed that all searchplugins were present
 
== Tomcat's Win vista testing ==
Testing as an Admin User
 
* fr
* 1509 Build ID: - Ending 2001 Build ID: BuildID = "2006120612"->BuildID = "2006120418"
* Version String: Mozilla/5.0 (Windows; U; Windows NT 6.0; fr; rv:1.8.0.9) Gecko/20061206 Firefox/1.5.0.9 Mnenhy/0.7.4.666 ID:2006120418
* Result:''' PASS'''
 
* de
* 1509 Build ID: - Ending 2001 Build ID:BuildID = "2006120612"->BuildID = "2006120418"
* Version String:Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1.8.0.9) Gecko/20061206 Firefox/1.5.0.9 Mnenhy/0.7.4.666 ID:2006120418
* Result: '''PASS'''
 
* nl
* 1509 Build ID: - Ending 2001 Build ID:BuildID = "2006120612"->BuildID = "2006120418"
* Version String:Mozilla/5.0 (Windows; U; Windows NT 6.0; nl; rv:1.8.0.9) Gecko/20061206 Firefox/1.5.0.9 Mnenhy/0.7.4.666 ID:2006120418
* Result: '''PASS'''
 
= Mac (Intel)=
'''en-US'''
* 1509 Build ID: 2006120612 - Ending 2001 Build ID: 2006120417
* Version String: Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.1) Gecko/20061204 Firefox/2.0.0.1
* Restult: '''PASS''' (jay)
 
'''de'''
* 1509 Build ID: 2006120612 - Ending 2001 Build ID: 2006120417
* Version String: Mozilla/5.0 (Macintosh; U; Intel Mac OS X; de; rv:1.8.1.1) Gecko/20061204 Firefox/2.0.0.1
* Restult: '''PASS''' (jay)
 
'''fr'''
* 1509 Build ID: 2006120612 - Ending 2001 Build ID: 2006120417
* Version String: Mozilla/5.0 (Macintosh; U; Intel Mac OS X; fr; rv:1.8.1.1) Gecko/20061204 Firefox/2.0.0.1
* Restult: '''PASS''' (jay)
 
= Mac (PPC) =
'''en-US'''
* 1509 BuildID = "2006120612" - Ending 2001 BuildID = "2006120417"
* Version String: Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.8.1.1) Gecko/20061204 Firefox/2.0.0.1
* Result: '''PASS''' (marcia)
 
= Linux =
Tested by: tchung
* en-US
* 1509 Build ID: - Ending 2001 Build ID: 2006120612 > 2006120814
* Version String: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.1) Gecko/20061208 Firefox/2.0.0.1
* Restult: '''PASS'''
 
* pl
* 1509 Build ID: - Ending 2001 Build ID: 2006120612 > 2006120814
* Version String: Mozilla/5.0 (X11; U; Linux i686; pl; rv:1.8.1.1) Gecko/20061208 Firefox/2.0.0.1
* Restult: '''PASS'''
 
Tested by: tomcat - Linux Fedora FC 6
* en-US
* 1509 Build ID: - Ending 2001 Build ID: 2006120612 > 2006120814
* Version String: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.1)Gecko/20061208 Firefox/2.0.0.1 ID:2006120814
* Restult: '''PASS'''
 
* nl
* 1509 Build ID: - Ending 2001 Build ID: 2006120612 > 2006120814
* Version String: Mozilla/5.0 (X11; U; Linux i686; nl; rv:1.8.1.1)Gecko/20061208 Firefox/2.0.0.1 ID:2006120814
* Restult: '''PASS'''
 
* it
* 1509 Build ID: - Ending 2001 Build ID: 2006120612 > 2006120814
* Version String: Mozilla/5.0 (X11; U; Linux i686; it; rv:1.8.1.1)Gecko/20061208 Firefox/2.0.0.1 ID:2006120814
* Restult: '''PASS'''
 
* pl
* 1509 Build ID: - Ending 2001 Build ID: 2006120612 > 2006120814
* Version String: Mozilla/5.0 (X11; U; Linux i686; pl; rv:1.8.1.1)Gecko/20061208 Firefox/2.0.0.1 ID:2006120814
* Restult: '''PASS'''
 
* de
* 1509 Build ID: - Ending 2001 Build ID: 2006120612 > 2006120814
* Version String: Mozilla/5.0 (X11; U; Linux i686; de; rv:1.8.1.1)Gecko/20061208 Firefox/2.0.0.1 ID:2006120814
* Restult: '''PASS'''
 
* en-GB
* 1509 Build ID: - Ending 2001 Build ID: 2006120612 > 2006120814
* Version String: Mozilla/5.0 (X11; U; Linux i686; en-GB; rv:1.8.1.1)Gecko/20061208 Firefox/2.0.0.1 ID:2006120814
* Restult: '''PASS'''
</font>
 
= Software Update History Issue =
The software update status in the Options/Advanced/"Software Update History" is set to "Install Pending" after a major update. See [https://bugzilla.mozilla.org/show_bug.cgi?id=368082 bug 368082]. These are some of the scenarios we have tried to examine the updates.xml file after an update download and after applying the update:
 
* 1508-1509, partial, full, release, mac
* 2.0-2001, partial, full, release, mac
* 1509-2001, partial, full, releasetest, mac
* Notes: updates.xml files for these scenarios are captured in the bug above. So far it looks like the "Install Pending" string only appears in the update.xml file for the major update in this last scenario. All of them are different.

Latest revision as of 00:55, 11 September 2007

Testing results tracking page for major updates. We have tested major updates in the past by following the major software update test cases in Litmus, but currently we can do this type of test on "releasetest" going from 1.5.0.12->2.0.0.6.

Use the major software update testing strategy page as reference. In-line Details have been translated for all locales. Eulas are not translated and they default to the en-US version.

15012-2006 Results on betatest channel

15012-2006 Results on releasetest

15012-2006 Live Spot Checks

15012-2004 Results on releasetest

15012-2004 Results on beta channel

15012-2004 Results on releasetest after CJKT issue fix (6/27)

15012-2004 Live Spot Checks (6/28) ~@3pm

Retrieved from "https://wiki.mozilla.org/index.php?title=Firefox:1.5.0.x:Major_Update_1.5.0.x_to_2.0.0.x:Test_Results&oldid=68091"