Firefox:1.5.0.x:Major Update 1.5.0.x to 2.0.0.x:Test Results: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
No edit summary
No edit summary
 
(11 intermediate revisions by 2 users not shown)
Line 1: Line 1:
Testing results tracking page for major updates. We have tested major updates in the past by following the [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=38&subgroup_id=623 major software update test cases in Litmus], but currently we can do this type of test on "releasetest" going from 1.5.0.12->2.0.0.4. Bear in mind that the testing environment is temporary.
Testing results tracking page for major updates. We have tested major updates in the past by following the [http://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=1&testgroup_id=38&subgroup_id=623 major software update test cases in Litmus], but currently we can do this type of test on "releasetest" going from 1.5.0.12->2.0.0.6.


Use the major software update [http://wiki.mozilla.org/Firefox:1.5.0.x:Major_Update_1.5.0.x_to_2.0.0.x testing strategy page] as reference. In-line Details have been translated for all locales. Eulas are not translated and they default to the en-US version.
Use the major software update [http://wiki.mozilla.org/Firefox:1.5.0.x:Major_Update_1.5.0.x_to_2.0.0.x testing strategy page] as reference. In-line Details have been translated for all locales. Eulas are not translated and they default to the en-US version.


= Mac (Intel)=
[http://wiki.mozilla.org/Firefox:1.5.0.x:Major_Update_1.5.0.x_to_2.0.0.x:Test_Results:15012-2006_betatest '''15012-2006 Results on betatest channel''']
'''en-US'''
* releasetest, partial
* Version String: Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.4) Gecko/20070515 Firefox/2.0.0.4
* Result: '''PASS''' (jay)
* Notes: Update dialog, license agreement, and product pages (whatsnew/relnotes) all look good.


'''de'''
[http://wiki.mozilla.org/Firefox:1.5.0.x:Major_Update_1.5.0.x_to_2.0.0.x:Test_Results:15012-2006 '''15012-2006 Results on releasetest''']
* releasetest, complete
* Version String: Mozilla/5.0 (Macintosh; U; Intel Mac OS X; de; rv:1.8.1.4) Gecko/20070515 Firefox/2.0.0.4
* Result: '''PASS''' (jay)
* Notes: Update dialog, license agreement, and product pages (whatsnew/relnotes) all look good.


'''fr'''
[http://wiki.mozilla.org/Firefox:1.5.0.x:Major_Update_1.5.0.x_to_2.0.0.x:Test_Results:15012-2006_rollout '''15012-2006 Live Spot Checks''']
* releasetest, partial
* Version String: Mozilla/5.0 (Macintosh; U; Intel Mac OS X; fr; rv:1.8.1.4) Gecko/20070515 Firefox/2.0.0.4
* Result: '''PASS''' (jay)
* Notes: Update dialog, license agreement, and product pages (whatsnew/relnotes) all look good.


= Windows XP =
----


'''de'''
[http://wiki.mozilla.org/Firefox:1.5.0.x:Major_Update_1.5.0.x_to_2.0.0.x:Test_Results:15012 '''15012-2004 Results on releasetest''']
* releasetest, partial
* Version String: Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.0.12) Gecko/20070508 Firefox/1.5.0.12 ID:2007050813 to Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.4) Gecko/20070515 Firefox/2.0.0.4 ID:2007051502
* Result: '''PASS''' (tomcat)
* Notes: Update dialog, license agreement, and product pages (whatsnew/relnotes) all look good. Also no dataloss in Bookmarks, Prefs.


'''ca'''
[http://wiki.mozilla.org/Firefox:1.5.0.x:Major_Update_1.5.0.x_to_2.0.0.x:Test_Results:15012_beta '''15012-2004 Results on beta channel''']
* releasetest, partial
* Version String: Mozilla/5.0 (Windows; U; Windows NT 5.1; ca; rv:1.8.1.4) Gecko/20070515 Firefox/2.0.0.4 ID:2007051502
* Result: '''PASS''' (tomcat)
* Notes: Update dialog, license agreement, and product pages (whatsnew/relnotes) all look good. Also no dataloss in Bookmarks, Prefs.


'''fi'''
[http://wiki.mozilla.org/Firefox:1.5.0.x:Major_Update_1.5.0.x_to_2.0.0.x:Test_Results:15012_prerollout '''15012-2004 Results on releasetest after CJKT issue fix (6/27)''']
* releasetest, partial, fallback
* Version String: Mozilla/5.0 (Windows; U; Windows NT 5.1; fi; rv:1.8.0.12) Gecko/20070508 Firefox/1.5.0.12 ID:2007050813 Mozilla/5.0 (Windows; U; Windows NT 5.1; fi; rv:1.8.1.4) Gecko/20070515 Firefox/2.0.0.4 ID:2007051502
* Result: '''PASS''' (tomcat)
* Notes: Update dialog, license agreement, and product pages (whatsnew/relnotes) all look good. Also no dataloss in Bookmarks, Prefs.


= Windows Vista =
[http://wiki.mozilla.org/Firefox:1.5.0.x:Major_Update_1.5.0.x_to_2.0.0.x:Test_Results:15012_rollout '''15012-2004 Live Spot Checks (6/28) ~@3pm''']
'''en-US'''
* Tested under various user scenarios, results are available at http://quality.mozilla.org/vista+update+testing
** NOTE: If you launch Firefox from the shortcut (without "Run as administrator"), software update will fail.  You will be able to check for updates, download the patch, and restart... but it will not be applied.)
 
= Linux =
* en-US, 15012-2004, partial+fallback, juanb: '''PASS'''
** Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.4) Gecko/20070515 Firefox/2.0.0.4
 
*en-GB, 15012-2004, partial, juanb: '''PASS'''
** Mozilla/5.0 (X11; U; Linux i686; en-GB; rv:1.8.1.4) Gecko/20070515 Firefox/2.0.0.4
 
*es-ES, 15012-2004, partial, juanb: '''PASS'''
** Mozilla/5.0 (X11; U; Linux i686; es-ES; rv:1.8.1.4) Gecko/20070515 Firefox/2.0.0.4
** '''Notes:''' default search engine plugin preference was not preserved.
 
*it, 15012-2004, partial, juanb: '''PASS'''
**
** '''Notes:''' similar problems as above. Refer to this bug - https://bugzilla.mozilla.org/show_bug.cgi?id=377099
 
= Focused Testing =
Let's try to go through all of the test in the major updates reference page and test around different kinds of profiles, containing multiple extensions and themes, compatible and incompatible with 2.0x. Keep an eye out for data loss problems, such as bookmarks, and any other preferences that should be preserved after an update.

Latest revision as of 00:55, 11 September 2007

Testing results tracking page for major updates. We have tested major updates in the past by following the major software update test cases in Litmus, but currently we can do this type of test on "releasetest" going from 1.5.0.12->2.0.0.6.

Use the major software update testing strategy page as reference. In-line Details have been translated for all locales. Eulas are not translated and they default to the en-US version.

15012-2006 Results on betatest channel

15012-2006 Results on releasetest

15012-2006 Live Spot Checks


15012-2004 Results on releasetest

15012-2004 Results on beta channel

15012-2004 Results on releasetest after CJKT issue fix (6/27)

15012-2004 Live Spot Checks (6/28) ~@3pm