Firefox:1.5.0.x:Major Update 1.5.0.x to 2.0.0.x:Test Results: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
Line 14: Line 14:
=== Windows XP ===
=== Windows XP ===
=== Windows Vista ===
=== Windows Vista ===
* Minor Update 1.5.0.10pre -> 1.5.0.10pre (1/29 -> 1/30) (as Regular User, so need to "run as administrator" and provide Admin password often)
** Install 1/29 1.5.0.10pre build, change update channel to "releasetest"
** Check for updates (get offered 1/30 build), download, choose to apply later
*** This did nothing (since I forgot to run Firefox "as administrator".
** Run Firefox "as administrator", checked for updates again (chose to apply later)
** Checked update files:
*** active-update.xml:
<pre>
<updates xmlns="http://www.mozilla.org/2005/app-update"><update type="minor" name="Firefox 1.5.0.10pre" version="1.5.0.10pre" extensionVersion="1.5.0.10pre" detailsURL="http://en-US.www.mozilla.com/en-US/firefox/1.5.0.10/details/index.html" licenseURL="undefined" serviceURL="https://aus2.mozilla.org/update/1/Firefox/1.5.0.10pre/2007012905/WINNT_x86-msvc/en-US/releasetest/update.xml" channel="releasetest" installDate="1170277251376" statusText="Install Pending" buildID="2007013006" isCompleteUpdate="false" licenseAccepted="false" foregroundDownload="true"><patch type="complete" URL="http://stage.mozilla.org/pub/mozilla.org/firefox/nightly/experimental/1.5.0.10pre-2.0.0.2pre-major-test1/firefox-1.5.0.10pre.en-US.win32.complete.mar" hashFunction="SHA1" hashValue="e4025c5a918824cc971e9528165afc4693b7c65c" size="6421835" selected="undefined" state="undefined"/><patch type="partial" URL="http://stage.mozilla.org/pub/mozilla.org/firefox/nightly/experimental/1.5.0.10pre-2.0.0.2pre-major-test1/firefox-1.5.0.10old-1.5.0.10pre.en-US.win32.partial.mar" hashFunction="SHA1" hashValue="572c9f556da7d4a920d7a6467372d208d812e3ce" size="9469" selected="true" state="pending" progress="100" status="9 of 9 KB"/></update></updates>
</pre>
*** updates.xml:
<pre>
<updates xmlns="http://www.mozilla.org/2005/app-update"><update type="minor" name="Firefox 1.5.0.10pre" version="1.5.0.10pre" extensionVersion="1.5.0.10pre" detailsURL="http://en-US.www.mozilla.com/en-US/firefox/1.5.0.10/details/index.html" licenseURL="undefined" serviceURL="https://aus2.mozilla.org/update/1/Firefox/1.5.0.10pre/2007012905/WINNT_x86-msvc/en-US/releasetest/update.xml" channel="releasetest" installDate="1170277251376" statusText="Install Pending" buildID="2007013006" isCompleteUpdate="false" licenseAccepted="false" foregroundDownload="true"><patch type="complete" URL="http://stage.mozilla.org/pub/mozilla.org/firefox/nightly/experimental/1.5.0.10pre-2.0.0.2pre-major-test1/firefox-1.5.0.10pre.en-US.win32.complete.mar" hashFunction="SHA1" hashValue="e4025c5a918824cc971e9528165afc4693b7c65c" size="6421835" selected="undefined" state="undefined"/><patch type="partial" URL="http://stage.mozilla.org/pub/mozilla.org/firefox/nightly/experimental/1.5.0.10pre-2.0.0.2pre-major-test1/firefox-1.5.0.10old-1.5.0.10pre.en-US.win32.partial.mar" hashFunction="SHA1" hashValue="572c9f556da7d4a920d7a6467372d208d812e3ce" size="9469" selected="true" state="pending" progress="100" status="9 of 9 KB"/></update></updates>
</pre>
*** /updates dir: update.mar (10 KB), update.status (pending)
=== Mac ===
=== Mac ===
=== Linux ===
=== Linux ===

Revision as of 21:06, 31 January 2007

Testing results tracking page for major updates. We have tested major updates in the past by following the major software update test cases in Litmus, but currently we can do this type of test on "releasetest" going from 1.5.0.9->2.0.0.1. Bear in mind that the testing environment is temporary.

Use the major software update testing strategy page as reference. In-line Details have been translated for all locales. Eulas are not translated and they default to the en-US version.

Post-368082: We need to test this fix, which adds a channel attribute in the updates.xml file when doing updates stargin with 15010. This will then fix the problem of having an Install Pending status in the software update history when going from 15010 to 2002.

Major Software Updtes Testing post-bug 368082

Test fix in 15010

Grab a build from here: http://stage.mozilla.org/pub/mozilla.org/firefox/nightly/experimental/1.5.0.10pre-2.0.0.2pre-major-test1/older/

Update to the newer 15010 version on releasetest and check that active-updates.xml and updates.xml has a channel attribute after checking for updates. Also make sure the software update status history is correct.

Windows XP

Windows Vista

  • Minor Update 1.5.0.10pre -> 1.5.0.10pre (1/29 -> 1/30) (as Regular User, so need to "run as administrator" and provide Admin password often)
    • Install 1/29 1.5.0.10pre build, change update channel to "releasetest"
    • Check for updates (get offered 1/30 build), download, choose to apply later
      • This did nothing (since I forgot to run Firefox "as administrator".
    • Run Firefox "as administrator", checked for updates again (chose to apply later)
    • Checked update files:
      • active-update.xml:
<updates xmlns="http://www.mozilla.org/2005/app-update"><update type="minor" name="Firefox 1.5.0.10pre" version="1.5.0.10pre" extensionVersion="1.5.0.10pre" detailsURL="http://en-US.www.mozilla.com/en-US/firefox/1.5.0.10/details/index.html" licenseURL="undefined" serviceURL="https://aus2.mozilla.org/update/1/Firefox/1.5.0.10pre/2007012905/WINNT_x86-msvc/en-US/releasetest/update.xml" channel="releasetest" installDate="1170277251376" statusText="Install Pending" buildID="2007013006" isCompleteUpdate="false" licenseAccepted="false" foregroundDownload="true"><patch type="complete" URL="http://stage.mozilla.org/pub/mozilla.org/firefox/nightly/experimental/1.5.0.10pre-2.0.0.2pre-major-test1/firefox-1.5.0.10pre.en-US.win32.complete.mar" hashFunction="SHA1" hashValue="e4025c5a918824cc971e9528165afc4693b7c65c" size="6421835" selected="undefined" state="undefined"/><patch type="partial" URL="http://stage.mozilla.org/pub/mozilla.org/firefox/nightly/experimental/1.5.0.10pre-2.0.0.2pre-major-test1/firefox-1.5.0.10old-1.5.0.10pre.en-US.win32.partial.mar" hashFunction="SHA1" hashValue="572c9f556da7d4a920d7a6467372d208d812e3ce" size="9469" selected="true" state="pending" progress="100" status="9 of 9 KB"/></update></updates>
      • updates.xml:
<updates xmlns="http://www.mozilla.org/2005/app-update"><update type="minor" name="Firefox 1.5.0.10pre" version="1.5.0.10pre" extensionVersion="1.5.0.10pre" detailsURL="http://en-US.www.mozilla.com/en-US/firefox/1.5.0.10/details/index.html" licenseURL="undefined" serviceURL="https://aus2.mozilla.org/update/1/Firefox/1.5.0.10pre/2007012905/WINNT_x86-msvc/en-US/releasetest/update.xml" channel="releasetest" installDate="1170277251376" statusText="Install Pending" buildID="2007013006" isCompleteUpdate="false" licenseAccepted="false" foregroundDownload="true"><patch type="complete" URL="http://stage.mozilla.org/pub/mozilla.org/firefox/nightly/experimental/1.5.0.10pre-2.0.0.2pre-major-test1/firefox-1.5.0.10pre.en-US.win32.complete.mar" hashFunction="SHA1" hashValue="e4025c5a918824cc971e9528165afc4693b7c65c" size="6421835" selected="undefined" state="undefined"/><patch type="partial" URL="http://stage.mozilla.org/pub/mozilla.org/firefox/nightly/experimental/1.5.0.10pre-2.0.0.2pre-major-test1/firefox-1.5.0.10old-1.5.0.10pre.en-US.win32.partial.mar" hashFunction="SHA1" hashValue="572c9f556da7d4a920d7a6467372d208d812e3ce" size="9469" selected="true" state="pending" progress="100" status="9 of 9 KB"/></update></updates>
      • /updates dir: update.mar (10 KB), update.status (pending)

Mac

Linux

Test major updates from fixed 15010

We need to retest the major software updates to verify that the software update history status is fixed. It should no longer say Install Pending after going from 15010 to 2002.


Win XP (juanb)

  • en-US
  • 1509 Build ID: - Ending 2001 Build ID:
  • Version String:
  • Conditions: New profile
  • Restult: PASS
  • Notes: After update and restart, I see two tabs open "You've updated..." and what I set as my home page.
  • fr
  • 1509 Build ID: - Ending 2001 Build ID:
  • Version String:
  • Conditions: Profile with bookmarks, feeds, passwords saved, form field data saved, extension, search plugin added, compatible and incompatible (with 2.x) extensions
  • Restult: PASS
  • Notes: Details are localized.
  • es-ES
  • 1509 Build ID - Ending 2001 Build ID: 2006120612-2006120418
  • Version String: Mozilla/5.0 (Windows; U; Windows NT 5.1; es-ES; rv:1.8.1.1) Gecko/20061204 Firefox/2.0.0.1
  • Conditions: New profile with compatible themes and extensions, incompatible themes and extensions, and extensions and themes that could be updated so they could be compatible with 2.0x
  • Restult: PASS
  • Notes: Discovered bug 368082 Update History Status is set to "Install Pending"

Tested by: tomcat on Windows x64 SP1

  • en-US
  • 1509 Build ID: - Ending 2001 Build ID:
  • Version String: Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.1.2pre) Gecko/20070120 BonEcho/2.0.0.2pre ID:2007012003
  • Result: PASS
  • de
  • 1509 Build ID: - Ending 2001 Build ID:
  • Version String: Mozilla/5.0 (Windows; U; Windows NT 5.2; de; rv:1.8.1.2pre)Gecko/20070120 BonEcho/2.0.0.2pre ID:2007012003
  • Result: PASS
  • en-GB
  • 1509 Build ID: - Ending 2001 Build ID:
  • Version String: Mozilla/5.0 (Windows; U; Windows NT 5.2; en-GB; rv:1.8.1.1)Gecko/20061204 Firefox/2.0.0.1 ID:2006120418
  • Result: PASS
  • sv-SE
  • 1509 Build ID: - Ending 2001 Build ID:
  • Version String:Mozilla/5.0 (Windows; U; Windows NT 5.2; sv-SE; rv:1.8.1.1)Gecko/20061204 Firefox/2.0.0.1 ID:2006120418
  • Result: PASS
  • Note: No localised page for this locale
  • he
  • 1509 Build ID: - Ending 2001 Build ID:
  • Version String: Mozilla/5.0 (Windows; U; Windows NT 5.2; he; rv:1.8.1.1)Gecko/20061204 Firefox/2.0.0.1 ID:2006120418
  • Result: PASS
  • Note: L10N Site passed on the 2nd run
  • ja
  • 1509 Build ID: - Ending 2001 Build ID:
  • Version String: Mozilla/5.0 (Windows; U; Windows NT 5.2; ja; rv:1.8.1.1)Gecko/20061204 Firefox/2.0.0.1 ID:2006120418
  • Result: PASS
  • nl
  • 1509 Build ID: - Ending 2001 Build ID:
  • Version String: Mozilla/5.0 (Windows; U; Windows NT 5.2; nl; rv:1.8.1.1)Gecko/20061204 Firefox/2.0.0.1 ID:2006120418
  • Result: PASS
  • pl
  • 1509 Build ID: - Ending 2001 Build ID:
  • Version String:Mozilla/5.0 (Windows; U; Windows NT 5.2; nl; rv:1.8.1.1)Gecko/20061204 Firefox/2.0.0.1 ID:2006120418
  • Result: PASS
  • zh-TW
  • 1509 Build ID: - Ending 2001 Build ID:
  • Version String: Mozilla/5.0 (Windows; U; Windows NT 5.2; zh-TW; rv:1.8.1.1)Gecko/20061204 Firefox/2.0.0.1 ID:2006120418
  • Result: PASS
  • zh-CN
  • 1509 Build ID: - Ending 2001 Build ID:
  • Version String: Mozilla/5.0 (Windows; U; Windows NT 5.2; zh-CN; rv:1.8.1.1)Gecko/20061204 Firefox/2.0.0.1 ID:2006120418
  • Result: PASS

Win Vista

Marcia's Testing

Testing as an Admin User

Expected:

  • Must give updater.exe permission to run
  • en-US
  • 1509 Build ID: - Ending 2001 Build ID: BuildID = "2006120612"->BuildID = "2006120418"
  • Version String: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.8.1.1) Gecko/20061204 Firefox/2.0.0.1
  • Result: PASS
  • it
  • 1509 Build ID: - Ending 2001 Build ID:BuildID = "2006120612"->BuildID = "2006120418"
  • Version String:Mozilla/5.0 (Windows; U; Windows NT 6.0; it; rv:1.8.1.1) Gecko/20061204 Firefox/2.0.0.1
  • Result: PASS

Test of Incompatible Themes and Extensions

  • Installed 1509 fr build
    • Installed theme "Firefox Vista" that was only compatible with 1.5
  • Performed successful update to 2.0.0.1, and received dialog warning me of incompatibility
    • Note: I experience extreme network latency when applying this update, need to figure out a better way

Test of Search Plugins

  • Installed 1509 en build
    • In addition to default plugins, installed the following: ESPN, IMDB, USAToday, Lonely Planet and BBC news.
  • Performed a major update to 2.0.0.1
  • Confirmed that all searchplugins were present

Tomcat's Win vista testing

Testing as an Admin User

  • fr
  • 1509 Build ID: - Ending 2001 Build ID: BuildID = "2006120612"->BuildID = "2006120418"
  • Version String: Mozilla/5.0 (Windows; U; Windows NT 6.0; fr; rv:1.8.0.9) Gecko/20061206 Firefox/1.5.0.9 Mnenhy/0.7.4.666 ID:2006120418
  • Result: PASS
  • de
  • 1509 Build ID: - Ending 2001 Build ID:BuildID = "2006120612"->BuildID = "2006120418"
  • Version String:Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1.8.0.9) Gecko/20061206 Firefox/1.5.0.9 Mnenhy/0.7.4.666 ID:2006120418
  • Result: PASS
  • nl
  • 1509 Build ID: - Ending 2001 Build ID:BuildID = "2006120612"->BuildID = "2006120418"
  • Version String:Mozilla/5.0 (Windows; U; Windows NT 6.0; nl; rv:1.8.0.9) Gecko/20061206 Firefox/1.5.0.9 Mnenhy/0.7.4.666 ID:2006120418
  • Result: PASS

Mac (Intel)

en-US

  • 1509 Build ID: 2006120612 - Ending 2001 Build ID: 2006120417
  • Version String: Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.1) Gecko/20061204 Firefox/2.0.0.1
  • Restult: PASS (jay)

de

  • 1509 Build ID: 2006120612 - Ending 2001 Build ID: 2006120417
  • Version String: Mozilla/5.0 (Macintosh; U; Intel Mac OS X; de; rv:1.8.1.1) Gecko/20061204 Firefox/2.0.0.1
  • Restult: PASS (jay)

fr

  • 1509 Build ID: 2006120612 - Ending 2001 Build ID: 2006120417
  • Version String: Mozilla/5.0 (Macintosh; U; Intel Mac OS X; fr; rv:1.8.1.1) Gecko/20061204 Firefox/2.0.0.1
  • Restult: PASS (jay)

Mac (PPC)

en-US

  • 1509 BuildID = "2006120612" - Ending 2001 BuildID = "2006120417"
  • Version String: Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.8.1.1) Gecko/20061204 Firefox/2.0.0.1
  • Result: PASS (marcia)

Linux

Tested by: tchung

  • en-US
  • 1509 Build ID: - Ending 2001 Build ID: 2006120612 > 2006120814
  • Version String: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.1) Gecko/20061208 Firefox/2.0.0.1
  • Restult: PASS
  • pl
  • 1509 Build ID: - Ending 2001 Build ID: 2006120612 > 2006120814
  • Version String: Mozilla/5.0 (X11; U; Linux i686; pl; rv:1.8.1.1) Gecko/20061208 Firefox/2.0.0.1
  • Restult: PASS

Tested by: tomcat - Linux Fedora FC 6

  • en-US
  • 1509 Build ID: - Ending 2001 Build ID: 2006120612 > 2006120814
  • Version String: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.1)Gecko/20061208 Firefox/2.0.0.1 ID:2006120814
  • Restult: PASS
  • nl
  • 1509 Build ID: - Ending 2001 Build ID: 2006120612 > 2006120814
  • Version String: Mozilla/5.0 (X11; U; Linux i686; nl; rv:1.8.1.1)Gecko/20061208 Firefox/2.0.0.1 ID:2006120814
  • Restult: PASS
  • it
  • 1509 Build ID: - Ending 2001 Build ID: 2006120612 > 2006120814
  • Version String: Mozilla/5.0 (X11; U; Linux i686; it; rv:1.8.1.1)Gecko/20061208 Firefox/2.0.0.1 ID:2006120814
  • Restult: PASS
  • pl
  • 1509 Build ID: - Ending 2001 Build ID: 2006120612 > 2006120814
  • Version String: Mozilla/5.0 (X11; U; Linux i686; pl; rv:1.8.1.1)Gecko/20061208 Firefox/2.0.0.1 ID:2006120814
  • Restult: PASS
  • de
  • 1509 Build ID: - Ending 2001 Build ID: 2006120612 > 2006120814
  • Version String: Mozilla/5.0 (X11; U; Linux i686; de; rv:1.8.1.1)Gecko/20061208 Firefox/2.0.0.1 ID:2006120814
  • Restult: PASS
  • en-GB
  • 1509 Build ID: - Ending 2001 Build ID: 2006120612 > 2006120814
  • Version String: Mozilla/5.0 (X11; U; Linux i686; en-GB; rv:1.8.1.1)Gecko/20061208 Firefox/2.0.0.1 ID:2006120814
  • Restult: PASS

Software Update History Issue

The software update status in the Options/Advanced/"Software Update History" is set to "Install Pending" after a major update. See bug 368082. These are some of the scenarios we have tried to examine the updates.xml file after an update download and after applying the update:

  • 1508-1509, partial, full, release, mac
  • 2.0-2001, partial, full, release, mac
  • 1509-2001, partial, full, releasetest, mac
  • Notes: updates.xml files for these scenarios are captured in the bug above. So far it looks like the "Install Pending" string only appears in the update.xml file for the major update in this last scenario. All of them are different.
Retrieved from "https://wiki.mozilla.org/index.php?title=Firefox:1.5.0.x:Major_Update_1.5.0.x_to_2.0.0.x:Test_Results&oldid=47910"