Firefox:1.5.0.8:Test Plan:Software Update

From MozillaWiki
Revision as of 20:59, 2 November 2006 by Marcia (talk | contribs) (→‎marcia)
Jump to navigation Jump to search

Software Update Testing Results

Note: The script we have does not test failing the partial on purpose and then having Firefox/Thunderbird go out and get the full update. In the chart below when it says "Fallback" that means fail the partial and make sure it goes out and gets the full update.

Firefox

Windows Mac Linux
1.5.0.7 en-US (tomcat) PASS (full + partial) en-US (jay) PASS (full + partial) en-US (juanb) PASS (partial + fallback)
1.5.0.6 en-US (tomcat) PASS (full + partial) en-US (juanb) PASS (complete + fallback)
1.5.0.4 en-US (tomcat) PASS en-US (juanb) PASS (complete + fallback)
1.5.0.3 en-US (tomcat) PASS (de) One Tier 1 locale (jay) - PASS
1.5.0.1 One Tier 1 locale (tomcat) - PASS en-US (jay) PASS
1.5 en-US (tomcat)PASS (fr) One Tier 1 locale (jay) - PASS zh-TW (juanb) PASS (complete + fallback)

Detailed Results go here:

    • Platform
    • Talkback Build ID
    • Version String
    • RESULT/FAIL

tomcat

  • Path 1.5.0.0 -> 1.5.0.8 DE - Windows XP x64 - partial and fallback - Releasetest
    • User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.2; de; rv:1.8) Gecko/20051111 Firefox/1.5 6,1 MB -> Mozilla/5.0 (Windows; U; Windows NT 5.2; de; rv:1.8.0.8) Gecko/20061025 Firefox/1.5.0.8
    • Talkback Build ID: 2006102516
    • PASS
  • Path 1.5.0.0 -> 1.5.0.8 en-US - Windows XP x64 - partial and fallback Releasetest
    • User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8) Gecko/20051111 Firefox/1.5 6,1 MB -> Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.0.8) Gecko/20061025 Firefox/1.5.0.8
    • Talkback Build ID:2006102516
    • PASS
  • Path 1.5.0.1 -> 1.5.0.8 en-US - Windows XP x64 - partial and fallback Releasetest
    • User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.0.1) Gecko/20060111 Firefox/1.5.0.1 -> Mozilla/5.0 (Windows; U; Windows NT 5.2; de; rv:1.8.0.8) Gecko/20061025 Firefox/1.5.0.8
    • Talkback Build ID:2006102516
    • PASS
  • Path 1.5.0.1 -> 1.5.0.8 de - Windows XP x64 - partial and fallback Releasetest
    • User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.2; de; rv:1.8.0.1) Gecko/20060111 Firefox/1.5.0.1 -> Mozilla/5.0 (Windows; U; Windows NT 5.2; de; rv:1.8.0.8) Gecko/20061025 Firefox/1.5.0.8
    • Talkback Build ID:2006102516
    • PASS
  • Path 1.5.0.2 -> 1.5.0.8 en-US - Windows XP x64 - partial and fallback Releasetest
    • User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.0.2) Gecko/20060308 Firefox/1.5.0.2 -> Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.0.8) Gecko/20061025 Firefox/1.5.0.8
    • Talkback Build ID:2006102516
    • PASS
  • Path 1.5.0.2 -> 1.5.0.8 de - Windows XP x64 - partial and fallback Releasetest
    • User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.2; de; rv:1.8.0.2) Gecko/20060308 Firefox/1.5.0.2 -> Mozilla/5.0 (Windows; U; Windows NT 5.2; de; rv:1.8.0.8) Gecko/20061025 Firefox/1.5.0.8
    • Talkback Build ID:2006102516
    • PASS
  • Path 1.5.0.2 -> 1.5.0.8 en-US - Windows XP x64 - partial and fallback Releasetest
    • User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.0.2) Gecko/20060308 Firefox/1.5.0.2 -> Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.0.8) Gecko/20061025 Firefox/1.5.0.8
    • Talkback Build ID:2006102516
    • PASS
  • Path 1.5.0.3 -> 1.5.0.8 en-US - Windows XP x64 - partial and fallback Releasetest)
    • User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.0.3) Gecko/20060426 Firefox/1.5.0.3 -> Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.0.8) Gecko/20061025 Firefox/1.5.0.8
    • Talkback Build ID:2006102516
    • PASS
  • Path 1.5.0.3 -> 1.5.0.8 de - Windows XP x64 - partial and fallback Releasetest
    • User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.2; de; rv:1.8.0.3) Gecko/20060426 Firefox/1.5.0.3 -> Mozilla/5.0 (Windows; U; Windows NT 5.2; de; rv:1.8.0.8) Gecko/20061025 Firefox/1.5.0.8
    • Talkback Build ID:2006102516
    • PASS
  • Path 1.5.0.4 -> 1.5.0.8 en-US - Windows XP x64 - partial and fallback Releasetest
    • User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4 (6,1 MB) -> Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.0.8) Gecko/20061025 Firefox/1.5.0.8
    • Talkback Build ID:2006102516
    • PASS
  • Path 1.5.0.4 -> 1.5.0.8 de - Windows XP x64 - partial and fallback Releasetest
    • User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.2; de; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4 (6,1 MB) -> Mozilla/5.0 (Windows; U; Windows NT 5.2; de; rv:1.8.0.8) Gecko/20061025 Firefox/1.5.0.8
    • Talkback Build ID:2006102516
    • PASS
  • Path 1.5.0.5 -> 1.5.0.8 en-US - Windows XP x64 - partial and fallback Releasetest
    • User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.0.5) Gecko/20060719 Firefox/1.5.0.5 (6,1) -> Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.0.8) Gecko/20061025 Firefox/1.5.0.8
    • Talkback Build ID:2006102516
    • PASS
  • Path 1.5.0.5 -> 1.5.0.8 de - Windows XP x64 - partial and fallback Releasetest
    • User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.2; de; rv:1.8.0.5) Gecko/20060719 Firefox/1.5.0.5 (6,1) -> Mozilla/5.0 (Windows; U; Windows NT 5.2; de; rv:1.8.0.8) Gecko/20061025 Firefox/1.5.0.
    • Talkback Build ID:2006102516
    • PASS
  • Path 1.5.0.6 -> 1.5.0.8 en-US - Windows XP x64 - partial and fallback Releasetest
    • User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.0.6) Gecko/20060728 Firefox/1.5.0.6 (6,1 MB) -> Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.0.8) Gecko/20061025 Firefox/1.5.0.8
    • Talkback Build ID:2006102516
    • PASS
  • Path 1.5.0.6 -> 1.5.0.8 de - Windows XP x64 - partial and fallback Releasetest
    • User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.2; de; rv:1.8.0.6) Gecko/20060728 Firefox/1.5.0.6 (6,1 MB) -> Mozilla/5.0 (Windows; U; Windows NT 5.2; de; rv:1.8.0.8) Gecko/20061025 Firefox/1.5.0.8
    • Talkback Build ID:2006102516
    • PASS
  • Path 1.5.0.7 -> 1.5.0.8 en-US - Windows XP x64 - partial and fallback Releasetest
    • User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.0.6) Gecko/20060728 Firefox/1.5.0.6 (1,6 - 2,2 MB ?) -> Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.0.8) Gecko/20061025 Firefox/1.5.0.8
    • Talkback Build ID:2006102516
    • PASS
  • Path 1.5.0.7 -> 1.5.0.8 de - Windows XP x64 - partial and fallback Releasetest
    • User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.2; de; rv:1.8.0.7) Gecko/20060909 Firefox/1.5.0.7 382 KB Mozilla/5.0 -> (Windows; U; Windows NT 5.2; de; rv:1.8.0.8) Gecko/20061025 Firefox/1.5.0.8
    • Talkback Build ID:2006102516
    • PASS

juanb

  • 1.5.0.7 -> 1.5.0.8 (en-US, Linux(Fedora), partial + fallback, releasetest)
    • User-agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.0.8) Gecko/20061025 Firefox/1.5.0.8
    • Talkback Build IDs: 2006090918 -> 2006102516
    • PASS
  • 1.5.0.6 -> 1.5.0.8 (en-US, Linux(Fedora), complete + fallback, betatest)
    • User-agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.0.8) Gecko/20061025 Firefox/1.5.0.8
    • Talkback Build IDs: 2006072814 -> 2006102516
    • PASS
  • 1.5.0.4 -> 1.5.0.8 (en-US, IntelMac, complete + fallback, betatest)
    • User-agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.0.8) Gecko/20061025 Firefox/1.5.0.8
    • Talkback Build IDs: 2006050817 -> 2006102516
    • PASS
  • 1.5 -> 1.5.0.8 (zh-TW, Linux(Fedora), complete + fallback, betatest)
    • User-agent: Mozilla/5.0 (X11; U; Linux i686; zh-TW; rv:1.8.0.8) Gecko/20061025 Firefox/1.5.0.8
    • Talkback Build IDs: 2005111116 -> 2006102516
    • PASS

jay

  • All my locales/versions were updated to 1.5.0.8 with no issues, and the builds ids were all correct.

Thunderbird

Windows Mac Linux
1.5.0.7 en-US/de (tomcat) PASS (full + partial) en-US (juanb) PASS (partial + fallback) en-US (juanb) PASS (partial + fallback)
1.5.0.5 en-US/de (tomcat) PASS (full + partial) en-US (tester) RESULT (full + partial) en-US (juanb) PASS (complete + fallback)
1.5.0.4 en-US/de (tomcat) PASS (full + partial) ja-JP-mac (juanb) PASS (complete + fallback)
1.5.0.2 en-US/de (tomcat) PASS (full + partial)
1.5 en-US/de (tomcat) PASS (full + partial) nl (juanb) PASS (complete + fallback) it (juanb) PASS (complete + fallback)

tomcat

  • Path 1.5.0.0 -> 1.5.0.8 en-US Windows XP x64 partial/Fallback Releasetest
    • User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8) Gecko/20051201 Thunderbird/1.5 ID:2005120115 7,4 MB Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.0.8) Gecko/20061025 Thunderbird/1.5.0.8 ID:2006102517
    • Talkback Build ID:ID:2006102517
    • PASS
  • Path 1.5.0.2 -> 1.5.0.8 en-US Windows XP x64 partial/Fallback Releasetest
    • User-agent:Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.0.2) Gecko/20060308 Thunderbird/1.5.0.2 ID:2006030803 Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.0.8) Gecko/20061025 Thunderbird/1.5.0.8 ID:2006102517
    • Talkback Build ID:ID:2006102517
    • PASS
  • Path 1.5.0.4 -> 1.5.0.8 en-US Windows XP x64 partial/Fallback Releasetest
    • User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.0.4) Gecko/20060516 Thunderbird/1.5.0.4 ID:2006051612 Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.0.8) Gecko/20061025 Thunderbird/1.5.0.8 ID:2006102517
    • Talkback Build ID:ID:2006102517
    • PASS
  • Path 1.5.0.5 -> 1.5.0.8 en-US Windows XP x64 partial/Fallback Releasetest
    • User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.0.5) Gecko/20060719 Thunderbird/1.5.0.5 ID:2006071912 Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.0.8) Gecko/20061025 Thunderbird/1.5.0.8 ID:2006102517
    • Talkback Build ID:
    • PASS
  • Path 1.5.0.7 -> 1.5.0.8 en-US Windows XP x64 partial/Fallback Releasetest
    • User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.0.7) Gecko/20060909 Thunderbird/1.5.0.7 ID:2006090918 327 KB Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.0.8) Gecko/20061025 Thunderbird/1.5.0.8 ID:2006102517
    • Talkback Build ID: ID:2006102517
    • PASS
  • Path 1.5.0.0 -> 1.5.0.8 de Windows XP x64 partial/Fallback Releasetest
    • User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.2; de; rv:1.8) Gecko/20051201 Thunderbird/1.5 ID:2005120115 Mozilla/5.0 (Windows; U; Windows NT 5.2; de; rv:1.8.0.8) Gecko/20061025 Thunderbird/1.5.0.8 ID:2006102517
    • Talkback Build ID: ID:2006102517
    • PASS
  • Path Path 1.5.0.2 -> 1.5.0.8 de Windows XP x64 partial/Fallback Releasetest
    • User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.2; de; rv:1.8.0.2) Gecko/20060308 Thunderbird/1.5.0.2 ID:2006030803 Mozilla/5.0 (Windows; U; Windows NT 5.2; de; rv:1.8.0.8) Gecko/20061025 Thunderbird/1.5.0.8 ID:2006102517
    • Talkback Build ID:ID:2006102517
    • PASS
  • Path 1.5.0.4 -> 1.5.0.8 de Windows XP x64 partial/Fallback Releasetest
    • User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.2; de; rv:1.8.0.4) Gecko/20060516 Thunderbird/1.5.0.4 ID:2006051612Mozilla/5.0 (Windows; U; Windows NT 5.2; de; rv:1.8.0.8) Gecko/20061025 Thunderbird/1.5.0.8 ID:2006102517
    • Talkback Build ID: ID:2006102517
    • PASS
  • Path 1.5.0.5 -> 1.5.0.8 de Windows XP x64 partial/Fallback Releasetest
    • User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.2; de; rv:1.8.0.5) Gecko/20060719 Thunderbird/1.5.0.5 ID:2006071912 Mozilla/5.0 (Windows; U; Windows NT 5.2; de; rv:1.8.0.8) Gecko/20061025 Thunderbird/1.5.0.8 ID:2006102517
    • Talkback Build ID:ID:2006102517
    • PASS
  • Path 1.5.0.7 -> 1.5.0.8 de Windows XP x64 partial/Fallback Releasetest
    • User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.2; de; rv:1.8.0.7) Gecko/20060909 Thunderbird/1.5.0.7 ID:2006090918 Mozilla/5.0 (Windows; U; Windows NT 5.2; de; rv:1.8.0.8) Gecko/20061025 Thunderbird/1.5.0.8 ID:2006102517
    • Talkback Build ID:
    • PASS
  • Path 1.5.0.0 -> 1.5.0.8 ja Windows XP x64 partial/Fallback Releasetest
    • User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.2; ja; rv:1.8) Gecko/20051201 Thunderbird/1.5 ID:2005120115 Mozilla/5.0 (Windows; U; Windows NT 5.2; ja; rv:1.8.0.8) Gecko/20061025 Thunderbird/1.5.0.8 ID:2006102517
    • Talkback Build ID: ID:2006102517
    • PASS
  • Path 1.5.0.4 -> 1.5.0.8 da Windows XP x64 partial/Fallback Releasetest
    • User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.2; da; rv:1.8.0.4) Gecko/20060516 Thunderbird/1.5.0.4 ID:2006051612 Mozilla/5.0 (Windows; U; Windows NT 5.2; da; rv:1.8.0.8) Gecko/20061025 Thunderbird/1.5.0.8 ID:2006102517
    • Talkback Build ID: ID:2006102517
    • PASS
  • Path 1.5.0.5 -> 1.5.0.8 fi Windows XP x64 partial/Fallback Releasetest
    • User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.2; fi; rv:1.8.0.5) Gecko/20060719 Thunderbird/1.5.0.5 ID:2006071912 Mozilla/5.0 (Windows; U; Windows NT 5.2; fi; rv:1.8.0.8) Gecko/20061025 Thunderbird/1.5.0.8 ID:2006102517
    • Talkback Build ID: ID:2006102517
    • PASS
  • Path 1.5.0.2-> 1.5.0.8 zh-CN Windows XP x64 partial/Fallback Releasetest
    • User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.2; zh-CN; rv:1.8.0.2) Gecko/20060308 Thunderbird/1.5.0.2 ID:2006030803 Mozilla/5.0 (Windows; U; Windows NT 5.2; zh-CN; rv:1.8.0.8) Gecko/20061025 Thunderbird/1.5.0.8 ID:2006102517
    • Talkback Build ID: ID:2006102517
    • PASS

juanb

  • 1.5.0.7 -> 1.5.0.8 (en-US, Linux(Fedora), partial + fallback, releasetest)
    • User-agent: version 1.5.0.8 (20061025)
    • Talkback Build IDs: 2006090918 -> 2006102517
    • PASS
  • 1.5.0.5 -> 1.5.0.8 (en-US, Linux(Fedora), complete + fallback, betatest)
    • User-agent: version 1.5.0.8 (20061025)
    • Talkback Build IDs: 2006071913 -> 2006102517
    • PASS
  • 1.5.0.4 -> 1.5.0.8 (ja-JP-mac, Intelmac, complete + fallback, betatest)
    • User-agent: バージョン 1.5.0.8 (20061025)
    • Talkback Build IDs: 2006051612 -> 2006102517
    • PASS
  • 1.5 -> 1.5.0.8 (it, Linux(Fedora), complete + fallback, betatest)
    • User-agent: versione 1.5.0.8 (20061025)
    • Talkback Build IDs: 2005120113 -> 2006102517
    • PASS
  • 1.5 -> 1.5.0.8 (nl, Intelmac, complete + fallback, betatest)
    • User-agent: Versie 1.5.0.8 (20061025)
    • Talkback Build IDs: 2005120115 -> 2006102517
    • PASS

marcia

Tested with a fresh profile each time.

  • 1.5.0.7 -> 1.5.0.8 (en-US, PPC Mac 10.3.9, partial, releasetest)
  • 1.5.0.7 -> 1.5.0.8 (da, PPC Mac 10.3.9, partial, releasetest)
    • User-agent:version 1.5.0.8 (20061025)
    • Talkback Build ID: 2006102517
    • PASS
    • installed Nasa Normal theme. Theme was present after update.
  • 1.5 -> 1.5.0.8 (en-GB, PPC Mac 10.3.9, partial, releasetest)
    • User-agent: version 1.5.0.8 (20061025)
    • Talkback Build ID: 2006102517
    • PASS
    • Installed Mostly Crystal theme. Theme was present after update.
  • 1.5.0.2 -> 1.5.0.8 (en-US, PPC Mac 10.3.9, partial, releasetest)
    • User-agent: version 1.5.0.8 (20061025)
    • Talkback Build ID: 2006102517
    • PASS
    • Installed Noia 2.0 eXtreme theme. Theme was present after update.

P1 Locales

Every other locale, test failing the partial and make sure it falls back to full. If you are making a longer hop from 1.5->1.5.0.8 you can still test failing the update to see that after the failure it goes out and gets the update on the second try. Note that only 1.5.0.7 will use a partial update; 1.5.0.* will all use full updates.

  • da
  • de
  • es-ES
  • fi
  • fr
  • it
  • ja-JP-mac (mac primarily)
  • ja
  • nl
  • pl
  • zh-CN
  • zh-TW

P2 Locales

Those not assigned to any P1 locale can still help by selecting a localization from the complete list of locales and testing it (Complete list of locales). Post results here.


tester6

  • Path (example: 1.5.0.7 -> 1.5.0.8) (locale, platform, partial and/or fallback, channel)
    • User-agent:
    • Talkback Build ID:
    • RESULT

Live Testing

tester7

    • example: ff, win, ja 1.5.0.7->1.5.0.8 = RESULT
    • example: tb, mac, fi 1.5.0.5->1.5.0.8 = RESULT
Retrieved from "https://wiki.mozilla.org/index.php?title=Firefox:1.5.0.8:Test_Plan:Software_Update&oldid=40149"