Firefox:1.5.0.7:UpdateTesting: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
Line 45: Line 45:


== Alice's Tests ==
== Alice's Tests ==
* 1.5.0.6 -> 1.5.0.7 (enUS, win, partial)
* 1.5.0.6 -> 1.5.0.7 (enUS, winXP, partial)
** releasetest
** releasetest
** 531 KB
** 531 KB
** '''PASS'''
** '''PASS'''
* 1.5.0.6 -> 1.5.0.7 (enUS, win, fallback)
* 1.5.0.6 -> 1.5.0.7 (enUS, winXP, fallback)
** betatest
** betatest
** 6.1 MB
** 6.1 MB
Line 68: Line 68:
** betatest
** betatest
** 14.5 MB
** 14.5 MB
** '''PASS'''
* 1.5 -> 1.5.0.7 (enUS, WinXP, full)
** betatest
** 6.1 MB
** '''PASS'''
** '''PASS'''



Revision as of 00:05, 13 September 2006

en-US Builds

Software Update Testing Results

Note: The script we have does not test failing the partial on purpose and then having Firefox/Thunderbird go out and get the full update. In the chart below when it says "Fallback" that means fail the partial and make sure it goes out and gets the full update.

Firefox

Windows Mac Linux
1.5.0.6 en-US (alice) PASS (full + partial) en-US (alice) PASS (full + partial) en-US (tracy) -
1.5.0.4 en-US fallback - (alice) PASS
1.5.0.3 One Tier 1 locale (jay) - PASS
1.5.0.1 One Tier 1 locale (jay) - PASS (alice) PASS
1.5 (alice) PASS One Tier 1 locale (jay) - PASS One Tier 1 locale fallback (tracy) -

Detailed Results go here:

    • Platform
    • Talkback Build ID
    • Version String
    • PASS/FAIL

Alice's Tests

  • 1.5.0.6 -> 1.5.0.7 (enUS, winXP, partial)
    • releasetest
    • 531 KB
    • PASS
  • 1.5.0.6 -> 1.5.0.7 (enUS, winXP, fallback)
    • betatest
    • 6.1 MB
    • PASS
  • 1.5.0.6 -> 1.5.0.7 (enUS, MacOSX, partial)
    • releasetest
    • 1.6 MB
    • PASS
  • 1.5.0.6 -> 1.5.0.7 (enUS, MacOSX, fallback)
    • releastest
    • 14.5 MB
    • PASS
  • 1.5.0.4 -> 1.5.0.7 (enUS, MacOSX, full)
    • releasetest
    • 14.5 MB
    • PASS
  • 1.5.0.1 -> 1.5.0.7 (enUS, MacOSX, full)
    • betatest
    • 14.5 MB
    • PASS
  • 1.5 -> 1.5.0.7 (enUS, WinXP, full)
    • betatest
    • 6.1 MB
    • PASS

Jay's Tests

  • 1.5.0.1 -> 1.5.0.7 (fr, Win32, partial, releasetest) [6.1MB]
    • Talkback Build ID: 2006090918
    • User-agent:
    • PASS
  • 1.5 -> 1.5.0.7 (de, MacOSX, partial, betatest) [14.5MB]
    • Talkback Build ID: 2006090921
    • User-agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X; de; rv:1.8.0.7) Gecko/20060909 Firefox/1.5.0.7
    • PASS
  • 1.5.0.3 -> 1.5.0.7 (ja, MacOSX, partial, releasetest) [14.5MB]

Thunderbird

Windows Mac Linux
1.5.0.5 en-US en-US en-US
1.5.0.4 en-US fallback -
1.5.0.2 One Tier 1 locale
1.5 One Tier 1 locale - One Tier 1 locale fallback -

Detailed Results go here:

    • Platform
    • Talkback Build ID
    • Version String
    • PASS/FAIL

P1 Locales

Every other locale, test failing the partial and make sure it falls back to full. If you are making a longer hop from 1.5->1.5.0.7 you can still test failing the update to see that after the failure it goes out and gets the update on the second try. Note that only 1.5.0.6 will use a partial update; 1.5.0.* will all use full updates.

  • da
  • de
  • es-ES
  • fi
  • fr
  • it
  • ja-JP-mac (mac primarily)
  • ja
  • nl
  • pl
  • zh-CN
  • zh-TW

P2 Locales

Those not assigned to any P1 locale can still help by selecting a localization from the complete list of locales and testing it (Complete list of locales). Post results here.