Firefox:1.5.0.5:Test Plan:Software Update: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(42 intermediate revisions by 5 users not shown)
Line 5: Line 5:
Rotate between partial and full, your choice
Rotate between partial and full, your choice


Windows en-US [tracy]
Windows en-US [tracy/ispiked]
*partial betatest 1.5.0.4 -> 1.5.0.5 - '''PASS'''
*partial betatest 1.5.0.4 -> 1.5.0.5 - '''PASS'''
*partial releasetest 1.5.0.4 -> 1.5.0.5 - '''PASS'''
*partial releasetest 1.5.0.4 -> 1.5.0.5 - '''PASS'''
*complete releasetest 1.5.0.2 -> 1.5.0.5 - '''PASS'''
**Tested successfully downloading and restarting and failing the complete update and restarting to download again. Both passed.


PPC Mac en-US [marcia]
PPC Mac en-US [marcia/ispiked]
*partial releasetest 1.5.0.4->1.5.0.5 - '''PASS'''
*partial releasetest 1.5.0.4->1.5.0.5 - '''PASS'''
*partial betatest 1.5.0.4->1.5.0.5 - '''PASS'''
*partial betatest 1.5.0.4->1.5.0.5 - '''PASS'''
*Talkback Build ID in both cases: 2006072310
*complete betatest 1.5.0.1->1.5.0.5 - '''PASS'''
**Talkback Build ID all cases: 2006072310


Linux (Ubuntu) en-US [juanb]
Linux (Ubuntu/Fedora) en-US [juanb/ispiked]
*partial betatest 1.5.0.4 -> 1.5.0.5 - '''PASS'''
*partial betatest 1.5.0.4 -> 1.5.0.5 - '''PASS'''
*complete releasetest 1.5.0.2 -> 1.5.0.5 - '''PASS'''
**Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.0.5) Gecko/20060719 Firefox/1.5.0.5
**Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.0.5) Gecko/20060719 Firefox/1.5.0.5
**Talkback BuildID = "2006071912"
**Talkback BuildID = "2006071912"
Line 56: Line 60:


== Thunderbird ==
== Thunderbird ==
 
===en-US Builds===
Rotate between partial and full, your choice
Rotate between partial and full, your choice


Windows en-US [marcia]
Windows en-US [ispiked]
* partial betatest 1.5.0.4 -> 1.5.0.5 -
* partial betatest 1.5.0.4 -> 1.5.0.5 - '''PASS'''
* partial releasetest 1.5.0.4 -> 1.5.0.5 -  
**Tested getting partial update and restarting as well as failing partial and restarting to download complete. Both passed.
* complete betatest 1.5 -> 1.5.0.5 - '''PASS'''


PPC Mac en-US [marcia]
Intel Mac en-US [marcia]  
* partial releasetest (PPC build) 1.5.0.4 -> 1.5.0.5 - '''PASS'''
**confirmed update was correct file size of 7.4 MB
**On first test, partial failed immediately, fallover to full and then app hung after complete was downloaded. This issue needs to be documented in the post mortem - the thread on IRC was too long to follow.
* partial releasetest (UB Build) 1.5.0.4 -> 1.5.0.5 - '''PASS'''
**Build ID: version 1.5.0.5 (20060719)
* complete betatest (PPC build) 1.5.0.2 -> 1.5.0.5 - '''PASS'''
      
      
Linux en-US []
PPC Mac en-US [marcia]
* partial betatest (PPC build) 1.5.0.4 -> 1.5.0.5 - '''PASS'''
**On first test, partial failed immediately, fallover to full and then app hung after complete was downloaded.
* partial betatest (UB Build) 1.5.0.4 -> 1.5.0.5 - '''PASS'''
* complete releasetest (PPC build) 1.5 -> 1.5.0.5 - '''PASS'''
**Tested failing - '''PASS'''
 
Linux en-US [ispiked]
* partial betatest 1.5.0.4 -> 1.5.0.5 - '''PASS'''
**Tested failing partial, downloading complete and not failing partial and restarting to update. Both passed.
* complete releasetest 1.5.0.2 -> 1.5.0.5 - '''PASS'''


P1 locales:
===P1 locales===


''Every other locale, test failing the partial and make sure it falls back to full. If you are making a longer hop from 1.5->1.5.0.5 you can still test failing the update to see that after the failure it goes out and gets the update on the second try. Note that only 1.5.0.4 will use a partial update; 1.5.0.* will all use full updates.''
''Every other locale, test failing the partial and make sure it falls back to full. If you are making a longer hop from 1.5->1.5.0.5 you can still test failing the update to see that after the failure it goes out and gets the update on the second try. Note that only 1.5.0.4 will use a partial update; 1.5.0.* will all use full updates.''


* da - Windows betatest 1.5 -> 1.5.0.5 [marcia] -
* da - Windows betatest 1.5 -> 1.5.0.5 [marcia] - '''PASS'''
* de - Mac releasetest 1.5.0.2 -> 1.5.0.5 [jay] -
**Tested failing the update - '''PASS'''
* de - Mac releasetest partial(= full) 1.5.0.2 ppc -> 1.5.0.5 ub [jay] - '''PASS'''
* de - Mac releasetest partial 1.5.0.4 ppc -> 1.5.0.5 ub [jay] - '''PASS''' [6.5 MB - Version 1.5.0.5 (20060719)]
* es-ES - Linux betatest 1.5.0.2 ->1.5.0.5 [ispiked] - '''PASS'''
* es-ES - Linux betatest 1.5.0.2 ->1.5.0.5 [ispiked] - '''PASS'''
* fi - Windows releasetest 1.5.0.2 -> 1.5.0.5 [tracy]
* fi - Windows releasetest 1.5.0.2 -> 1.5.0.5 [tracy] - '''PASS'''
* fr - Mac betatest 1.5 -> 1.5.0.5 [jay] -
* fr - Mac betatest partial(= full) 1.5 ppc -> 1.5.0.5 ub [jay] - '''PASS''' [15.8 MB - version 1.5.0.5 (20060719)]
* it - Linux releasetest 1.5.0.2 -> 1.5.0.5 [tracy]
* fr - Mac releasetest 1.5.0.4 ub -> 1.5.0.5 ub [jay] - '''PASS''' [version 1.5.0.5 (20060719)]
* ja-JP-mac (mac primarily) 1.5.0.4->1.5.0.5 [jay] -  
* it - Linux releasetest 1.5.0.2 -> 1.5.0.5 [tracy] - '''PASS'''
* ja - Windows betatest 1.5.0.4 -> 1.5.0.5 [marcia] -  
* ja-JP-mac (mac primarily) partial 1.5.0.4 ub -> 1.5.0.5 ub [jay] - '''PASS''' [1.6 MB - バージョン 1.5.0.5 (20060719)]
* nl - Linux betatest 1.5->1.5.0.5 [ispiked] -
* ja-JP-mac full 1.5.0.5 ppc -> 1.5.0.5 ub [jay] -
* pl - Windows releasetest 1.5 ->1.5.0.5 [marcia] -
* ja - Windows betatest 1.5.0.4 -> 1.5.0.5 [marcia] - '''PASS'''
* zh-CN - Mac betatest 1.5.0.4-> 1.5.0.5 [tracy]
**Tested failing the update - '''PASS'''
* zh-TW - Linux releasetest 1.5.0.4 -> 1.5.0.5 [tracy]
* nl - Linux betatest 1.5->1.5.0.5 [ispiked] - '''PASS'''
**Tested failing complete update and downloading complete again on restart.
* nl - Linux betatest 1.5.0.4 -> 1.5.0.5 [ispiked] - '''PASS'''
**This initially failed because the partial updates weren't generated correctly, but rhelmer fixed it.
* pl - Windows releasetest 1.5 ->1.5.0.5 [marcia] - '''PASS'''
* zh-CN - Mac betatest partial 1.5.0.4-> 1.5.0.5 [tracy] - '''PASS'''
* zh-CN - Mac releasetest full 1.5.0.4 -> 1.5.0.5 [jay] - '''PASS''' [17.8 MB - 版本 1.5.0.5 (20060719)]
* zh-TW - Linux releasetest 1.5.0.4 -> 1.5.0.5 [tracy] - ''no zh-TW 1.5.0.4 or 1.5.0.5''
 
===P2 locales===
 
* ca - Mac PPC releasetest 1.5.0.2(PPC) -> 1.5.0.5 [rob] - '''FAIL'''
** Downloads full update twice then updater freezes, updates.status = null
* ca - Mac PPC releasetest 1.5.0.4(PPC) -> 1.5.0.5 [rob] - '''FAIL'''
** Downloads patch, then full update: then updater freezes; updates.status = null
* ca - Mac PPC releasetest 1.5.0.4(UB) -> 1.5.0.5 [rob] - '''PASS'''

Latest revision as of 18:32, 26 July 2006

Software Update Spot Checks (Firefox and Thunderbird)

Thunderbird Results at bottom of this page.

Firefox

en-US Builds

Rotate between partial and full, your choice

Windows en-US [tracy/ispiked]

  • partial betatest 1.5.0.4 -> 1.5.0.5 - PASS
  • partial releasetest 1.5.0.4 -> 1.5.0.5 - PASS
  • complete releasetest 1.5.0.2 -> 1.5.0.5 - PASS
    • Tested successfully downloading and restarting and failing the complete update and restarting to download again. Both passed.

PPC Mac en-US [marcia/ispiked]

  • partial releasetest 1.5.0.4->1.5.0.5 - PASS
  • partial betatest 1.5.0.4->1.5.0.5 - PASS
  • complete betatest 1.5.0.1->1.5.0.5 - PASS
    • Talkback Build ID all cases: 2006072310

Linux (Ubuntu/Fedora) en-US [juanb/ispiked]

  • partial betatest 1.5.0.4 -> 1.5.0.5 - PASS
  • complete releasetest 1.5.0.2 -> 1.5.0.5 - PASS
    • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.0.5) Gecko/20060719 Firefox/1.5.0.5
    • Talkback BuildID = "2006071912"

P1 Locales

Marcia: Windows ispiked: Linux Juan: Mac

Every other locale, test failing the partial and make sure it falls back to full. If you are making a longer hop from 1.5->1.5.0.5 you can still test failing the update to see that after the failure it goes out and gets the update on the second try. Note that only 1.5.0.4 will use a partial update; 1.5.0.* will all use full updates.

  • da - Windows betatest 1.5 -> 1.5.0.5 [marcia] - PASS
    • Talkback Build ID = 2006071912
  • de - Mac releasetest 1.5.0.1 -> 1.5.0.5 [juanb] - PASS
    • Talkback BuildID = "2006072310"
  • es-ES - Linux betatest 1.5.0.2 ->1.5.0.5 - PASS
  • fi - Windows releasetest 1.5.0.3 -> 1.5.0.5 [marcia] - PASS
    • Talkback Build ID=2006071912
  • fr - Mac betatest 1.5 -> 1.5.0.5 - [juanb] - PASS
    • Talkback BuildID="2006072310"
  • it - Linux releasetest 1.5.0.1 -> 1.5.0.5 - PASS
    • Was failing because of wrong build IDs on AUS, but rhelmer fixed it.
  • it - Linux releasetest 1.5.0.4 -> 1.5.0.5 - PASS
    • Tested both partial updating and restarting, and failing partial and downloading complete. Both passed.
  • ja-JP-mac (mac primarily) - Mac betatest 1.5.0.2 ->1.5.0.5
  • ja - Windows betatest 1.5.0.3 -> 1.5.0.5 [marcia] - PASS
    • Fail on Windows XP Machine, Pass on Windows Machine
    • Talkback Build ID=2006071912
    • rhelmer passed on his machine as well
  • nl - Linux betatest 1.5->1.5.0.5 - PASS
    • Tested failing complete, downloading complete again.
  • pl - Windows releasetest 1.5.0.1 ->1.5.0.5 [marcia] - PASS
    • Talkback Build ID = 2006071912
    • Tested Fail partial, fallback to Full - PASS
  • zh-CN - Mac betatest 1.5.0.4-> 1.5.0.5
    • partial betatest - PASS
      • Mozilla/5.0 (Macintosh; U; Intel Mac OS X; zh-CN; rv:1.8.0.5) Gecko/20060723 Firefox/1.5.0.5
      • Talkback BuildID = "2006072310"
  • zh-TW - Linux releasetest 1.5.0.1 -> 1.5.0.5 - PASS

Thunderbird

en-US Builds

Rotate between partial and full, your choice

Windows en-US [ispiked]

  • partial betatest 1.5.0.4 -> 1.5.0.5 - PASS
    • Tested getting partial update and restarting as well as failing partial and restarting to download complete. Both passed.
  • complete betatest 1.5 -> 1.5.0.5 - PASS

Intel Mac en-US [marcia]

  • partial releasetest (PPC build) 1.5.0.4 -> 1.5.0.5 - PASS
    • confirmed update was correct file size of 7.4 MB
    • On first test, partial failed immediately, fallover to full and then app hung after complete was downloaded. This issue needs to be documented in the post mortem - the thread on IRC was too long to follow.
  • partial releasetest (UB Build) 1.5.0.4 -> 1.5.0.5 - PASS
    • Build ID: version 1.5.0.5 (20060719)
  • complete betatest (PPC build) 1.5.0.2 -> 1.5.0.5 - PASS

PPC Mac en-US [marcia]

  • partial betatest (PPC build) 1.5.0.4 -> 1.5.0.5 - PASS
    • On first test, partial failed immediately, fallover to full and then app hung after complete was downloaded.
  • partial betatest (UB Build) 1.5.0.4 -> 1.5.0.5 - PASS
  • complete releasetest (PPC build) 1.5 -> 1.5.0.5 - PASS
    • Tested failing - PASS

Linux en-US [ispiked]

  • partial betatest 1.5.0.4 -> 1.5.0.5 - PASS
    • Tested failing partial, downloading complete and not failing partial and restarting to update. Both passed.
  • complete releasetest 1.5.0.2 -> 1.5.0.5 - PASS

P1 locales

Every other locale, test failing the partial and make sure it falls back to full. If you are making a longer hop from 1.5->1.5.0.5 you can still test failing the update to see that after the failure it goes out and gets the update on the second try. Note that only 1.5.0.4 will use a partial update; 1.5.0.* will all use full updates.

  • da - Windows betatest 1.5 -> 1.5.0.5 [marcia] - PASS
    • Tested failing the update - PASS
  • de - Mac releasetest partial(= full) 1.5.0.2 ppc -> 1.5.0.5 ub [jay] - PASS
  • de - Mac releasetest partial 1.5.0.4 ppc -> 1.5.0.5 ub [jay] - PASS [6.5 MB - Version 1.5.0.5 (20060719)]
  • es-ES - Linux betatest 1.5.0.2 ->1.5.0.5 [ispiked] - PASS
  • fi - Windows releasetest 1.5.0.2 -> 1.5.0.5 [tracy] - PASS
  • fr - Mac betatest partial(= full) 1.5 ppc -> 1.5.0.5 ub [jay] - PASS [15.8 MB - version 1.5.0.5 (20060719)]
  • fr - Mac releasetest 1.5.0.4 ub -> 1.5.0.5 ub [jay] - PASS [version 1.5.0.5 (20060719)]
  • it - Linux releasetest 1.5.0.2 -> 1.5.0.5 [tracy] - PASS
  • ja-JP-mac (mac primarily) partial 1.5.0.4 ub -> 1.5.0.5 ub [jay] - PASS [1.6 MB - バージョン 1.5.0.5 (20060719)]
  • ja-JP-mac full 1.5.0.5 ppc -> 1.5.0.5 ub [jay] -
  • ja - Windows betatest 1.5.0.4 -> 1.5.0.5 [marcia] - PASS
    • Tested failing the update - PASS
  • nl - Linux betatest 1.5->1.5.0.5 [ispiked] - PASS
    • Tested failing complete update and downloading complete again on restart.
  • nl - Linux betatest 1.5.0.4 -> 1.5.0.5 [ispiked] - PASS
    • This initially failed because the partial updates weren't generated correctly, but rhelmer fixed it.
  • pl - Windows releasetest 1.5 ->1.5.0.5 [marcia] - PASS
  • zh-CN - Mac betatest partial 1.5.0.4-> 1.5.0.5 [tracy] - PASS
  • zh-CN - Mac releasetest full 1.5.0.4 -> 1.5.0.5 [jay] - PASS [17.8 MB - 版本 1.5.0.5 (20060719)]
  • zh-TW - Linux releasetest 1.5.0.4 -> 1.5.0.5 [tracy] - no zh-TW 1.5.0.4 or 1.5.0.5

P2 locales

  • ca - Mac PPC releasetest 1.5.0.2(PPC) -> 1.5.0.5 [rob] - FAIL
    • Downloads full update twice then updater freezes, updates.status = null
  • ca - Mac PPC releasetest 1.5.0.4(PPC) -> 1.5.0.5 [rob] - FAIL
    • Downloads patch, then full update: then updater freezes; updates.status = null
  • ca - Mac PPC releasetest 1.5.0.4(UB) -> 1.5.0.5 [rob] - PASS