Firefox:1.5.0.5:Test Plan:Software Update: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(69 intermediate revisions by 6 users not shown)
Line 1: Line 1:
== Software Update Spot Checks ==
== Software Update Spot Checks (Firefox and Thunderbird) ==
 
''Thunderbird Results at bottom of this page.''
== Firefox ==
===en-US Builds===
Rotate between partial and full, your choice
Rotate between partial and full, your choice


Windows en-US [tracy]
Windows en-US [tracy/ispiked]
*partial betatest 1.5.0.4 -> 1.5.0.5 - '''PASS'''
*partial betatest 1.5.0.4 -> 1.5.0.5 - '''PASS'''
*partial releasetest 1.5.0.4 -> 1.5.0.5 - '''PASS'''
*partial releasetest 1.5.0.4 -> 1.5.0.5 - '''PASS'''
*complete releasetest 1.5.0.2 -> 1.5.0.5 - '''PASS'''
**Tested successfully downloading and restarting and failing the complete update and restarting to download again. Both passed.


PPC Mac en-US [marcia]
PPC Mac en-US [marcia/ispiked]
*partial releasetest 1.5.0.4->1.5.0.5 - '''PASS'''
*partial releasetest 1.5.0.4->1.5.0.5 - '''PASS'''
*partial betatest 1.5.0.4->1.5.0.5 - '''PASS'''
*partial betatest 1.5.0.4->1.5.0.5 - '''PASS'''
*Talkback Build ID in both cases: 2006072310
*complete betatest 1.5.0.1->1.5.0.5 - '''PASS'''
**Talkback Build ID all cases: 2006072310


Linux (Ubuntu) en-US [juanb]
Linux (Ubuntu/Fedora) en-US [juanb/ispiked]
*partial betatest 1.5.0.4 -> 1.5.0.5 - '''PASS'''
*partial betatest 1.5.0.4 -> 1.5.0.5 - '''PASS'''
*complete releasetest 1.5.0.2 -> 1.5.0.5 - '''PASS'''
**Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.0.5) Gecko/20060719 Firefox/1.5.0.5
**Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.0.5) Gecko/20060719 Firefox/1.5.0.5
**Talkback BuildID = "2006071912"
**Talkback BuildID = "2006071912"


P1 locales:
===P1 Locales===
 
Marcia: Windows
Marcia: Windows
Tracy: Linux
ispiked: Linux
Juan: Mac
Juan: Mac


''Every other locale, test failing the partial and make sure it falls back to full.''
''Every other locale, test failing the partial and make sure it falls back to full. If you are making a longer hop from 1.5->1.5.0.5 you can still test failing the update to see that after the failure it goes out and gets the update on the second try. Note that only 1.5.0.4 will use a partial update; 1.5.0.* will all use full updates.''


* da - Windows betatest 1.5 -> 1.5.0.5 [marcia] -''' PASS'''
* da - Windows betatest 1.5 -> 1.5.0.5 [marcia] -''' PASS'''
**Talkback Build ID =  
**Talkback Build ID = 2006071912
* de - Mac releasetest 1.5.0.1 -> 1.5.0.5
* de - Mac releasetest 1.5.0.1 -> 1.5.0.5 [juanb] - '''PASS'''
* es-ES - Linux betatest 1.5.0.2 ->1.5.0.5
**Talkback BuildID = "2006072310"
* fi - Windows releasetest 1.5.0.3 -> 1.5.0.5
* es-ES - Linux betatest 1.5.0.2 ->1.5.0.5 - '''PASS'''
* fr - Mac betatest 1.5 -> 1.5.0.5
* fi - Windows releasetest 1.5.0.3 -> 1.5.0.5 [marcia] - '''PASS'''
* it - Linux releasetest 1.5.0.1 -> 1.5.0.5
**Talkback Build ID=2006071912
* fr - Mac betatest 1.5 -> 1.5.0.5 - [juanb] - '''PASS'''
**Talkback BuildID="2006072310"
* it - Linux releasetest 1.5.0.1 -> 1.5.0.5 - '''PASS'''
**Was failing because of wrong build IDs on AUS, but rhelmer fixed it.
* it - Linux releasetest 1.5.0.4 -> 1.5.0.5 - '''PASS'''
**Tested both partial updating and restarting, and failing partial and downloading complete. Both passed.
* ja-JP-mac (mac primarily) - Mac betatest 1.5.0.2 ->1.5.0.5
* ja-JP-mac (mac primarily) - Mac betatest 1.5.0.2 ->1.5.0.5
* ja - Windows betatest 1.5.0.3 -> 1.5.0.5
* ja - Windows betatest 1.5.0.3 -> 1.5.0.5 [marcia] - '''PASS'''
* nl - Linux betatest 1.5->1.5.0.5
**Fail on Windows XP Machine, Pass on Windows Machine
**Talkback Build ID=2006071912
**rhelmer passed on his machine as well
* nl - Linux betatest 1.5->1.5.0.5 - '''PASS'''
**Tested failing complete, downloading complete again.
* pl - Windows releasetest 1.5.0.1 ->1.5.0.5 [marcia] - '''PASS'''
* pl - Windows releasetest 1.5.0.1 ->1.5.0.5 [marcia] - '''PASS'''
**Talkback Build ID = 2006071912
**Talkback Build ID = 2006071912
**Tested Fail partial, fallback to Full - PASS
**Tested Fail partial, fallback to Full - '''PASS'''
* zh-CN - Mac betatest 1.5.0.4-> 1.5.0.5
* zh-CN - Mac betatest 1.5.0.4-> 1.5.0.5
** partial betatest - '''PASS'''
** partial betatest - '''PASS'''
*** Mozilla/5.0 (Macintosh; U; Intel Mac OS X; zh-CN; rv:1.8.0.5) Gecko/20060723 Firefox/1.5.0.5
*** Mozilla/5.0 (Macintosh; U; Intel Mac OS X; zh-CN; rv:1.8.0.5) Gecko/20060723 Firefox/1.5.0.5
*** Talkback BuildID = "2006072310"
*** Talkback BuildID = "2006072310"
* zh-TW - Linux releasetest 1.5.0.1 -> 1.5.0.5
* zh-TW - Linux releasetest 1.5.0.1 -> 1.5.0.5 - '''PASS'''
 
== Thunderbird ==
===en-US Builds===
Rotate between partial and full, your choice
 
Windows en-US [ispiked]
* partial betatest 1.5.0.4 -> 1.5.0.5 - '''PASS'''
**Tested getting partial update and restarting as well as failing partial and restarting to download complete. Both passed.
* complete betatest 1.5 -> 1.5.0.5 - '''PASS'''
 
Intel Mac en-US [marcia]
* partial releasetest (PPC build) 1.5.0.4 -> 1.5.0.5 - '''PASS'''
**confirmed update was correct file size of 7.4 MB
**On first test, partial failed immediately, fallover to full and then app hung after complete was downloaded. This issue needs to be documented in the post mortem - the thread on IRC was too long to follow.
* partial releasetest (UB Build) 1.5.0.4 -> 1.5.0.5 - '''PASS'''
**Build ID: version 1.5.0.5 (20060719)
* complete betatest (PPC build) 1.5.0.2 -> 1.5.0.5 - '''PASS'''
   
PPC Mac en-US [marcia]
* partial betatest (PPC build) 1.5.0.4 -> 1.5.0.5 - '''PASS'''
**On first test, partial failed immediately, fallover to full and then app hung after complete was downloaded.
* partial betatest (UB Build) 1.5.0.4 -> 1.5.0.5 - '''PASS'''
* complete releasetest (PPC build) 1.5 -> 1.5.0.5 - '''PASS'''
**Tested failing - '''PASS'''
 
Linux en-US [ispiked]
* partial betatest 1.5.0.4 -> 1.5.0.5 - '''PASS'''
**Tested failing partial, downloading complete and not failing partial and restarting to update. Both passed.
* complete releasetest 1.5.0.2 -> 1.5.0.5 - '''PASS'''
 
===P1 locales===
 
''Every other locale, test failing the partial and make sure it falls back to full. If you are making a longer hop from 1.5->1.5.0.5 you can still test failing the update to see that after the failure it goes out and gets the update on the second try. Note that only 1.5.0.4 will use a partial update; 1.5.0.* will all use full updates.''
 
* da - Windows betatest 1.5 -> 1.5.0.5 [marcia] - '''PASS'''
**Tested failing the update - '''PASS'''
* de - Mac releasetest partial(= full) 1.5.0.2 ppc -> 1.5.0.5 ub [jay] - '''PASS'''
* de - Mac releasetest partial 1.5.0.4 ppc -> 1.5.0.5 ub [jay] - '''PASS''' [6.5 MB - Version 1.5.0.5 (20060719)]
* es-ES - Linux betatest 1.5.0.2 ->1.5.0.5 [ispiked] - '''PASS'''
* fi - Windows releasetest 1.5.0.2 -> 1.5.0.5 [tracy] - '''PASS'''
* fr - Mac betatest partial(= full) 1.5 ppc -> 1.5.0.5 ub [jay] - '''PASS''' [15.8 MB - version 1.5.0.5 (20060719)]
* fr - Mac releasetest 1.5.0.4 ub -> 1.5.0.5 ub [jay] - '''PASS''' [version 1.5.0.5 (20060719)]
* it - Linux releasetest 1.5.0.2 -> 1.5.0.5 [tracy] - '''PASS'''
* ja-JP-mac (mac primarily) partial 1.5.0.4 ub -> 1.5.0.5 ub [jay] - '''PASS''' [1.6 MB - バージョン 1.5.0.5 (20060719)]
* ja-JP-mac full 1.5.0.5 ppc -> 1.5.0.5 ub [jay] -
* ja - Windows betatest 1.5.0.4 -> 1.5.0.5 [marcia] - '''PASS'''
**Tested failing the update - '''PASS'''
* nl - Linux betatest 1.5->1.5.0.5 [ispiked] - '''PASS'''
**Tested failing complete update and downloading complete again on restart.
* nl - Linux betatest 1.5.0.4 -> 1.5.0.5 [ispiked] - '''PASS'''
**This initially failed because the partial updates weren't generated correctly, but rhelmer fixed it.
* pl - Windows releasetest 1.5 ->1.5.0.5 [marcia] - '''PASS'''
* zh-CN - Mac betatest partial 1.5.0.4-> 1.5.0.5 [tracy] - '''PASS'''
* zh-CN - Mac releasetest full 1.5.0.4 -> 1.5.0.5 [jay] - '''PASS''' [17.8 MB - 版本 1.5.0.5 (20060719)]
* zh-TW - Linux releasetest 1.5.0.4 -> 1.5.0.5 [tracy] - ''no zh-TW 1.5.0.4 or 1.5.0.5''
 
===P2 locales===
 
* ca - Mac PPC releasetest 1.5.0.2(PPC) -> 1.5.0.5 [rob] - '''FAIL'''
** Downloads full update twice then updater freezes, updates.status = null
* ca - Mac PPC releasetest 1.5.0.4(PPC) -> 1.5.0.5 [rob] - '''FAIL'''
** Downloads patch, then full update: then updater freezes; updates.status = null
* ca - Mac PPC releasetest 1.5.0.4(UB) -> 1.5.0.5 [rob] - '''PASS'''

Latest revision as of 18:32, 26 July 2006

Software Update Spot Checks (Firefox and Thunderbird)

Thunderbird Results at bottom of this page.

Firefox

en-US Builds

Rotate between partial and full, your choice

Windows en-US [tracy/ispiked]

  • partial betatest 1.5.0.4 -> 1.5.0.5 - PASS
  • partial releasetest 1.5.0.4 -> 1.5.0.5 - PASS
  • complete releasetest 1.5.0.2 -> 1.5.0.5 - PASS
    • Tested successfully downloading and restarting and failing the complete update and restarting to download again. Both passed.

PPC Mac en-US [marcia/ispiked]

  • partial releasetest 1.5.0.4->1.5.0.5 - PASS
  • partial betatest 1.5.0.4->1.5.0.5 - PASS
  • complete betatest 1.5.0.1->1.5.0.5 - PASS
    • Talkback Build ID all cases: 2006072310

Linux (Ubuntu/Fedora) en-US [juanb/ispiked]

  • partial betatest 1.5.0.4 -> 1.5.0.5 - PASS
  • complete releasetest 1.5.0.2 -> 1.5.0.5 - PASS
    • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.0.5) Gecko/20060719 Firefox/1.5.0.5
    • Talkback BuildID = "2006071912"

P1 Locales

Marcia: Windows ispiked: Linux Juan: Mac

Every other locale, test failing the partial and make sure it falls back to full. If you are making a longer hop from 1.5->1.5.0.5 you can still test failing the update to see that after the failure it goes out and gets the update on the second try. Note that only 1.5.0.4 will use a partial update; 1.5.0.* will all use full updates.

  • da - Windows betatest 1.5 -> 1.5.0.5 [marcia] - PASS
    • Talkback Build ID = 2006071912
  • de - Mac releasetest 1.5.0.1 -> 1.5.0.5 [juanb] - PASS
    • Talkback BuildID = "2006072310"
  • es-ES - Linux betatest 1.5.0.2 ->1.5.0.5 - PASS
  • fi - Windows releasetest 1.5.0.3 -> 1.5.0.5 [marcia] - PASS
    • Talkback Build ID=2006071912
  • fr - Mac betatest 1.5 -> 1.5.0.5 - [juanb] - PASS
    • Talkback BuildID="2006072310"
  • it - Linux releasetest 1.5.0.1 -> 1.5.0.5 - PASS
    • Was failing because of wrong build IDs on AUS, but rhelmer fixed it.
  • it - Linux releasetest 1.5.0.4 -> 1.5.0.5 - PASS
    • Tested both partial updating and restarting, and failing partial and downloading complete. Both passed.
  • ja-JP-mac (mac primarily) - Mac betatest 1.5.0.2 ->1.5.0.5
  • ja - Windows betatest 1.5.0.3 -> 1.5.0.5 [marcia] - PASS
    • Fail on Windows XP Machine, Pass on Windows Machine
    • Talkback Build ID=2006071912
    • rhelmer passed on his machine as well
  • nl - Linux betatest 1.5->1.5.0.5 - PASS
    • Tested failing complete, downloading complete again.
  • pl - Windows releasetest 1.5.0.1 ->1.5.0.5 [marcia] - PASS
    • Talkback Build ID = 2006071912
    • Tested Fail partial, fallback to Full - PASS
  • zh-CN - Mac betatest 1.5.0.4-> 1.5.0.5
    • partial betatest - PASS
      • Mozilla/5.0 (Macintosh; U; Intel Mac OS X; zh-CN; rv:1.8.0.5) Gecko/20060723 Firefox/1.5.0.5
      • Talkback BuildID = "2006072310"
  • zh-TW - Linux releasetest 1.5.0.1 -> 1.5.0.5 - PASS

Thunderbird

en-US Builds

Rotate between partial and full, your choice

Windows en-US [ispiked]

  • partial betatest 1.5.0.4 -> 1.5.0.5 - PASS
    • Tested getting partial update and restarting as well as failing partial and restarting to download complete. Both passed.
  • complete betatest 1.5 -> 1.5.0.5 - PASS

Intel Mac en-US [marcia]

  • partial releasetest (PPC build) 1.5.0.4 -> 1.5.0.5 - PASS
    • confirmed update was correct file size of 7.4 MB
    • On first test, partial failed immediately, fallover to full and then app hung after complete was downloaded. This issue needs to be documented in the post mortem - the thread on IRC was too long to follow.
  • partial releasetest (UB Build) 1.5.0.4 -> 1.5.0.5 - PASS
    • Build ID: version 1.5.0.5 (20060719)
  • complete betatest (PPC build) 1.5.0.2 -> 1.5.0.5 - PASS

PPC Mac en-US [marcia]

  • partial betatest (PPC build) 1.5.0.4 -> 1.5.0.5 - PASS
    • On first test, partial failed immediately, fallover to full and then app hung after complete was downloaded.
  • partial betatest (UB Build) 1.5.0.4 -> 1.5.0.5 - PASS
  • complete releasetest (PPC build) 1.5 -> 1.5.0.5 - PASS
    • Tested failing - PASS

Linux en-US [ispiked]

  • partial betatest 1.5.0.4 -> 1.5.0.5 - PASS
    • Tested failing partial, downloading complete and not failing partial and restarting to update. Both passed.
  • complete releasetest 1.5.0.2 -> 1.5.0.5 - PASS

P1 locales

Every other locale, test failing the partial and make sure it falls back to full. If you are making a longer hop from 1.5->1.5.0.5 you can still test failing the update to see that after the failure it goes out and gets the update on the second try. Note that only 1.5.0.4 will use a partial update; 1.5.0.* will all use full updates.

  • da - Windows betatest 1.5 -> 1.5.0.5 [marcia] - PASS
    • Tested failing the update - PASS
  • de - Mac releasetest partial(= full) 1.5.0.2 ppc -> 1.5.0.5 ub [jay] - PASS
  • de - Mac releasetest partial 1.5.0.4 ppc -> 1.5.0.5 ub [jay] - PASS [6.5 MB - Version 1.5.0.5 (20060719)]
  • es-ES - Linux betatest 1.5.0.2 ->1.5.0.5 [ispiked] - PASS
  • fi - Windows releasetest 1.5.0.2 -> 1.5.0.5 [tracy] - PASS
  • fr - Mac betatest partial(= full) 1.5 ppc -> 1.5.0.5 ub [jay] - PASS [15.8 MB - version 1.5.0.5 (20060719)]
  • fr - Mac releasetest 1.5.0.4 ub -> 1.5.0.5 ub [jay] - PASS [version 1.5.0.5 (20060719)]
  • it - Linux releasetest 1.5.0.2 -> 1.5.0.5 [tracy] - PASS
  • ja-JP-mac (mac primarily) partial 1.5.0.4 ub -> 1.5.0.5 ub [jay] - PASS [1.6 MB - バージョン 1.5.0.5 (20060719)]
  • ja-JP-mac full 1.5.0.5 ppc -> 1.5.0.5 ub [jay] -
  • ja - Windows betatest 1.5.0.4 -> 1.5.0.5 [marcia] - PASS
    • Tested failing the update - PASS
  • nl - Linux betatest 1.5->1.5.0.5 [ispiked] - PASS
    • Tested failing complete update and downloading complete again on restart.
  • nl - Linux betatest 1.5.0.4 -> 1.5.0.5 [ispiked] - PASS
    • This initially failed because the partial updates weren't generated correctly, but rhelmer fixed it.
  • pl - Windows releasetest 1.5 ->1.5.0.5 [marcia] - PASS
  • zh-CN - Mac betatest partial 1.5.0.4-> 1.5.0.5 [tracy] - PASS
  • zh-CN - Mac releasetest full 1.5.0.4 -> 1.5.0.5 [jay] - PASS [17.8 MB - 版本 1.5.0.5 (20060719)]
  • zh-TW - Linux releasetest 1.5.0.4 -> 1.5.0.5 [tracy] - no zh-TW 1.5.0.4 or 1.5.0.5

P2 locales

  • ca - Mac PPC releasetest 1.5.0.2(PPC) -> 1.5.0.5 [rob] - FAIL
    • Downloads full update twice then updater freezes, updates.status = null
  • ca - Mac PPC releasetest 1.5.0.4(PPC) -> 1.5.0.5 [rob] - FAIL
    • Downloads patch, then full update: then updater freezes; updates.status = null
  • ca - Mac PPC releasetest 1.5.0.4(UB) -> 1.5.0.5 [rob] - PASS
Retrieved from "https://wiki.mozilla.org/index.php?title=Firefox:1.5.0.5:Test_Plan:Software_Update&oldid=29996"