Firefox:1.5.0.4:Test Plan:Software Update

From MozillaWiki
Jump to: navigation, search

The Test

  • Test that updates work for the following scenerios:
    • 1.5.0.3 -> 1.5.0.4 (partial and full) - ALL P1 locales and platforms
    • 1.5.0 - 1.5.0.2 -> 1.5.0.4 (partial or full, since both will get the full .mar patch) - Spot check locales on a mix of platforms
    • Simple update/launch test
  • Use betatest and releasetest channels
  • Platforms:
    • win32
    • linux
    • Mac PPC -> Mac UB (New Update Path - Needs Extra Testing)
    • Mac UB -> Mac UB
  • Cycle through the platforms you have available.
  • Generally I am shifting platforms from the last test to this test in this way:
  • Info about locales;
    • Official l10n list (used by Release team)

Configs/Results for this test

Sample UA Strings after update to 1.5.0.4:

  • Windows = Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4
  • Linux =
  • MacOS X =

Locales Tested

Test the following scenarios on all platforms for P1s:

  • Firefox 1.5.0.3 -> Firefox 1.5.0.4 (partial and full)
  • Firefox 1.5.0 - Firefox 1.5.0.2 (pick any one of the 3 releases) -> 1.5.0.4 (partial or full, since both will get the full .mar patch) -
    • Partial patches + betatest/releasetest channels will be ready for testing later tonight 5/24 or tomorrow morning, keep an eye out for email from rhelmer
    • Tracy (Windows), Marcia (Mac UB->UB), Juan (Mac PPC->UB), Jay (Linux)
    • Waiting for full patches from rhelmer

Issues Discovered:

  • Mac OS X UB/PPC mixup:
davel:	should url be osxppc instead of osx for partial?
rhelmer:	yes it should
rhelmer:	complete is right but partial is not for ppc->ub
davel:	yup.
davel:	(I verified it by looking at the redirect)
juanb:	what is not right with the partial?
rhelmer:	juanb: it's the partial for ub->ub
coop:	it's the wrong partial
juanb:	ok
davel:	aus was pointing 1503 pcc to the ub->ub partial.  the url in update.xml had "os=osx" instead of "os=osxppc"
rhelmer:	i am regenerating the patchinfo files now..
rhelmer:	i want to make sure this is fixed in the patcher2 config
rhelmer:	(patcher2 generates the patchinfo files that we feed to AUS)
  • had a file named "ja-JP-unimac.mac.mar" instead of "ja-JP-mac.unimac.mar"
  • l10n Build IDs for 1.5.0.1 -> 1.5.0.4 path not correct (different from enUS)


Priority 1 (P1):

  • 1. da
    • 1.5.0.3 -> Mozilla/5.0 (Windows; U; Windows NT 5.1; da; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4 (partial) (betatest) - PASS (tracy)
    • 1.5 -> Mozilla/5.0 (Windows; U; Windows NT 5.1; da; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4 (releasetest) - PASS (tracy)
    • Jay (Linux)
      • 1.5.0.3 -> 1.5.0.4, releasetest, partial - PASS
    • Marcia (UB on Intel Mac)
      • 1.5.0.3 -> 1.5.0.4, releasetest, partial - PASS
    • Juan (PPC-UB on Intel Mac)
      • 1.5.0.3 -> 1.5.0.4, releasetest, partial, full - PASS
  • 2. de
    • 1.5.0.3 -> Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4 (partial) (releasetest) - PASS - (tracy)
    • Jay (Linux)
      • 1.5.0.3 -> 1.5.0.4, betatest, partial - PASS
      • 1.5.0.3 -> 1.5.0.4, releasetest, full - PASS
      • 1.5.0.1 -> 1.5.0.4, betatest, partial - FAIL (l10n Build IDs different than enUS for 1.5.0.1, so all locales should be broken for 1.5.0.1 -> 1.5.0.4)
      • 1.5.0.2 -> 1.5.0.4, releasetest, partial - PASS
    • Marcia (UB on Intel Mac)
      • 1.5.0.3 -> 1.5.0.4, betatest, partial - PASS
      • 1.5.0.3 -> 1.5.0.4, releasetest, full - PASS
    • Juan (PPC-UB on Intel Mac)
      • 1.5.0.3 -> 1.5.0.4, betatest, partial, full - PASS
  • 3. en-US
    • 1.5.0.3 -> Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4 (partial) (betatest) - PASS - (tracy)
    • 1.5.0.3 -> Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4 (full) (releasetest) - PASS - (tracy)
    • Jay (Linux)
      • 1.5.0.3 -> 1.5.0.4, releasetest, partial - PASS
      • 1.5.0.1 -> 1.5.0.4, releasetest, partial -
      • 1.5.0.2 -> 1.5.0.4, betatest, partial - PASS
    • Marcia (UB on PPC Mac)
      • 1.5.0.3 -> 1.5.0.4, releasetest, partial - PASS
    • Juan (PPC-UB on Intel Mac)
      • 1.5.0.3 -> 1.5.0.4, releasetest, partial, betatest, full - PASS
      • 1.5 -> 1.5.0.4, releasetest, full - PASS
  • 4. es-ES
    • 1.5.0.3 -> Mozilla/5.0 (Windows; U; Windows NT 5.1; es-ES; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4 (full) (releasetest) - PASS - (tracy)
    • Jay (Linux)
      • 1.5.0.3 -> 1.5.0.4, betatest, partial - PASS
    • Marcia (UB on PPC)
      • 1.5.0.3 -> 1.5.0.4, releasetest, partial - PASS
    • Juan (PPC-UB on Intel Mac)
      • 1.5.0.3 -> 1.5.0.4, betatest, partial, full - PASS
      • 1.5.0.1 -> 1.5.0.4, releasetest, full - PASS
  • 5. fi
    • 1.5.0.3 -> Mozilla/5.0 (Windows; U; Windows NT 5.1; fi; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4 (partial) (betatest) - PASS - (tracy)
    • Jay (Linux)
      • 1.5.0.3 -> 1.5.0.4, releasetest, partial - PASS
      • 1.5.0 -> 1.5.0.4, releasetest, partial - PASS
    • Marcia (UB on PPC)
      • 1.5.0.3 -> 1.5.0.4, releasetest, partial - PASS
      • 1.5.0.3 -> 1.5.0.4, betatest, full - PASS
    • Juan (PPC-UB on Intel Mac)
      • 1.5.0.3 -> 1.5.0.4, releasetest, partial, full - PASS
  • 6. fr
    • 1.5.0.3 -> Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4 (partial) (releasetest) - PASS - (tracy)
    • Jay (Linux)
      • 1.5.0.3 -> 1.5.0.4, betatest, partial - PASS
      • 1.5.0.3 -> 1.5.0.4, releasetest, full - PASS
      • 1.5.0.1 -> 1.5.0.4, betatest, partial -
    • Juan (PPC-UB on Intel Mac)
      • 1.5.0.3 -> 1.5.0.4, betatest, partial, releasetest, full - PASS
      • 1.5.0.2 -> 1.5.0.4, releasetest, full - PASS
      • 1.5 -> 1.5.0.4, releasetest, partial - PASS
    • Marcia (UB on Intel)
      • 1.5.0.3 -> 1.5.0.4, betatest, partial - PASS
    • Marcia (PPC on PPC)
      • 1.5. -> 1.5.0.4, releasetest, partial - PASS
  • 7. it
    • 1.5.0.3 -> Mozilla/5.0 (Windows; U; Windows NT 5.1; it; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4 (full) (betatest) - PASS - (tracy)
    • Jay (Linux)
      • 1.5.0.3 -> 1.5.0.4, releasetest, partial - PASS
    • Juan (PPC-UB on Intel Mac)
      • 1.5.0.3 -> 1.5.0.4, releasetest, partial, full - PASS
    • Marcia (UB on Intel)
      • 1.5.0.3 -> 1.5.0.4, releasetest, partial - PASS
    • Marcia (PPC on PPC)
      • 1.5. -> 1.5.0.4, releasetest, partial - PASS
  • 8. ja win32 linux
    • 1.5.0.3 -> Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4 (full) (releasetest) - PASS - (tracy)
    • 1.5.0.1 -> Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4 (betatest) - PASS - (tracy)
    • Jay (Linux)
      • 1.5.0.3 -> 1.5.0.4, betatest, partial - PASS
      • 1.5.0.3 -> 1.5.0.4, releasetest, full - PASS
      • 1.5.0 -> 1.5.0.4, releasetest, full - PASS
      • 1.5.0.2 -> 1.5.0.4, betatest, partial - PASS
      • 1.5.0.1 -> 1.5.0.4, releasetest, partial -
  • 9. ja-JP-mac osx osxppc
    • Juan (PPC-UB on Intel Mac)
      • 1.5.0.3 -> 1.5.0.4, betatest, partial, full - PASS
    • Marcia (UB on Intel Mac)
      • 1.5.0.3 -> 1.5.0.4, betatest, partial - PASS
  • 10. nl
    • 1.5.0.3 -> Mozilla/5.0 (Windows; U; Windows NT 5.1; nl; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4 (partial) (releasetest) - PASS - (tracy)
    • Jay (Linux)
      • 1.5.0.3 -> 1.5.0.4, betatest, partial - PASS
      • 1.5.0.3 -> 1.5.0.4, releasetest, full - PASS
    • Juan (PPC-UB on Intel Mac)
      • 1.5.0.3 -> 1.5.0.4, releasetest, partial, full - PASS
    • Marcia (UB on Intel Mac)
      • 1.5.0.3 -> 1.5.0.4, betatest, partial - PASS
    • Marcia (PPC on PPC)
      • 1.5. -> 1.5.0.4, releasetest, partial - PASS
  • 11. pl
    • 1.5.0.3 -> Mozilla/5.0 (Windows; U; Windows NT 5.1; pl; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4 (partial) (betatest) - PASS - (tracy)
    • Jay (Linux)
      • 1.5.0.3 -> 1.5.0.4, releasetest, partial - PASS
      • 1.5.0 -> 1.5.0.4, releasetest, partial -
    • Juan (PPC-UB on Intel Mac)
      • 1.5.0.3 -> 1.5.0.4, releasetest, partial, full - PASS
    • Marcia (UB on Intel Mac)
      • 1.5.0.3 -> 1.5.0.4, betatest, full - PASS
  • 12. zh-CN
    • 1.5.0.3 -> Mozilla/5.0 (Windows; U; Windows NT 5.1; zh-CN; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4 (full) (releasetest) - PASS - (tracy)
    • Jay (Linux)
      • 1.5.0.3 -> 1.5.0.4, betatest, partial - PASS
      • 1.5.0 -> 1.5.0.4, releasetest, partial - PASS
    • Juan (PPC-UB on Intel Mac)
      • 1.5.0.3 -> 1.5.0.4, betatest, partial, full - PASS
    • Marcia (UB on Intel Mac)
      • 1.5.0.3 -> 1.5.0.4, betatest, partial - PASS
  • 13. zh-TW
    • 1.5.0.3 -> Mozilla/5.0 (Windows; U; Windows NT 5.1; zh-TW; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4 (full) (betatest) - PASS - (tracy)
    • 1.5.0.2 -> Mozilla/5.0 (Windows; U; Windows NT 5.1; zh-TW; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4 (releasetest) - PASS - (tracy)
    • Jay (Linux)
      • 1.5.0.3 -> 1.5.0.4, releasetest, partial - PASS
    • Juan (PPC-UB on Intel Mac)
      • 1.5.0.3 -> 1.5.0.4, betatest, partial, full - PASS
      • 1.5.0.2 -> 1.5.0.4, betatest, partial - PASS
    • Marcia (UB on Intel Mac)
      • 1.5.0.3 -> 1.5.0.4, releasetest, partial - PASS


Thunderbird Update Testing

  • Test the following scenarios on Windows: ==
    • Tbird 1.5.0.2 -> Tbird 1.5.0.4 (partial and full)
    • Tbird 1.5.0 - Tbird 1.5.0.4
    • Tracy (1-4 on list), Juan (5-8), Jay (9-12)

Priority 1 (P1):

  • 1. da:
    • (win) 1.5.0.2 -> 1.5.0.4, betatest, partial = PASS (build id = 2006051612)
    • (win) 1.5.0.2 -> 1.5.0.4, betatest, full = PASS (build id = 2006051612)
  • 2. de:
    • (win) 1.5.0.2 -> 1.5.0.4, releasetest, partial = PASS (build id = 2006051612)
    • (win) 1.5.0.2 -> 1.5.0.4, betatest, full = PASS (build id = 2006051612)
    • (macppc) 1.5.0.2 -> 1.5.0.4, releasetest, full = PASS (build id = 2006053016)
  • 3. en-US:
    • (win) 1.5.0.2 -> 1.5.0.4, betatest, partial = PASS (build id = 2006051612)
    • (win) 1.5.0.2 -> 1.5.0.4, releasetest, full = PASS (build id = 2006051612)
    • (macppc) 1.5.0.2 -> 1.5.0.4, releasetest, partial = PASS (build id = 2006053016)
  • 4. es-ES:
    • (win) 1.5.0.2 -> 1.5.0.4, releasetest, partial = PASS (build id = 2006051612)
    • (win) 1.5.0.2 -> 1.5.0.4, releasetest, full = PASS (build id = 2006051612)
  • 5. fi
    • (win) 1.5.0.2->1.5.0.4, releasetest, partial = PASS (build id = 2006051612)
    • (win) 1.5.0.2->1.5.0.4, betatest, full = PASS (build id = 2006051612)
    • (intelmac-ppc build) 1.5.0.2->1.5.0.4, releasetest, partial = PASS (build id = 2006053016)
  • 6. fr
    • (win) 1.5.0.2->1.5.0.4, betatest, partial = PASS (build id = 2006051612)
    • (win) 1.5.0.2->1.5.0.4, releasetest, full = PASS (build id = 2006051612)
    • (intelmac-ppc build) 1.5.0.2->1.5.0.4, releasetest, partial = PASS (build id = 2006053016)
  • 7. it
    • (win) 1.5.0.2->1.5.0.4, releastest, partial = PASS (build id = 2006051612)
    • (win) 1.5.0.2->1.5.0.4, betatest, full = PASS (build id = 2006051612)
    • (intelmac-ppc build) 1.5.0.2->1.5.0.4, releasetest, partial = PASS (build id = 2006053016)
  • 8. ja
    • (win) 1.5.0.2->1.5.0.4, betatest, partial = PASS (build id = 2006051612)
    • (win) 1.5.0.2->1.5.0.4, releasetest, full = PASS (build id = 2006051612)
    • (macppc: ja-JP-mac) 1.5.0.2 -> 1.5.0.4, betatest, partial = PASS (build id = 2006053016)
  • 9. nl
    • (win) 1.5.0.2->1.5.0.4, releasetest, partial = PASS (build id = 2006051612)
    • (win) 1.5.0.2->1.5.0.4, releasetest, full = PASS (build id = 2006051612)
  • 10. pl
    • (win) 1.5.0.2->1.5.0.4, betatest, partial = PASS (build id = 2006051612)
    • (macppc) 1.5.0.2 -> 1.5.0.4, betatest, full = PASS (build id = 2006053016)
  • 11. zh-CN
    • (win) 1.5.0.2->1.5.0.4, releasetest, partial = PASS (build id = 2006051612)
  • 12. zh-TW

Spot Check the remaining locales on any platform and paths of your choosing:

    • bc, davel, coop, timr

Priority 2 (P2):

  • 14. ar
    • 1.5.0.3->1.5.0.4 releasetest, full|partial winxp (showed 1.5 in add/remove) PASS /bc
    • 1.5.0.3->1.5.0.4 bc macppc
  • 15. cs
    • 1.5.0.3->1.5.0.4 releasetest, full|partial winxp (showed 1.5.0.4 in add/remove) PASS /bc
    • 1.5.0.3->1.5.0.4 bc macppc
  • 16. es-AR
    • (macppc) 1.5.0.2->1.5.0.4, releasetest, partial = PASS (build id = 2006053016) coop
  • 17. he
    • (macppc) 1.5.0.2->1.5.0.4, releasetest, partial = PASS (build id = 2006053016) coop
  • 18. ko
    • (macppc) 1.5.0.2->1.5.0.4, releasetest, partial = PASS (build id = 2006053016) coop
  • 19. nb-NO
    • (macppc) 1.5.0.2->1.5.0.4, releasetest, partial = PASS (build id = 2006053016) coop
  • 20. sl
    • (macppc) 1.5.0.2->1.5.0.4, releasetest, partial = PASS (build id = 2006053016) coop
  • 21. sv-SE
    • (macppc) 1.5.0.2->1.5.0.4, releasetest, partial = PASS (build id = 2006053016) coop

Priority 3 (P3):

  • 22. pt-BR
    • 1.5.0.3->1.5.0.4 releasetest, full|partial winxp (showed 1.5.0.4 in add/remove) PASS /bc
    • 1.5.0.3->1.5.0.4 bc macppc
  • 23. ru
  • 24. sk

Unclassified (P?):

  • 25. bg
    • 1.5.0.3->1.5.0.4 releasetest, full|partial winxp (showed 1.5.0.4 in add/remove) PASS /bc
    • 1.5.0.3->1.5.0.4 releasetest bc/macppc
  • 26. ca
    • 1.5.0.3->1.5.0.4 releasetest, full|partial winxp (showed 1.5.0.4 in add/remove) PASS /bc
    • 1.5.0.3->1.5.0.4 releasetest bc/macppc
  • 27. el
    • 1.5.0.3->1.5.0.4 releasetest, full|partial winxp (showed 1.5.0.4 in add/remove) PASS /bc
    • 1.5.0.3->1.5.0.4 releasetest bc/macppc
  • 28. en-GB
    • 1.5.0.3->1.5.0.4 releasetest, full|partial winxp (showed 1.5.0.4 in add/remove) PASS /bc
    • 1.5.0.3->1.5.0.4 releasetest bc/macppc
  • 29. eu
  • 30. ga-IE
  • 31. gu-IN win32 linux
  • 32. hu
  • 33. lt
  • 34. mk
  • 35. pa-IN win32 linux
  • 36. ro
  • 37. tr

Live Update Testing

Just run a spot check on a few locales from your original assignments

Firefox :

  • Tracy
    • 1.5.0.3 -> 1.5.0.4, Partial, en-US - PASS
    • 1.5.0.3 -> 1.5.0.4, Partial, zh-CN - PASS
    • 1.5.0.3 -> 1.5.0.4, Full, it - PASS
    • 1.5.0.3 -> 1.5.0.4, Full, nl - PASS
  • Marcia
  • Juan
    • 1.5 - 1.5.0.4, ja-jp, mac, full, PASS (2006053016)
    • 1.5.0.2 - 1.5.0.4, en-US, mac, partial, full, PASS

Thunderbird:

  • Tracy
    • 1.5.0.2 -> 1.5.0.4, Partial, en-US - PASS
    • 1.5.0.2 -> 1.5.0.4, Fulll, de - PASS
  • Marcia
  • Juan
    • 1.5 - 1.5.0.4, it, mac, full, PASS (2006050817)
    • 1.5.0.1 - 1.5.0.4, ES-ES, mac, full, PASS
    • 1.5.0.2 - 1.5.0.4, ko, mac, full, PASS
    • 1.5.0.4 uninstall survey, en-US, WinXP, PASS
Retrieved from "https://wiki.mozilla.org/index.php?title=Firefox:1.5.0.4:Test_Plan:Software_Update&oldid=27087"