Beta2 Software Update Testing Results

Windows en-US [marcia]

• partial betatest Alpha1 -> Beta2 - 'PASS'
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2

WinXP en-US [timr]

• A1 -> B2 full - Pass
• A2 -> B2 full - Pass
• A3 -> B2 Full - Pass
• B1 -> B2 Partial - Pass
  • forgot to grab the version string

PPC Mac en-US [marcia] Note there were two builds offered for Alpha1

• full betatest Alpha1 -> Beta2 - 'PASS for UB only'
• Downloaded UB Build, PPC Build did not update
• full betatest using UB Build Alpha1 -> Beta2 - FAIL
  • Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2

PPC Mac en-US [timr]

• B1 -> B2 partial - pass
• B1 -> B2 partial later - pass
• B1 -> B2 partial failover to full - Pass
  • forgot to grab the version string

PPC Mac L10n [timr]

• B1 (fr) -> B2 partial - pass
• B1 (de) -> B2 partial later - pass
• B1 (en-GB) -> B2 partial failover to full - Pass
  • Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-GB; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2

Intel mac en-US [marcia]

• partial, betatest 2.0a2 -> 2.0b2 - PASS
• failover to full, betatest, 2.0a2 -> 2.0b2 - PASS
  • Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2

Intelmac en-US [juanb]

• partial, betatest 2.0b1 -> 2.0b2 - PASS
• failover to full, betatest 2.0b1 -> 2.0b2 - PASS
• failed failover-to-full, betatest 2.0b1 -> 2.0b2 - FAIL (bug 350804)
  • Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2

Intel Mac fr [jay]

• partial, betatest 2.0.b1 -> 2.0b2 - PASS
  • Mozilla/5.0 (Macintosh; U; Intel Mac OS X; fr; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2

Ubuntu Linux en-US [jay]

• partial, betatest 2.0a1 -> 2.0.b2 - PASS
  • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2

Fedora Core Linux en-US [rob/marcia]

• partial, betatest 2.0b1 -> 2.0.b2 - PASS
  • also tested failing partial and ensuring it got full - PASS
  • B

Notes and Issues Encountered

Windows

• On Windows I saw the following things, but could not reproduce reliably:

• • Downloaded the update, installed it. Then went back to Check for Updates manually and Firefox was not hip with the fact I already had the update.

• • Several times I downloaded updates, then clicked later and exited the browser. Upon restart the first time Firefox did not apply the downloaded update.

• • On two instances when the updater was running I saw the talkback screen flash in the status bar, then it went away. At first I thought I crashed, but it was just the screen flashing.

Mac

• https://bugzilla.mozilla.org/show_bug.cgi?id=350802 - Bon Echo icon hangs around after update from Alpha1
• https://bugzilla.mozilla.org/show_bug.cgi?id=350804 - Unable to restart a full update after failing the update
• https://bugzilla.mozilla.org/show_bug.cgi?id=350920 - update doesn't start downloading in the background
  • turns out to be a non-bug: It was explained to me that the file will start downloading in the background at a very slow rate (intended), so that the progress will be noted in the size of the update.mar file for that update.
• https://bugzilla.mozilla.org/show_bug.cgi?id=350938 - updater does not resume update process when you force quit it (test case 2445)
• https://bugzilla.mozilla.org/show_bug.cgi?id=351046 - software update does not resume where it left off after computer shutdown (test case 2463)

Other Scenarios or Testing Completed

• Intelmac en-US [juanb]
  • Tried applying updates "Later" after download for both partial and failover, and both were applied upon relaunch.
• Litmus Software Update test suite completed on Intel Mac [juanb]
  • [Results]
  • As part of the test suite I also ran some tests on extension/theme compatibility and these behaved as expected.