De-support Hotfix Testing

Known issues: https://etherpad.mozilla.org/arC2CZqj6y

Timeline

Targeting QA testing and sign-off on April 19, 2012

Focus Areas

1. The hotfix is only downloaded on Windows
2. The hotfix is installed automatically on Windows 2000 and Windows XP <SP2, and is uninstalled automatically when we're not on those versions of Windows
3. the proper localization comes up in the billboard, depending on the version of Firefox
4. when we set the clock forward (10 days), the user is re-prompted again at startup

Instructions to test a hotfix

Installing Hotfix

• Start Firefox with a new profile
• In about:config set the following prefs:
  • make sure extensions.hotfix.id is set to firefox-hotfix@mozilla.org (should be by default)
  • set extensions.update.interval to 10
  • In the pref extensions.update.background.url (extensions.update.url for Firefox < 13) replace versioncheck.addons.mozilla.org from the string with addons-dev.allizom.org (only do this when testing the staged add-on)
• Restart Firefox
• Open the add-ons manager
• Wait for Addon Hotfix to appear. To know if it was installed and subsequently uninstalled, check that the pref extensions.hotfix.lastVersion matches the expected hotfix version.
• If that doesn't work, set extensions.logging.enabled to true and check the error console output.

Staging Server Tests

• WHAT: Testing with latest Firefox Beta on the staging server
• WHEN: April 19, 2012

Test #1: Hotfix only downloads on Windows

For this test we need to make sure that the hotfix is only downloaded on Windows platforms.

Test #2: Hotfix uninstalled if Windows XP SP2 or newer

For this test we need to make sure that the hotfix automatically removed for users running Windows XP SP2 or later. To verify removal, check extensions.hotfix.lastVersion, it should be 20120419.01, with the add-on itself uninstalled.

Test #3: Billboard Prompting

For this test we need to make sure the billboard only appears on Windows <= XP SP1

Test #4: Billboard Localization

For this test we need to make sure that the billboard is properly localized and is appropriate for the Windows version.

Windows 2000 (tester - Tracy)

Expected first bullet in the en-US billboard: "Upgrading your operating system". "Learn More" links to Windows 2000 page on SUMO.

• en-US: Pass
• de: Pass note: SUMO page is not fully localized.
• pt-BR: Pass note: SUMO page is not fully localized.

Windows XP (tester - Tracy)

Expected first bullet in the en-US billboard: "Installing a free upgrade to your operating system". "Learn More" links to Windows XP page on SUMO.

• en-US: Pass
• fr: Pass note: SUMO page is not fully localized.

Test #5: Billboard Re-prompting

For this test we need to make sure the billboard reprompts when the clock is moved forward.

1. Install Firefox 12 Beta
2. Get the hotfix to install
3. Wait for the billboard to prompt and dismiss it
4. Set your system clock forward 10 days
5. Restart Firefox and verify the billboard prompts again

Windows 2000 (tester - Tracy)

Test #6: Spotcheck Updating Operating System

For this test we need to make sure updating to a supported OS works as expected.

• Start with Firefox 12 Beta on Windows XP SP1
• Verify the hotfix gets installed (pass)
• Verify the billboard appears (pass)
• Update to SP2 or newer (used registry hack from http://www.autoitscript.com/forum/topic/22689-osservicepack/page__p__230693#entry230693)
• Verify the hotfix gets removed (pass)
• Verify the billboard does not re-prompt (pass)
• RESULT: Pass (tracy)

Beta Push (Apr 19th, 2012)

• Firefox 10: no hotfix or billboard on any platform
• Firefox 11: no hotfix or billboard on any platform
• Firefox 12: hotfix and billboard ONLY on Windows 2000, XP, XP SP1
• Billboard should be localized

Release Push (Apr 25, 2012)

• Windows 2000:
  • Firefox 10 en-US: PASS - hotfix installed (ashughes)
  • Firefox 10 es-ES: PASS - hotfix installed (ashughes)
  • Firefox 12 en-US: PASS - hotfix installed (ashughes)
  • Firefox 12 de: PASS - hotfix installed (ashughes)

• Windows XP SP2:
  • Firefox 12 en-US: PASS - hotfix installed and disabled, removed on restart (ashughes)
  • Firefox 12 pt-BR: PASS - hotfix installed and disabled, removed on restart (ashughes)