Mozilla QA Community:Software Update

From MozillaWiki
Jump to: navigation, search


Software Update Testing

Before You Begin... READ THE FAQ!

How To Test

Downloads

To download the nightly builds for testing:

Or see this directory for the previous days' builds.

Run Test Cases

  1. Run the set of test cases that pertains to the feature we are testing. The test cases for Software Update are listed below.

For Failures, Post Feedback in the Mozilla QA Blog

  1. If you find test cases that fail, post your results to the Mozilla QA Blog with details about the problem. Make sure to include the following information:
    • Test(s) that failed (test group/case ID)
    • Observed behavior
    • OS/Platform information
  2. If test cases fail, make sure to reference the list of existing bugs in the FAQ or check Bugzilla for known bugs in this area. If new bugs surface, we will make sure to add them to the FAQ.
  3. Check the blog posts to see if others are experiencing the same behavior or if a newly opened bug has been created. If there is a need for a new bug to be logged, log the bug in Bugzilla.

Test Cases

I. Positive Tests

A. Software Update: Update Available/Later

Steps:

  1. Download and launch the previous day’s nightly build
  2. Go to Help | Check for Updates


Expected:


B. Software Update: Update Available/Show Extension List

Steps:

  1. Download and launch the previous day’s nightly build
  2. Go to Help | Check for Updates


Expected:


C. Software Update: Update Available/Download and Install Update/Later

Steps:

  1. Download and launch the previous day’s nightly build
  2. Go to Help | Check for Updates



Expected:


D. Software Update: Update Available/Pausing an update

Steps:

  1. Download and launch the previous day’s nightly build
  2. Go to Help | Check for Updates


Expected:


E. Software Update: Update Available/Closing an update

Steps:

  1. Download and launch the previous day’s nightly build
  2. Go to Help | Check for Updates


Expected:


F. Software Update: Update Available/Clicking the Details button

Steps:

  1. Download and launch the previous day’s nightly build
  2. Go to Help | Check for Updates


Expected: An empty window will open. Full functionality will be available in Deer Park 1.5 beta 1.

G. Software Update: No updates found (this test should be performed after you have performed a successful software update)

Steps:

  1. Go to Help | Check for Updates
  2. The Software Update dialog should launch.

Expected:


II. Negative Tests

A. Software Update with nonexistant update URL

Steps:

  1. Using about:config, set app.update.url to "http://www.mozilla.org/nonexistantupdate.html"
  2. Select Help->Check for Updates

Expected: The error "AUS: Update XML File Not Found (404)"

B. Manual updating option

Steps:

  1. Using about:config, set app.update.url to "http://www.mozilla.org/nonexistantupdate.html" (simulating an AUS failure)
  2. Select Help->Check for Updates
  3. Click the link to update your software manually.

Expected: A new browser window should open with a page providing various download links to update Firefox. The Software Update window should remain open behind the new window.

C. Software Update with malformed/broken update file

This may happen when using a zip installtion rather than the installer. The original string may have refrences to install products based on the version, build, platform and channel. The orignal string may look like this: https://aus2.mozilla.org/update/1/%PRODUCT%/%VERSION%/%BUILD_ID%/%BUILD_TARGET%/%LOCALE%/%CHANNEL%/update.xml

Steps:

  1. Using about:config, set app.update.url to "http://www.mozilla.org/index.html"
  2. Select Help->Check for Updates

Expected: The error "AUS: Update XML File Malformed (200)"

D. Trying to update when no updates are available

Steps:

  1. Download and launch the most recent nightly build
  2. Select Help->Check for Updates

Expected: The "checking for updates" panel should display for a moment, during which the progress indicator will spin to indicate progress. Update will then report that no updates were found.

E. Keyboard navigation in the Software Update Window

Steps:

  1. Download and launch an old nightly build
  2. Select Help->Check for Updates
  3. Click the "more general information" link.
  4. Close the new window.
  5. With focus given to the Software Update window, press the tab key twice to give focus to the "Later" button.
  6. Press return

Expected: After step 3, a notice that an update is available. This notice should not describe the update as an "important Security Update" unless there is fact an important security update. After step 4, a new browser window should open providing some sort of information. The Software Update window should remain open behind the new window. After step 7, the Software Update window should close and no update should occur.

F. Putting the machine to sleep during update download

Steps:

  1. Download and launch an old nightly build.
  2. Select Help->Check for Updates.
  3. Press the "Download and Install" button.
  4. While the download is in progress, put your machine to sleep, suspend, or hybernate mode. Depending on your machine and the size of the update, this may not be possible.
  5. A moment later, wake the machine.
  6. Allow the download to complete and switch to a new build and profile.

Expected: A short while after step 6, the download should automatically resume with no action taken by the user.

G. Network interruption during update download

Steps:

  1. Download and launch an old nightly build
  2. Select Help->Check for Updates.
  3. Press the "Download and Install" button.
  4. While the download is in progress, physically disconnect your network access, disable your wireless card, or otherwise remove your machine from the network.
  5. Wait a while, and then reconnect your network access.

Expected: After step 5, the progress bar should stop and the text should indicate that the download is progressing at 0 KB/sec. A short while after step 6, the download should automatically resume with no action taken by the user.

H. Software Update: "Restart Later"

Steps:

  1. Download and launch an old nightly build.
  2. Select Help->Check for Updates.
  3. Press the "Download and Install" button.
  4. Allow the download to complete.
  5. Press "Later."
  6. Press OK to the will install on restart dialog.
  7. Open the Help menu.
  8. Select the update option in the Help menu.

Expected: After step 7, the Software Update window should close and the browser should remain and function as normal. After step 8, the update menu item should not indicate that a download is in progress or that there is a download to resume After step 9, the Software Update window should indicate that an update is awaiting installation and a restart is required. It should not attempt to redownload the update or connect to the update server.

I. Pause and close Software Update with background downloading

Steps:

  1. Download and launch an old nightly build.
  2. Select Help->Check for Updates.
  3. Press the "Download and Install" button.
  4. While the download is in progress, press the "Pause" button
  5. Press the "Hide" button
  6. Choose Yes to allow the download to continue in the background.
  7. Select Help->Downloading Firefox.

Expected: The Software Update window should give an indication of the update progress. It should not attempt to start the download over again or connect to the update server.

J. Pause and close Software Update without background downloading

Steps:

  1. Download and launch an old nightly build.
  2. Select Help->Check for Updates.
  3. Press the "Download and Install" button.
  4. While the download is in progress, press the "pause" button
  5. Press the close button
  6. Choose no to keep the download paused.
  7. Select Help->Resume Downloading Firefox.

Expected: The Software Update window should reopen and the download should continue from where it left off. It should not attempt to check for updates again or start the download from the begining.

K. Interrupt installation of update: force quit

Steps:

  1. Download and launch an old nightly build.
  2. Select Help->Check for Updates.
  3. Press the "Download and Install" button.
  4. Press "restart"
  5. After the browser has restarted and while the installation is in progress, force quit the updater application.
  6. Launch the Firefox Browser

Expected: The updater should resume or restart the update process and the application should be left in a usuable (updated) state.

L. Software Update behind a proxy

Steps:

  1. Download and launch an old nightly build.
  2. Configure the product to connect to websites through a proxy server that requires authentication 3. Select Help->Check for Updates.

Expected: A username/password dialog should open to request authentication information for the proxy. After this is completed, Software Update should check for updates. It should not try to check for updates before authentication is complete.

III. Software Update Preferences

A. Automatically check for Firefox updates

Steps:

  1. Navigate to Tools | Options | Advanced. For Mac, Go to Preferences | Advanced. Click on the Update tab.
  2. Check the preference to automatically check for updates to Firefox

Expected: Confirm that Firefox automatically checks for updates without having to highlight the "check for updates" in the file menu or without selecting the "check now" button.

B. Automatically check for Firefox updates/Automatically Download and install the update

Steps:

  1. Navigate to Tools | Options | Advanced. For Mac, Go to Preferences | Advanced. Click on the Update tab.
  2. Check the preference to automatically check for updates to Firefox
  3. Check the radio button that says "Automatically download and install the update"

Expected: Confirm that Firefox automatically downloads and installs the update. With this radio button enabled, Firefox should not throw up any kind of dialog that asks you if you want to install the update, it should just be done automatically. You will receive notification when the download is complete which asks you whether you want to install now or later.

C. Automatically check for Firefox updates/Ask me what I want to do

Steps:

  1. Navigate to Tools | Options | Advanced. For Mac, Go to Preferences | Advanced.Click on the Update tab.
  2. Check the preference to automatically check for updates to Firefox
  3. Check the radio button that says "Ask me what I want to do"

Expected: Confirm that Firefox throws up a dialog asking you what you want to do when an update is found.

D. Automatically check for Firefox updates/Warn me if this disable extensions and themes

Steps:

  1. Navigate to Tools | Options | Advanced. For Mac, Go to Preferences | Advanced. Click on the Update tab.
  2. Check the preference to automatically check for updates to Firefox
  3. Click on the radio button that says "Automatically download and install the update."
  4. Check the box that says "Warn me if this will disable extensions and themes"

Expected: Confirm that when Firefox automatically checks for updates that it throws up a warning dialog which informs ou whether this will disable your extensions and themes.

E. Automatically check for Updates to Firefox/Uncheck the box

Steps:

  1. Navigate to Tools | Options | Advanced. For Mac, Go to Preferences | Advanced. Click on the Update tab.
  2. Uncheck the preference to automatically check for updates to Firefox

Expected: Confirm that all of the items under "When updates to Deer Park are found" are grayed out and not able to be selected.

F. Show Update History (This test assumes you have already performed one or more updates)

Steps:

  1. Navigate to Tools | Options | Advanced. For Mac, Go to Preferences | Advanced. Click on the Update tab.
  2. Click on the "Show Update History" button

Expected: Confirm that Firefox displays information relating to the updates you have performed, whether successfully or unsuccessfully.

G. Check Now for Firefox Updates

Steps:

  1. Navigate to Tools | Options | Advanced. For Mac, Go to Preferences | Advanced. Click on the Update tab.
  2. Click the box that says "Check Now" button which is next to Firefox.

Expected: Confirm that after clicking "Check Now" that Firefox immediately initiates a check for updates. You should receive a confirmation if updates are available, or a "No Updates are found" if there are no updates available.

Advanced Tests