Overview

Release Candidate builds for Alpha, Beta and ... provided by builders must be tested by volunteers and QA according to a rigorous process in order to certify that the release candidate build is worthy for public release.

We have just a few days to complete this important testing, so we need all available hands. Thank you for your interest, and if circumstances allow, your enthusiastic participation. As always, help is available ...

Several types of tests are listed below:

BFT (Basic Functionality Tests) is our most extensive test - using litmus testing tool. If you do not have time to do BFT tests we hope that you will ...
Smoketest (reduced litmus test set), or
Spot check - a visual "look see"
l10n (localization) - If you normally run or are familiar with a localized version of Thunderbird, we would appreciate you doing your testing using a locale build.

All of these test types are described below after the BFT description.

If you unable to help before the testing period finishes, please visit and run the tests as soon as you are able.

Details

Thank you for enthusiastically volunteering to participate.

Important

Make sure you are using only the builds specified in THIS message
Please file a bug whenever you encounter a problem.
When using litmus, if a testcase:
- Fails - please comment in the test, file a bug, and leave the URL of the testcase in the bug
- is unclear - please comment with steps that would make it more clear
- is not run, i.e. you skipped it - please do not mark it in any way with a comment, nor mark it passing or failed.

http://wiki.mozilla.org/QA/Thunderbird3/TestResults/Alpha2 documents the full QA process. Please take note of the release notes section. Testers will want to check sections 1.1 to 1.6. Contact methods are listed. If they don't work and you need help please email me.

Builds

Builds to be tested (do not use nightly) - <update for 3.0a3> http://ftp.mozilla.org/pub/mozilla.org/thunderbird/nightly/3.0a2-candidates/build1/ - pick localized version if possible.

BFT - Basic Functionality Tests

A BFT is a list of tests organized into subgroups. Unless you have 4-6 hours to test, to shorten your testing time you will want to focus by subgroups as follows:

* indicates priority items - scan the list and if you have the resource required please do these before do other groups
ALL indicates items we hope everyone will test
AL and MZ - please run that test group if your last name is within the range A-to-L or M-to-Z

If you start running out of time, or you get done with the assigned subgroups, please choose subgroups that show the least amount of testing coverage as shown on the "Select Subgroup" list.

Getting started:

login to litmus.mozilla.org (create an account if you don't have one)
visit https://litmus.mozilla.org/run_tests.cgi?test_run_id=29
complete all the information about your setup - paste buildid, set platform, OS, and locale
click "submit configuration"
And you're off and running the tests!
Please attempt * items first

Subgroup assignments for BFTs

  ALL-Install, shutdown, uninstall
   MZ-Migration (from other mail systems)
   MZ-Import (from other mail systems)
   MZ-Window configuration
  ALL-Toolbars and menus
  ALL-Account settings & Preferences (Options)
   *  IMAP accounts
   *  POP accounts (exclude Global Inbox)
   *  Global inbox
  ALL-Mail composition
   MZ-Spell checker
   MZ-RSS account & subscriptions
   MZ-Newsgroups
  ALL-Navigating and displaying messages
   AL-Downloading and saving
   AL-Image blocking
   AL-Return receipts
   *  Proxies
   MZ-Offline, disk space
  ALL-Moving, copying, deleting messages
  ALL-Views and labeling messages
   MZ-Message filters
   MZ-Message search
   AL-Address search
   AL-Saved Search folders
   AL-Message Grouping
  ALL-Message Aging
  ALL-Quicksearch
   MZ-Address books
   MZ-Junk mail
   MZ-Extensions
   AL-Theme management
   AL-Help
   AL-Printing
   AL-Master Passwords & password management
   *  Phishing, spoof detection
   *  Secure connections
   *  Digital signing, encrypting messages
   MZ-Software Update

smoketest

Access litmus using the procedure above for BFT, but use the smoketest URL: https://litmus.mozilla.org/run_tests.cgi?test_run_id=28

locale

Verify build is usable and update the wiki at http://wiki.mozilla.org/Thunderbird3/TestResults/Alpha2/L10N

In addition to running locale specific tests, if possible please run BFT or smoketest using the locale.

Spot checks

Spot checks take the least amount of time because they are are casual visual inspection and do not require the use of litmus. Visit http://wiki.mozilla.org/QA/Thunderbird3/TestResults/Alpha2#Thunderbird_Spot_Check and update the wiki

User:Wsmwk/MilestoneTesting

Contents