Mozilla QA Community:Thunderbird1.5.0.7 Community Test Day

From MozillaWiki
Jump to: navigation, search

Welcome to the Thunderbird Community Test Day!

Thank you for participating in this test day. The success of Firefox and Thunderbird is heavily dependent on community members like you. We appreciate your support!

When you are done, please send feedback to testday@mozilla.org or post significant findings to the Mozilla QA blog (http://weblogs.mozillazine.org/qa/). We are very interested to hear about how the test day went, any overall thoughts about Thunderbird, and roll up of issues found and bugs filed.

The official time for the test day is Friday, September 8, 2006, from 7am - 5pm PDT, but anyone can jump on Litmus at any time on any day!

For more information about this release, please check out the [Thunderbird2 wiki]. You will find the current schedule, test plan, and specific areas we can use help testing.

FAQ

Where do I start?

Other Options of if you don't use IRC:

  • Use Instant Messenger - http://www.aim.com/. A moderator will be online under the screen name "MozillaTestDay". Please send your screenname to marcia@mozilla.org before the test day so you can be invited to the chatroom, or just message "MozillaTestDay" during the day to figure out what to do.

OK, I am in the channel, now what?

Let the moderators know if you have any questions or encounter any problems. If you are not familiar with our bugzilla bug tracking system, feel free to report your problems to a moderator and they can log any bugs for you.

What build should I test?

We will be testing the Thunderbird 1.5.0.7 and Thunderbird 2 Beta 1 candidate builds:

Thunderbird 1.5.0.7: Please use the latest RC5 candidate: ftp://ftp.mozilla.org/pub/mozilla.org/thunderbird/nightly/1.5.0.7-candidates/rc5

Thunderbird 2 nightly (Beta 1 candidate)

ftp://ftp.mozilla.org/pub/mozilla.org/thunderbird/nightly/latest-mozilla1.8

What specifically will we be testing?

For Thunderbird 2 beta 1 candidate:

  • 1) UI nits with the theme refresh for Windows and Linux
  • 2) Feedback on Move Again / copy again. See the Messages menu.
  • 3) Feedback on Copy To / Recent --> recent folders and Move To / Recent --> recent folders
  • 4) anything with tagging
  • 5) folder views

For Thunderbird 1.5.0.7

  • General Usage, make sure there are no regressions from previous release
  • Making sure Enignmail Extension works
  • Making sure that signing your email works as expected
  • Making sure reading signed email works as expected
  • Testing saved passwords for your accounts

Known Bugs

Testing Instructions

  • Download the Thunderbird builds noted above
  • Get an email signing and encryption certificate. [Thawte] provides free email certificates.
  • Run any one of the tests in Litmus: Daily smoketest, Basic Functional, or Fun smoketest. We are also very interested in sending signed and encrypted messages to test the SMIME implementation.
  • if you need a test account to send test mail messages to, feel free to use test1@mozilla.com
  • Areas to Test around (coming soon)

Some other ways you can help:

  • Think of some test cases that aren't already included in Litmus (we love suggestions
  • Thunderbird needs new test cases for many of the 2.0 features. We could use your help creating test cases. Please email marcia@mozilla.org if you want to be involved in this effort.

Where do I find Litmus?

  • Go to the Litmus start page.
  • Log in or create an account if you don't already have one and then select run tests.
  • Enter the appropriate information and click Submit.
  • Choose a test group and then a subgroup and then click Submit to start testing!

Tips:

  • Make sure you enter the correct information for your platform, version of Thunderbird, etc.
  • Feel free to ask on IRC or AIM if you need help or have any questions.

Who will be moderating the #testday channel?

The moderator's nicks for this test day will be:

  • tracy
  • bc
  • marcia
  • coop
  • alice
  • mw22
  • timr

How do I file bugs?

First of all, let one of the moderators know so they can check if it is already a known problem. Then they can guide you to either provide more details, update an existing bug or file a new bug.

If filing a new bug, please do a quick check to see if the bug already exists. This can easily be done by searching for the error message, window name, or some over identifing feature of the bug.

In the case of any testing endeavor, it is important to include the list of extensions that you have installed since they can often cause strange issues to crop up.

How do I send feedback?

Please use the testday@mozilla.org to send feedback about how the testday went, any overall thoughts about Thunderbird, and roll up of issues found and bugs filed. We really appreciate your help today and your feedback is very valuable.

Rewards for this Test Day

The top 5 testers who have not previously won $25 gift certificates or store credit for Community Day testing will be rewarded for this test day. If you reside outside of the U.S, you will be awarded a $25 gift certificate to the Mozilla Store.

Results

Total Test Results By Locale

Locale # Results
de 19
en-US 83
lt 10

Total Test Results By Platform

Platform # Results
Windows 92
Linux 10
Mac (Intel) 10

Total Test Results By Result Status

Result Status # Results
Pass 110
Test unclear/broken 2

Total Test Results By Subgroup

Subgroup # Results # Testcases in Subgroup
Firefox:Localization (l10n):Localization (l10n) 15 15
Thunderbird:1.5 Basic Functional Tests (BFTs):Migration 1 1
Thunderbird:1.5 Basic Functional Tests (BFTs):Toolbars and menus 1 1
Thunderbird:1.5 Basic Functional Tests (BFTs):Account settings & Preferences (Options) 4 4
Thunderbird:1.5 Basic Functional Tests (BFTs):IMAP accounts 2 2
Thunderbird:1.5 Basic Functional Tests (BFTs):Global inbox 2 2
Thunderbird:1.5 Basic Functional Tests (BFTs):Mail composition 10 10
Thunderbird:1.5 Basic Functional Tests (BFTs):Spell checker 5 5
Thunderbird:1.5 Basic Functional Tests (BFTs):RSS account & subscriptions 7 7
Thunderbird:1.5 Basic Functional Tests (BFTs):Downloading and saving 1 1
Thunderbird:1.5 Basic Functional Tests (BFTs):Image blocking 2 2
Thunderbird:1.5 Basic Functional Tests (BFTs):Return receipts 2 2
Thunderbird:1.5 Basic Functional Tests (BFTs):Offline, disk space 4 4
Thunderbird:1.5 Basic Functional Tests (BFTs):Moving, copying, deleting messages 2 2
Thunderbird:1.5 Basic Functional Tests (BFTs):Views and labeling messages 4 4
Thunderbird:1.5 Basic Functional Tests (BFTs):Message filters 2 2
Thunderbird:1.5 Basic Functional Tests (BFTs):Saved Search folders 3 3
Thunderbird:1.5 Basic Functional Tests (BFTs):Message Grouping 2 2
Thunderbird:1.5 Basic Functional Tests (BFTs):Message Aging 2 2
Thunderbird:1.5 Basic Functional Tests (BFTs):Quicksearch 3 3
Thunderbird:1.5 Basic Functional Tests (BFTs):Address books 2 2
Thunderbird:1.5 Basic Functional Tests (BFTs):Extensions 5 5
Thunderbird:1.5 Basic Functional Tests (BFTs):Master Passwords & password management 2 2
Thunderbird:1.5 Basic Functional Tests (BFTs):Software Update 2 2
Thunderbird:1.5 Smoketests:Account Creation 5 6
Thunderbird:1.5 Smoketests:Install and Startup 7 4
Thunderbird:1.5 Smoketests:Message Viewing 2 6
Thunderbird:2.0 Smoketests:Install and Startup 3 4
Thunderbird:Localization (l10n):Localization (l10n) 10 12

Top Testers

Tester # Results
Tomcat 87
RQ 10
LonelyBob 10
mkairys 3
coop 2

Result Status Breakdown By Tester

Tester Pass Fail Unclear
LonelyBob 10 0 0
RQ 10 0 0
Tomcat 87 0 0
coop 0 0 2
mkairys 3 0 0