Mozilla QA Community:Thunderbird1.5.0.7 Community Test Day
Contents
- 1 Welcome to the Thunderbird Community Test Day!
- 1.1 FAQ
- 1.1.1 Where do I start?
- 1.1.2 OK, I am in the channel, now what?
- 1.1.3 What build should I test?
- 1.1.4 What specifically will we be testing?
- 1.1.5 For Thunderbird 2 beta 1 candidate:
- 1.1.6 For Thunderbird 1.5.0.7
- 1.1.7 Known Bugs
- 1.1.8 Testing Instructions
- 1.1.9 Where do I find Litmus?
- 1.1.10 Who will be moderating the #testday channel?
- 1.1.11 How do I file bugs?
- 1.1.12 How do I send feedback?
- 1.1.13 Rewards for this Test Day
- 1.2 Results
- 1.1 FAQ
Welcome to the Thunderbird Community Test Day!
Thank you for participating in this test day. The success of Firefox and Thunderbird is heavily dependent on community members like you. We appreciate your support!
When you are done, please send feedback to testday@mozilla.org or post significant findings to the Mozilla QA blog (http://weblogs.mozillazine.org/qa/). We are very interested to hear about how the test day went, any overall thoughts about Thunderbird, and roll up of issues found and bugs filed.
The official time for the test day is Friday, September 8, 2006, from 7am - 5pm PDT, but anyone can jump on Litmus at any time on any day!
For more information about this release, please check out the [Thunderbird2 wiki]. You will find the current schedule, test plan, and specific areas we can use help testing.
FAQ
Where do I start?
- Open up your favorite IRC client:
- Windows clients
- MacOS clients
- Linux clients
- ChatZilla (Firefox extension) - Note: If you are using ChatZilla you must also close ChatZilla for Firefox to fully restart. Workaround is to run Chatzilla on XULRunner (Windows installer) or run a version of Mozilla Suite and use the built in ChatZilla program from there - that way you are always online when you have to restart.
- Connect to irc.mozilla.org
- Join the #testday channel
Other Options of if you don't use IRC:
- Use Instant Messenger - http://www.aim.com/. A moderator will be online under the screen name "MozillaTestDay". Please send your screenname to marcia@mozilla.org before the test day so you can be invited to the chatroom, or just message "MozillaTestDay" during the day to figure out what to do.
OK, I am in the channel, now what?
Let the moderators know if you have any questions or encounter any problems. If you are not familiar with our bugzilla bug tracking system, feel free to report your problems to a moderator and they can log any bugs for you.
What build should I test?
We will be testing the Thunderbird 1.5.0.7 and Thunderbird 2 Beta 1 candidate builds:
Thunderbird 1.5.0.7: Please use the latest RC5 candidate: ftp://ftp.mozilla.org/pub/mozilla.org/thunderbird/nightly/1.5.0.7-candidates/rc5
Thunderbird 2 nightly (Beta 1 candidate)
ftp://ftp.mozilla.org/pub/mozilla.org/thunderbird/nightly/latest-mozilla1.8
What specifically will we be testing?
For Thunderbird 2 beta 1 candidate:
- 1) UI nits with the theme refresh for Windows and Linux
- 2) Feedback on Move Again / copy again. See the Messages menu.
- 3) Feedback on Copy To / Recent --> recent folders and Move To / Recent --> recent folders
- 4) anything with tagging
- 5) folder views
For Thunderbird 1.5.0.7
- General Usage, make sure there are no regressions from previous release
- Making sure Enignmail Extension works
- Making sure that signing your email works as expected
- Making sure reading signed email works as expected
- Testing saved passwords for your accounts
Known Bugs
- Get Themes and Get Extensions links Missing from Add-Ons: https://bugzilla.mozilla.org/show_bug.cgi?id=349574
Testing Instructions
- Download the Thunderbird builds noted above
- Get an email signing and encryption certificate. [Thawte] provides free email certificates.
- Run any one of the tests in Litmus: Daily smoketest, Basic Functional, or Fun smoketest. We are also very interested in sending signed and encrypted messages to test the SMIME implementation.
- if you need a test account to send test mail messages to, feel free to use test1@mozilla.com
- Areas to Test around (coming soon)
Some other ways you can help:
- Think of some test cases that aren't already included in Litmus (we love suggestions
- Thunderbird needs new test cases for many of the 2.0 features. We could use your help creating test cases. Please email marcia@mozilla.org if you want to be involved in this effort.
Where do I find Litmus?
- Go to the Litmus start page.
- Log in or create an account if you don't already have one and then select run tests.
- Enter the appropriate information and click Submit.
- Choose a test group and then a subgroup and then click Submit to start testing!
Tips:
- Make sure you enter the correct information for your platform, version of Thunderbird, etc.
- Feel free to ask on IRC or AIM if you need help or have any questions.
Who will be moderating the #testday channel?
The moderator's nicks for this test day will be:
- tracy
- bc
- marcia
- coop
- alice
- mw22
- timr
How do I file bugs?
First of all, let one of the moderators know so they can check if it is already a known problem. Then they can guide you to either provide more details, update an existing bug or file a new bug.
If filing a new bug, please do a quick check to see if the bug already exists. This can easily be done by searching for the error message, window name, or some over identifing feature of the bug.
In the case of any testing endeavor, it is important to include the list of extensions that you have installed since they can often cause strange issues to crop up.
How do I send feedback?
Please use the testday@mozilla.org to send feedback about how the testday went, any overall thoughts about Thunderbird, and roll up of issues found and bugs filed. We really appreciate your help today and your feedback is very valuable.
Rewards for this Test Day
The top 5 testers who have not previously won $25 gift certificates or store credit for Community Day testing will be rewarded for this test day. If you reside outside of the U.S, you will be awarded a $25 gift certificate to the Mozilla Store.
Results
Total Test Results By Locale
Locale | # Results |
---|---|
de | 19 |
en-US | 83 |
lt | 10 |
Total Test Results By Platform
Platform | # Results |
---|---|
Windows | 92 |
Linux | 10 |
Mac (Intel) | 10 |
Total Test Results By Result Status
Result Status | # Results |
---|---|
Pass | 110 |
Test unclear/broken | 2 |
Total Test Results By Subgroup
Subgroup | # Results | # Testcases in Subgroup |
---|---|---|
Firefox:Localization (l10n):Localization (l10n) | 15 | 15 |
Thunderbird:1.5 Basic Functional Tests (BFTs):Migration | 1 | 1 |
Thunderbird:1.5 Basic Functional Tests (BFTs):Toolbars and menus | 1 | 1 |
Thunderbird:1.5 Basic Functional Tests (BFTs):Account settings & Preferences (Options) | 4 | 4 |
Thunderbird:1.5 Basic Functional Tests (BFTs):IMAP accounts | 2 | 2 |
Thunderbird:1.5 Basic Functional Tests (BFTs):Global inbox | 2 | 2 |
Thunderbird:1.5 Basic Functional Tests (BFTs):Mail composition | 10 | 10 |
Thunderbird:1.5 Basic Functional Tests (BFTs):Spell checker | 5 | 5 |
Thunderbird:1.5 Basic Functional Tests (BFTs):RSS account & subscriptions | 7 | 7 |
Thunderbird:1.5 Basic Functional Tests (BFTs):Downloading and saving | 1 | 1 |
Thunderbird:1.5 Basic Functional Tests (BFTs):Image blocking | 2 | 2 |
Thunderbird:1.5 Basic Functional Tests (BFTs):Return receipts | 2 | 2 |
Thunderbird:1.5 Basic Functional Tests (BFTs):Offline, disk space | 4 | 4 |
Thunderbird:1.5 Basic Functional Tests (BFTs):Moving, copying, deleting messages | 2 | 2 |
Thunderbird:1.5 Basic Functional Tests (BFTs):Views and labeling messages | 4 | 4 |
Thunderbird:1.5 Basic Functional Tests (BFTs):Message filters | 2 | 2 |
Thunderbird:1.5 Basic Functional Tests (BFTs):Saved Search folders | 3 | 3 |
Thunderbird:1.5 Basic Functional Tests (BFTs):Message Grouping | 2 | 2 |
Thunderbird:1.5 Basic Functional Tests (BFTs):Message Aging | 2 | 2 |
Thunderbird:1.5 Basic Functional Tests (BFTs):Quicksearch | 3 | 3 |
Thunderbird:1.5 Basic Functional Tests (BFTs):Address books | 2 | 2 |
Thunderbird:1.5 Basic Functional Tests (BFTs):Extensions | 5 | 5 |
Thunderbird:1.5 Basic Functional Tests (BFTs):Master Passwords & password management | 2 | 2 |
Thunderbird:1.5 Basic Functional Tests (BFTs):Software Update | 2 | 2 |
Thunderbird:1.5 Smoketests:Account Creation | 5 | 6 |
Thunderbird:1.5 Smoketests:Install and Startup | 7 | 4 |
Thunderbird:1.5 Smoketests:Message Viewing | 2 | 6 |
Thunderbird:2.0 Smoketests:Install and Startup | 3 | 4 |
Thunderbird:Localization (l10n):Localization (l10n) | 10 | 12 |
Top Testers
Tester | # Results |
---|---|
Tomcat | 87 |
RQ | 10 |
LonelyBob | 10 |
mkairys | 3 |
coop | 2 |
Result Status Breakdown By Tester
Tester | Pass | Fail | Unclear |
---|---|---|---|
LonelyBob | 10 | 0 | 0 |
RQ | 10 | 0 | 0 |
Tomcat | 87 | 0 | 0 |
coop | 0 | 0 | 2 |
mkairys | 3 | 0 | 0 |