Mozilla QA Community:ThunderBird 1.5 RC2 Community Test Day: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
No edit summary
 
(22 intermediate revisions by 4 users not shown)
Line 1: Line 1:
= Welcome to the Thunderbird 1.5RC2 Community Test Day! =
= Welcome to the Thunderbird 1.5RC2 Community Test Day! =
=='''This testing event is over - thanks for your participation. Check back soon for another exciting community test event!'''==


The test day will be held on December 13th, 2005.  It will run from '''6am PST/9am EST until 5pm PST/8pm EST'''
The test day will be held on December 13th, 2005.  It will run from '''6am PST/9am EST until 5pm PST/8pm EST'''


= Welcome to the Firefox 1.5 RC3 Community Test Day!! =
We will be using the Litmus testing tool for this event.  The url to navigate to is http://litmus.mozilla.org/.
 
Please see the FAQ below for specific instructions on how to test using the Litmus tool, and other instructions about how to join the IRC channel and interface with other members of the Mozilla testing community.
 
== Important! ==
 
Backup your existing Thunderbird profile before testing!


Thank you for participating in this test day.  The success of Firefox is heavily dependent on community members like you.  We appreciate your support!!
Here is some information about backing up your profiles:


When you are done, please send feedback to [mailto:testday@mozilla.org]. We are very interested to hear about how the test day went, any overall thoughts about Firefox 1.5 RC3, and roll up of issues found and bugs filed.
#http://kb.mozillazine.org/Thunderbird_:_FAQs_:_Backing_Up_and_Restoring
#http://mozbackup.jasnapaka.com/ - Backup utility for Firefox and Thunderbird


== FAQ ==  
== FAQ ==  
Line 20: Line 30:


=== Ok, I am in the channel, now what? ===
=== Ok, I am in the channel, now what? ===
# Ask for an area to test.  One of the [http://wiki.mozilla.org/Mozilla_QA_Community:Firefox_1.5_RC3_Community_Test_Day#Who_will_be_moderating_the_.23testday_channel.3F moderators] will help guide you to a useful area to test.  If you have a specific area you want to test you can do it through one of our test procedures with automatic logging pass/fail and comments.  Or you can test on your own.  Just work with one of the Moderators.
# Let the moderators know if you have any questions or encounter any problems.  If you are not familiar with our [https://bugzilla.mozilla.org/index.cgi bugzilla bug tracking system], feel free to report your problems to a moderator and they can log any bugs for you.
# Let the moderators know if you have any questions or encounter any problems.  If you are not familiar with our [https://bugzilla.mozilla.org/index.cgi bugzilla bug tracking system], feel free to report your problems to a moderator and they can log any bugs for you.
# Let the moderator know when you are done so we can release any test ids and wrap up any questions you or the moderator may have about your testing.


=== What build should I test? ===
=== What build should I test? ===


We will be testing the Firefox RC3 build, which was released 11/17/05.  Here are links to the various platforms:
We will be testing the Thunderbird RC2 build.  Here are links to the various platforms:
 
[http://ftp.mozilla.org/pub/mozilla.org/thunderbird/nightly/1.5rc2-candidates/thunderbird-1.5.en-US.win32.installer.exe Windows]
[http://ftp.mozilla.org/pub/mozilla.org/thunderbird/nightly/1.5rc2-candidates/thunderbird-1.5.en-US.mac.dmg Mac]
[http://ftp.mozilla.org/pub/mozilla.org/thunderbird/nightly/1.5rc2-candidates/thunderbird-1.5.en-US.linux-i686.tar.gz Linux]


[http://mozilla.isc.org/pub/mozilla.org/firefox/releases/1.5rc3/win32/en-US/ Windows]
=== How do I use Litmus to test? ===
[http://mozilla.isc.org/pub/mozilla.org/firefox/releases/1.5rc3/mac/en-US/ Mac]
[http://mozilla.isc.org/pub/mozilla.org/firefox/releases/1.5rc3/linux-i686/en-US/ Linux]


If you are using an earlier build (Beta2, RC1 or RC2), feel free to test out our great software update feature to bring yourself up to RC3.
* Go to http://litmus.mozilla.org/
* Click on run tests. Please make sure to enter your email address in the last field.
* Select product "Thunderbird" and your platform and OS
* Select 1.5
* Enter 2005120115 as the build ID
* Enter your email address


=== Where do I find testrunner test procedures? ===
In the next section, select the following:


* Talk to a moderator '''before''' starting a testrunner run.  We need to make sure testers do not over write each other's results.
* Select the radio button that says BFTs
* There will be [http://testrunner.mozilla.org/test.cgi 10 test runs] for Firefox, on Windows, Mac, and Linux.
* Select the radio button for the section you want to test
* Please make sure to choose the correct platform when you start your run.
 
We are leaving it open as far as what you want to test, but we encourage you to explore areas in Thunderbird that you might not normally use. For example, try creating some saved searches and work offline for a while just to make sure those areas are functioning correctly.


=== Who will be moderating the #testday channel? ===
=== Who will be moderating the #testday channel? ===
Moderators are designated by a solid green dot in the IRC client and will be at the top of the channel.
The moderator's nicks are:
The moderator's nicks are:
* tracy
* tracy
Line 51: Line 70:


=== How do I file bugs? ===
=== How do I file bugs? ===
First of all, let one of the [http://wiki.mozilla.org/Mozilla_QA_Community:Firefox_1.5_RC3_Community_Test_Day#Who_will_be_moderating_the_.23testday_channel.3F moderators] know so they can check if it is already a known problem.  Then they can guide you to either provide more details, [https://bugzilla.mozilla.org/index.cgi update an existing bug] or file a new bug.  If filing a new bug, please do a quick check to see if the bug already exists.  This can easily be done by searching for the error message, window name, or some over identifing feature of the bug.
First of all, let one of the [http://wiki.mozilla.org/Mozilla_QA_Community:Firefox_1.5_RC3_Community_Test_Day#Who_will_be_moderating_the_.23testday_channel.3F moderators] know so they can check if it is already a known problem.  Then they can guide you to either provide more details, [https://bugzilla.mozilla.org/index.cgi update an existing bug] or file a new bug.  If filing a new bug, please do a quick check to see if the bug already exists.  This can easily be done by searching for the error message, window name, or some over identifying feature of the bug.


=== How do I send feedback? ===
=== How do I send feedback? ===
Please use the [mailto:testday@mozilla.org] to send feedback about how the testday went, any overall thoughts about Firefox 1.5 RC3, and roll up of issues found and bugs filed.  We really appreciate your help today and your feedback is very valuable.
Please use the [mailto:testday@mozilla.org] to send feedback about how the testday went, any overall thoughts about Thunderbird 1.5 RC2, and roll up of issues found and bugs filed.  We really appreciate your help today and your feedback is very valuable.
 
If you have issues with a particular testcase in Litmus, please take the time to add a comment to your test result indicating what is broken or unclear.
 
== Results ==
 
=== Parameters ===
 
* Product: Thunderbird
* Test Group: Basic Functional Tests (BFTs)
* Branch: 1.5 Branch
* Build ID: 20051201*
* Start Time: 2005/12/13 06:00:00 PST
* Finish Time: 2005/12/13 17:00:00 PST
 
=== Total Test Results By Locale ===
{| border="1" cellpadding="2"
! style="background:#efefef" | '''Locale'''
! style="background:#efefef" | '''# Results'''
|-
| en-US
| 176
|-
| pl
| 57
|-
| da-DK
| 2
|}
 
Note: we have no way of verifying whether the Thunderbird builds these people were using were actually the localized versions or not. They may have simply chosen the locale they were testing ''from''.
 
=== Total Test Results By Platform ===
 
{| border="1" cellpadding="2"
! style="background:#efefef" | '''Platform'''
! style="background:#efefef" | '''# Results'''
|-
| Windows
| 171
|-
| Linux
| 52
|-
| Mac
| 12
|}
 
=== Total Test Results By Result Status ===
 
{| border="1" cellpadding="2"
! style="background:#efefef" | '''Result Status'''
! style="background:#efefef" | '''# Results'''
|-
| Pass
| 194
|-
| Fail
| 28
|-
| Unclear
| 13
|}

Latest revision as of 00:05, 15 December 2005

Welcome to the Thunderbird 1.5RC2 Community Test Day!

This testing event is over - thanks for your participation. Check back soon for another exciting community test event!

The test day will be held on December 13th, 2005. It will run from 6am PST/9am EST until 5pm PST/8pm EST

We will be using the Litmus testing tool for this event. The url to navigate to is http://litmus.mozilla.org/.

Please see the FAQ below for specific instructions on how to test using the Litmus tool, and other instructions about how to join the IRC channel and interface with other members of the Mozilla testing community.

Important!

Backup your existing Thunderbird profile before testing!

Here is some information about backing up your profiles:

  1. http://kb.mozillazine.org/Thunderbird_:_FAQs_:_Backing_Up_and_Restoring
  2. http://mozbackup.jasnapaka.com/ - Backup utility for Firefox and Thunderbird

FAQ

Where do I start?

Ok, I am in the channel, now what?

  1. Let the moderators know if you have any questions or encounter any problems. If you are not familiar with our bugzilla bug tracking system, feel free to report your problems to a moderator and they can log any bugs for you.

What build should I test?

We will be testing the Thunderbird RC2 build. Here are links to the various platforms:

Windows Mac Linux

How do I use Litmus to test?

  • Go to http://litmus.mozilla.org/
  • Click on run tests. Please make sure to enter your email address in the last field.
  • Select product "Thunderbird" and your platform and OS
  • Select 1.5
  • Enter 2005120115 as the build ID
  • Enter your email address

In the next section, select the following:

  • Select the radio button that says BFTs
  • Select the radio button for the section you want to test

We are leaving it open as far as what you want to test, but we encourage you to explore areas in Thunderbird that you might not normally use. For example, try creating some saved searches and work offline for a while just to make sure those areas are functioning correctly.

Who will be moderating the #testday channel?

Moderators are designated by a solid green dot in the IRC client and will be at the top of the channel.

The moderator's nicks are:

  • tracy
  • coop
  • bc
  • timr
  • marcia
  • jay
  • davel

How do I file bugs?

First of all, let one of the moderators know so they can check if it is already a known problem. Then they can guide you to either provide more details, update an existing bug or file a new bug. If filing a new bug, please do a quick check to see if the bug already exists. This can easily be done by searching for the error message, window name, or some over identifying feature of the bug.

How do I send feedback?

Please use the [1] to send feedback about how the testday went, any overall thoughts about Thunderbird 1.5 RC2, and roll up of issues found and bugs filed. We really appreciate your help today and your feedback is very valuable.

If you have issues with a particular testcase in Litmus, please take the time to add a comment to your test result indicating what is broken or unclear.

Results

Parameters

  • Product: Thunderbird
  • Test Group: Basic Functional Tests (BFTs)
  • Branch: 1.5 Branch
  • Build ID: 20051201*
  • Start Time: 2005/12/13 06:00:00 PST
  • Finish Time: 2005/12/13 17:00:00 PST

Total Test Results By Locale

Locale # Results
en-US 176
pl 57
da-DK 2

Note: we have no way of verifying whether the Thunderbird builds these people were using were actually the localized versions or not. They may have simply chosen the locale they were testing from.

Total Test Results By Platform

Platform # Results
Windows 171
Linux 52
Mac 12

Total Test Results By Result Status

Result Status # Results
Pass 194
Fail 28
Unclear 13
Retrieved from "https://wiki.mozilla.org/index.php?title=Mozilla_QA_Community:ThunderBird_1.5_RC2_Community_Test_Day&oldid=21711"