Mozilla QA Community:BonEcho 2.0b1 Community Test Day: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(4 intermediate revisions by 4 users not shown)
Line 16: Line 16:
** [http://www.ircreviews.org/clients/platforms-macos.html MacOS clients]
** [http://www.ircreviews.org/clients/platforms-macos.html MacOS clients]
** [http://www.ircreviews.org/clients/platforms-unix.html Linux clients]  
** [http://www.ircreviews.org/clients/platforms-unix.html Linux clients]  
** [https://addons.mozilla.org/firefox/16/ ChatZilla (Firefox extension)] - ''Note: If you are using ChatZilla you must also close ChatZilla for Firefox to fully restart.'' Workaround is to run a version of Mozilla Suite and use the built in Chatzilla program from there - that way you are always online when you have to restart.
** [https://addons.mozilla.org/firefox/16/ ChatZilla (Firefox extension)] - ''Note: If you are using ChatZilla you must also close ChatZilla for Firefox to fully restart.'' Workaround is to run [http://chatzilla.rdmsoft.com/xulrunner/ Chatzilla on XULRunner] ([http://forums.mozillazine.org/viewtopic.php?t=377580 Windows installer]) or run a version of Mozilla Suite and use the built in Chatzilla program from there - that way you are always online when you have to restart.


* Connect to [irc://irc.mozilla.org irc.mozilla.org]
* Connect to [irc://irc.mozilla.org irc.mozilla.org]
Line 23: Line 23:
'''Other Options of if you don't use IRC:
'''Other Options of if you don't use IRC:
'''
'''
*Use Instant Messenger - http://www.aim.com/. A moderator will be online under the screen name "MozillaTestDay. Please send your screenname to [mailto:marcia@mozilla.org marcia@mozilla.org] before the test day and I will add you the chatroom.
*Use Instant Messenger - http://www.aim.com/. A moderator will be online under the screen name "MozillaTestDay. Please send your screenname to [mailto:marcia@mozilla.org marcia@mozilla.org] before the test day so you can be invited to the chatroom, or just message "MozillaTestDay" during the day to figure out what to do.


=== Ok, I am in the channel, now what? ===
=== Ok, I am in the channel, now what? ===
Line 85: Line 85:
* alice
* alice
* mw22
* mw22
* ispiked
* zach


=== How do I file bugs? ===
=== How do I file bugs? ===
Line 96: Line 94:
=== Rewards for this Test Day ===
=== Rewards for this Test Day ===
The top 5 testers will all earn $25 gift certificates to amazon.com.
The top 5 testers will all earn $25 gift certificates to amazon.com.
== Results ==
=== Total Test Results By Locale ===
{| border="1" cellpadding="2"
! style="background:#efefef" | '''Locale'''
! style="background:#efefef" | '''# Results'''
|-
| de
| 1
|-
| en-US
| 279
|}
=== Total Test Results By Platform ===
{| border="1" cellpadding="2"
! style="background:#efefef" | '''Platform'''
! style="background:#efefef" | '''# Results'''
|-
| Windows
| 165
|-
| Linux
| 54
|-
| Mac
| 61
|}
=== Total Test Results By Result Status ===
{| border="1" cellpadding="2"
! style="background:#efefef" | '''Result Status'''
! style="background:#efefef" | '''# Results'''
|-
| Pass
| 240
|-
| Fail
| 31
|-
| Test unclear/broken
| 9
|}
=== Total Test Results By Subgroup ===
{| border="1" cellpadding="2"
! style="background:#efefef" | '''Subgroup'''
! style="background:#efefef" | '''# Results'''
! style="background:#efefef" | '''# Testcases in Subgroup'''
|-
| Firefox:1.5 Smoketests:Functionality
| 1
| 26
|-
| Firefox:2.0 Basic Functional Tests (BFTs):Find in Page
| 5
| 6
|-
| Firefox:2.0 Basic Functional Tests (BFTs):Popup and annoyance blocking
| 7
| 8
|-
| Firefox:2.0 Basic Functional Tests (BFTs):Session Store
| 89
| 11
|-
| Firefox:2.0 Full Functional Tests (FFTs):RSS
| 128
| 17
|-
| Firefox:2.0 Full Functional Tests (FFTs):Session Store
| 119
| 19
|-
| Firefox:2.0 Full Functional Tests (FFTs):Anti-phishing
| 8
| 9
|-
| Firefox:2.0 Full Functional Tests (FFTs):Find in Page
| 5
| 10
|-
| Firefox:2.0 Full Functional Tests (FFTs):XMLHttpRequest
| 3
| 3
|-
| Firefox:2.0 Full Functional Tests (FFTs):Security
| 2
| 1
|}
=== Top Testers ===
{| border="1" cellpadding="2"
! style="background:#efefef" | '''Tester'''
! style="background:#efefef" | '''# Results'''
|-
| mw22
| 53
|-
| jpozlovsky
| 37
|-
| mkairys
| 36
|-
| Bobby
| 26
|-
| tracy
| 18
|-
| LonelyBob
| 18
|-
| pascalc
| 18
|-
| juanb
| 17
|-
| Eduardo
| 17
|-
| robcee
| 14
|-
| stevee
| 13
|-
| VT100
| 12
|-
| alxsn
| 1
|}
=== Result Status Breakdown By Tester ===
{| border="1" cellpadding="2"
! style="background:#efefef" | '''Tester'''
! style="background:#efefef" | '''Pass'''
! style="background:#efefef" | '''Fail'''
! style="background:#efefef" | '''Unclear'''
|-
| Bobby
| 20
| 5
| 1
|-
| Eduardo
| 16
| 1
| 0
|-
| LonelyBob
| 18
| 0
| 0
|-
| VT100
| 11
| 1
| 0
|-
| alxsn
| 0
| 1
| 0
|-
| jpozlovsky
| 31
| 5
| 1
|-
| juanb
| 17
| 0
| 0
|-
| mkairys
| 31
| 4
| 1
|-
| mw22
| 44
| 3
| 6
|-
| pascalc
| 12
| 6
| 0
|-
| robcee
| 12
| 2
| 0
|-
| stevee
| 12
| 1
| 0
|-
| tracy
| 16
| 2
| 0
|}

Latest revision as of 21:35, 24 August 2006

Welcome to the Bon Echo Community Test Day!!

Thank you for participating in this test day. The success of Firefox and Thunderbird is heavily dependent on community members like you. We appreciate your support!!

When you are done, please send feedback to testday@mozilla.org or post significant findings to the Mozilla QA blog (http://weblogs.mozillazine.org/qa/). We are very interested to hear about how the test day went, any overall thoughts about Bon Echo, and roll up of issues found and bugs filed.

The official time for the test day is Friday, July 28, 2006, from 7am - 5pm PDT, but anyone can jump on Litmus at any time on any day!

For more information about this release, please check out the Bon Echo wiki. You will find the current schedule, test plan, and specific areas we can use help testing.

FAQ

Where do I start?

Other Options of if you don't use IRC:

  • Use Instant Messenger - http://www.aim.com/. A moderator will be online under the screen name "MozillaTestDay. Please send your screenname to marcia@mozilla.org before the test day so you can be invited to the chatroom, or just message "MozillaTestDay" during the day to figure out what to do.

Ok, I am in the channel, now what?

  1. Let the moderators know if you have any questions or encounter any problems. If you are not familiar with our bugzilla bug tracking system, feel free to report your problems to a moderator and they can log any bugs for you.

What build should I test?

We will be testing the Bon Echo nightly candidate builds:

Firefox: ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/latest-mozilla1.8

What specifically will we be testing?

We will be testing two of Bon Echo's features: Session Restore and RSS. Both features will benefit from community testing, since in the case or RSS we all use different feed readers and subscribe to different feeds. Also, Ben Goodger changed the RSS functionality, so we want to make sure that everything works A-OK. Remember in the case of RSS that Bon Echo should be able to handle all different kinds of feeds: ATOM, RSS 0.9.1, 1.0 and 2.0.

In the case of Session Restore, we will benefit in exploring this feature further with a wider audience. You will all have different kinds of sessions running, so what the heck?

Existing Open Bugs are as follows:

Testing Instructions

  • Note: The nightly builds will still be branded with Bon Echo. The release builds will be branded Firefox.

Follow these instructions:

1. Download a Bon Echo build from the nightly directory: ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/latest-mozilla1.8

2. If you want to test Session Restore. go to litmus.mozilla.org and select a FF2.0 Full Functional Run. That will allow you to run all of the Session Restore test cases (you can select that radio button just to run those set of tests)

3. If you want to test RSS feeds, go to litmus.mozilla.org and select a FF 2.0 Full Functional Run. That will allow you to run all of the RSS test cases (you can select that radio button just to run those set of tests)

Some other ways you can help:

1. Think of some test cases that aren't already included in Litmus (we love suggestions!).

2. Do some exploratory testing in one of the areas. Do a combination of things to try to explore the feature fully. Since Session Restore has a lot to do with tabs, you might try combinations of things in that area. With RSS, go out and get a lot of different types of feeds and feed readers. There are lots of free feeds readers out there. Here are some links that might help:

1. Windows: http://email.about.com/cs/rssfeedreaders/tp/windows_free.htm

2. Mac: http://email.about.com/cs/rssfeedreaders/tp/top_rss_mac.htm

Where do I find Litmus?

  • Go to Litmus
  • log in and then select run tests
  • You can do a smoketest or a Basic Functional Test, it is entirely up to you!
  • Talk to a moderator if you need help.
  • Please make sure to choose the correct platform when you start your run.

Who will be moderating the #testday channel?

The moderator's nicks for this test day will be:

  • tracy
  • bc
  • marcia
  • juanb
  • coop
  • alice
  • mw22

How do I file bugs?

First of all, let one of the moderators know so they can check if it is already a known problem. Then they can guide you to either provide more details, update an existing bug or file a new bug. If filing a new bug, please do a quick check to see if the bug already exists. This can easily be done by searching for the error message, window name, or some over identifing feature of the bug. In the case of any testing endeavor, it is important to include the list of extensions that you have installed since they can often cause strange issues to crop up.

How do I send feedback?

Please use the testday@mozilla.org to send feedback about how the testday went, any overall thoughts about Bon Echo, and roll up of issues found and bugs filed. We really appreciate your help today and your feedback is very valuable.

Rewards for this Test Day

The top 5 testers will all earn $25 gift certificates to amazon.com.

Results

Total Test Results By Locale

Locale # Results
de 1
en-US 279

Total Test Results By Platform

Platform # Results
Windows 165
Linux 54
Mac 61

Total Test Results By Result Status

Result Status # Results
Pass 240
Fail 31
Test unclear/broken 9

Total Test Results By Subgroup

Subgroup # Results # Testcases in Subgroup
Firefox:1.5 Smoketests:Functionality 1 26
Firefox:2.0 Basic Functional Tests (BFTs):Find in Page 5 6
Firefox:2.0 Basic Functional Tests (BFTs):Popup and annoyance blocking 7 8
Firefox:2.0 Basic Functional Tests (BFTs):Session Store 89 11
Firefox:2.0 Full Functional Tests (FFTs):RSS 128 17
Firefox:2.0 Full Functional Tests (FFTs):Session Store 119 19
Firefox:2.0 Full Functional Tests (FFTs):Anti-phishing 8 9
Firefox:2.0 Full Functional Tests (FFTs):Find in Page 5 10
Firefox:2.0 Full Functional Tests (FFTs):XMLHttpRequest 3 3
Firefox:2.0 Full Functional Tests (FFTs):Security 2 1

Top Testers

Tester # Results
mw22 53
jpozlovsky 37
mkairys 36
Bobby 26
tracy 18
LonelyBob 18
pascalc 18
juanb 17
Eduardo 17
robcee 14
stevee 13
VT100 12
alxsn 1

Result Status Breakdown By Tester

Tester Pass Fail Unclear
Bobby 20 5 1
Eduardo 16 1 0
LonelyBob 18 0 0
VT100 11 1 0
alxsn 0 1 0
jpozlovsky 31 5 1
juanb 17 0 0
mkairys 31 4 1
mw22 44 3 6
pascalc 12 6 0
robcee 12 2 0
stevee 12 1 0
tracy 16 2 0
Retrieved from "https://wiki.mozilla.org/index.php?title=Mozilla_QA_Community:BonEcho_2.0b1_Community_Test_Day&oldid=32398"