Mozilla QA Community: Community Test Day

From MozillaWiki
Jump to: navigation, search

Welcome to the Firefox/Thunderbird Community Test Day!!

Thank you for participating in this test day. The success of Firefox and Thunderbird is heavily dependent on community members like you. We appreciate your support!!

When you are done, please send feedback to [1]. We are very interested to hear about how the test day went, any overall thoughts about Firefox and Thunderbird, and roll up of issues found and bugs filed.

The official time for the test day is Friday, July 14th, 2006, from 7am - 5pm PDT, but anyone can jump on Litmus at any time on any day!

For more information about this release, please check out the Firefox/Thunderbird Community Wiki. You will find the current schedule, test plan, and specific areas we can use help testing.


Where do I start?

Ok, I am in the channel, now what?

  1. Let the moderators know if you have any questions or encounter any problems. If you are not familiar with our bugzilla bug tracking system, feel free to report your problems to a moderator and they can log any bugs for you.

What build should I test?

We will be testing the Firefox and Thunderbird candidate builds (currently at rc3):



What needs to be tested?

We have made changes or fixed bugs/regressions in parts of the code that deal with the following areas. We should try to test around them to make sure everything still works as expected:

  • General browsing and mail usage
    • Print preview, specifically the UI around it
    • Indenting text in midas
    • <canvas> on mac
    • Java on mac
    • SVG on mac, in particular text in SVG
    • Closing windows
    • Drag'n'drop on mac
    • v-cards in thunderbird
    • Copy-pasting html
    • Clicking in <select>s
    • Navigation in general
    • Links to external applications such as mail, telnet, aim, etc
    • The urlbar autocomplete feature
  • Web developers can also try this
    • Any DOM tests we have of the getElementsByTagName function
    • garbage-collection in javascript (i.e. general javascript tests)
    • Javascript debuggers such as venkman and firebug
    • Proxy-auto-config
    • The document.getBoxObjectFor function

If you want, you can also try running through any number of Basic Funcational Tests (BFTs) that are available through Litmus, our test tracking system.

Where do I find Litmus?

  • Go to Litmus
  • log in and then select run tests
  • You can do a smoketest or a Basic Functional Test, it is entirely up to you!
  • Talk to a moderator if you need help.
  • Please make sure to choose the correct platform when you start your run.

Who will be moderating the #testday channel?

The moderator's nicks are:

  • tracy
  • bc
  • timr
  • marcia
  • jay
  • davel
  • juanb
  • robcee
  • alice
  • coop
  • ispiked

How do I file bugs?

First of all, let one of the moderators know so they can check if it is already a known problem. Then they can guide you to either provide more details, update an existing bug or file a new bug. If filing a new bug, please do a quick check to see if the bug already exists. This can easily be done by searching for the error message, window name, or some over identifing feature of the bug.

How do I send feedback?

Please use the [2] to send feedback about how the testday went, any overall thoughts about Firefox or Thunderbird 1.5.0.x, and roll up of issues found and bugs filed. We really appreciate your help today and your feedback is very valuable.


Total Test Results By Locale

Locale # Results
en-US 86

Total Test Results By Platform

Platform # Results
Windows 67
Linux 7
Mac 12

Total Test Results By Result Status

Result Status # Results
Pass 84
Test unclear/broken 2

Total Test Results By Subgroup

Subgroup # Results # Testcases in Subgroup
Firefox:1.5 Basic Functional Tests (BFTs):Installation 3 3
Firefox:1.5 Basic Functional Tests (BFTs):Migration 1 1
Firefox:1.5 Basic Functional Tests (BFTs):Menu Bar 8 10
Firefox:1.5 Basic Functional Tests (BFTs):Help 6 6
Firefox:1.5 Basic Functional Tests (BFTs):Page Controls 4 4
Firefox:1.5 Basic Functional Tests (BFTs):Toolbar Customization 5 5
Firefox:1.5 Basic Functional Tests (BFTs):Location Bar & Autocomplete 3 3
Firefox:1.5 Basic Functional Tests (BFTs):Search 7 3
Firefox:1.5 Basic Functional Tests (BFTs):Printing 3 3
Firefox:1.5 Basic Functional Tests (BFTs):Tabbed Browsing 13 13
Firefox:1.5 Basic Functional Tests (BFTs):Options (Preferences) Dialog 6 6
Firefox:1.5 Basic Functional Tests (BFTs):Page Info 2 2
Firefox:1.5 Basic Functional Tests (BFTs):Plug Ins 1 1
Firefox:1.5 Full Functional Tests (FFTs):Installation 1 6
Firefox:1.5 Full Functional Tests (FFTs):Location Bar & Autocomplete 4 4
Firefox:1.5 Full Functional Tests (FFTs):Popup and annoyance blocking 10 10
Firefox:2.0 Basic Functional Tests (BFTs):Installation 3 3
Thunderbird:1.5 Basic Functional Tests (BFTs):Install, shutdown, uninstall 3 3
Thunderbird:1.5 Basic Functional Tests (BFTs):IMAP accounts 2 2
Thunderbird:1.5 Basic Functional Tests (BFTs):Printing 1 1

Top Testers

Tester # Results
mkairys 67
RangerRick 11
klock 7
Jacque 1

Result Status Breakdown By Tester

Tester Pass Fail Unclear
Jacque 1 0 0
RangerRick 9 0 2
klock 7 0 0
mkairys 67 0 0