Mozilla QA Community:BonEcho 2.0b2 Community Test Day - Revision history

Marcia: /* Rewards for this Test Day */

2006-08-31T23:19:58Z

Rewards for this Test Day

← Older revision		Revision as of 23:19, 31 August 2006
Line 104:		Line 104:

	=== Rewards for this Test Day ===		=== Rewards for this Test Day ===
	The top 5 testers ~~will all earn~~ $25 gift certificates to amazon.com. If you ~~are located~~ outside of the U.S, you will be awarded a $25 gift certificate to the Mozilla Store.		The top 5 testers who have not previously won $25 gift certificates to amazon.com will be rewarded for this test day. If you reside outside of the U.S, you will be awarded a $25 gift certificate to the Mozilla Store.

	== Results ==		== Results ==

ChrisCooper: /* Results */

2006-08-29T14:45:57Z

Results

Show changes

Jbecerra: /* What specifically will we be testing? */

2006-08-24T19:42:12Z

What specifically will we be testing?

← Older revision		Revision as of 19:42, 24 August 2006
Line 40:		Line 40:
	=== What specifically will we be testing? ===		=== What specifically will we be testing? ===

	We will be testing the new tabbed browsing features that will be in Firefox 2. A quick overview of the new features:		We will be testing the new tabbed browsing and session store features that will be in Firefox 2. A quick overview of the new features:
	* '''Tab overflow''' - now when a lot of tabs are open, scroll buttons appear on the left and right side of the tab bar allowing you to scroll through tabs.		* '''Tab overflow''' - now when a lot of tabs are open, scroll buttons appear on the left and right side of the tab bar allowing you to scroll through tabs.
	* '''All Tabs button''' - a button that shows on the right side of the tab bar that lists all open tabs.		* '''All Tabs button''' - a button that shows on the right side of the tab bar that lists all open tabs.
Line 46:		Line 46:
	* '''Warn if closing too many tabs''' - now if you try to open too many tabs at once (more than 15), you will be asked if you want to open those tabs.		* '''Warn if closing too many tabs''' - now if you try to open too many tabs at once (more than 15), you will be asked if you want to open those tabs.
	* '''Tab focusing behavior''' - when you open a new tab from a link on a page and then close that tab, you will go back to the page the tab was opened from		* '''Tab focusing behavior''' - when you open a new tab from a link on a page and then close that tab, you will go back to the page the tab was opened from


			* '''Tab history and clearing private data''' - make sure tab history is cleared
			* '''Restore Session and tab history''' - make sure tab history is restored
			* '''Restore Session with form data''' - make sure entered form data is restored
			* '''Restore Session with multiple windows''' - make sure all windows are restored and that their tabs, size, position and order are the same; including other windows, like Downloads, Extensions, ...

	Existing open bugs:		Existing open bugs:

Jbecerra: /* Testing Instructions */

2006-08-23T23:29:17Z

Testing Instructions

← Older revision		Revision as of 23:29, 23 August 2006
Line 57:		Line 57:
	Follow these instructions:		Follow these instructions:

	# Download a Bon Echo build from the nightly directory: ~~(Windows, Linux)~~ ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/2.0b2-candidates/rc1		# Download a Bon Echo build from the nightly directory: ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/2.0b2-candidates/rc1 (Windows, Linux) ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/2.0b2-candidates/rc2 (Mac)
	(~~Mac~~) ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/2.0b2-candidates/rc2
	# Go to [http://litmus.mozilla.org Litmus] and run the FF2.0 Full Functional Tests for Tabbed browsing. (link to more on litmus)		# Go to [http://litmus.mozilla.org Litmus] and run the FF2.0 Full Functional Tests for Tabbed browsing. (link to more on litmus)

Jbecerra: /* Testing Instructions */

2006-08-23T23:27:58Z

Testing Instructions

← Older revision		Revision as of 23:27, 23 August 2006
Line 53:		Line 53:
	=== Testing Instructions ===		=== Testing Instructions ===

	''Note: ~~The nightly builds will still be branded with Bon Echo.~~ The release builds will be branded Firefox.''		''Note: The release candidate builds will be branded Firefox.''

	Follow these instructions:		Follow these instructions:

	# Download a Bon Echo build from the nightly directory: ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/~~latest~~-~~mozilla1~~.8		# Download a Bon Echo build from the nightly directory: (Windows, Linux) ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/2.0b2-candidates/rc1
			(Mac) ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/2.0b2-candidates/rc2
	# Go to [http://litmus.mozilla.org Litmus] and run the FF2.0 Full Functional Tests for Tabbed browsing. (link to more on litmus)		# Go to [http://litmus.mozilla.org Litmus] and run the FF2.0 Full Functional Tests for Tabbed browsing. (link to more on litmus)

Jbecerra: /* What build should I test? */

2006-08-23T23:25:40Z

What build should I test?

← Older revision		Revision as of 23:25, 23 August 2006
Line 31:		Line 31:
	=== What build should I test? ===		=== What build should I test? ===

	We will be testing the ~~Bon Echo nightly~~ candidate builds:		We will be testing the Firefox 2.0beta2 release candidate builds:

	'''Firefox (Windows, Linux):''' http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/2.0b2-candidates/rc1/		'''Firefox (Windows, Linux):''' http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/2.0b2-candidates/rc1/

Jbecerra: /* What build should I test? */

2006-08-23T23:20:46Z

What build should I test?

← Older revision		Revision as of 23:20, 23 August 2006
Line 5:		Line 5:
	When you are done, please send feedback to [mailto:testday@mozilla.org testday@mozilla.org] or post significant findings to the Mozilla QA blog (http://weblogs.mozillazine.org/qa/). We are very interested to hear about how the test day went, any overall thoughts about Bon Echo, and roll up of issues found and bugs filed.		When you are done, please send feedback to [mailto:testday@mozilla.org testday@mozilla.org] or post significant findings to the Mozilla QA blog (http://weblogs.mozillazine.org/qa/). We are very interested to hear about how the test day went, any overall thoughts about Bon Echo, and roll up of issues found and bugs filed.

	The official time for the test day is '''Friday, August 11, 2006, from 7am - 5pm PDT''', but anyone can jump on Litmus at any time on any day!		The official time for the test day is '''Friday, August 25, 2006, from 7am - 5pm PDT''', but anyone can jump on Litmus at any time on any day!

	''For more information about this release, please check out the [[Firefox2 \| Bon Echo wiki]]. You will find the current schedule, test plan, and specific areas we can use help testing.''		''For more information about this release, please check out the [[Firefox2 \| Bon Echo wiki]]. You will find the current schedule, test plan, and specific areas we can use help testing.''
Line 33:		Line 33:
	We will be testing the Bon Echo nightly candidate builds:		We will be testing the Bon Echo nightly candidate builds:

	'''Firefox:''' http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/~~latest~~-~~mozilla1~~.8		'''Firefox (Windows, Linux):''' http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/2.0b2-candidates/rc1/

			'''Firefox (Mac):'''
			http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/2.0b2-candidates/rc2/

	=== What specifically will we be testing? ===		=== What specifically will we be testing? ===

Jbecerra: /* Results */

2006-08-23T23:13:35Z

Results

← Older revision		Revision as of 23:13, 23 August 2006
Line 5:		Line 5:
	When you are done, please send feedback to [mailto:testday@mozilla.org testday@mozilla.org] or post significant findings to the Mozilla QA blog (http://weblogs.mozillazine.org/qa/). We are very interested to hear about how the test day went, any overall thoughts about Bon Echo, and roll up of issues found and bugs filed.		When you are done, please send feedback to [mailto:testday@mozilla.org testday@mozilla.org] or post significant findings to the Mozilla QA blog (http://weblogs.mozillazine.org/qa/). We are very interested to hear about how the test day went, any overall thoughts about Bon Echo, and roll up of issues found and bugs filed.

	The official time for the test day is '''Friday, August 25, 2006, from 7am - 5pm PDT''', but anyone can jump on Litmus at any time on any day!		The official time for the test day is '''Friday, August 11, 2006, from 7am - 5pm PDT''', but anyone can jump on Litmus at any time on any day!

	''For more information about this release, please check out the [[Firefox2 \| Bon Echo wiki]]. You will find the current schedule, test plan, and specific areas we can use help testing.''		''For more information about this release, please check out the [[Firefox2 \| Bon Echo wiki]]. You will find the current schedule, test plan, and specific areas we can use help testing.''

Jbecerra: /* Welcome to the Bon Echo Community Test Day! */

2006-08-23T23:13:30Z

Welcome to the Bon Echo Community Test Day!

Show changes

Jbecerra at 23:12, 23 August 2006

2006-08-23T23:12:34Z

New page

= Welcome to the Bon Echo Community Test Day! =

Thank you for participating in this test day. The success of Firefox and Thunderbird is heavily dependent on community members like you. We appreciate your support!

When you are done, please send feedback to [mailto:testday@mozilla.org testday@mozilla.org] or post significant findings to the Mozilla QA blog (http://weblogs.mozillazine.org/qa/). We are very interested to hear about how the test day went, any overall thoughts about Bon Echo, and roll up of issues found and bugs filed.

The official time for the test day is '''Friday, August 11, 2006, from 7am - 5pm PDT''', but anyone can jump on Litmus at any time on any day!

''For more information about this release, please check out the [[Firefox2 | Bon Echo wiki]]. You will find the current schedule, test plan, and specific areas we can use help testing.''

== FAQ ==

=== Where do I start? ===
* Open up your [http://www.ircreviews.org/clients/ favorite IRC client]:
** [http://www.ircreviews.org/clients/platforms-windows.html Windows clients]
** [http://www.ircreviews.org/clients/platforms-macos.html MacOS clients]
** [http://www.ircreviews.org/clients/platforms-unix.html Linux clients]
** [https://addons.mozilla.org/firefox/16/ ChatZilla (Firefox extension)] - ''Note: If you are using ChatZilla you must also close ChatZilla for Firefox to fully restart. Workaround is to run [http://chatzilla.rdmsoft.com/xulrunner/ Chatzilla on XULRunner] ([http://forums.mozillazine.org/viewtopic.php?t=377580 Windows installer]) or run a version of Mozilla Suite and use the built in ChatZilla program from there - that way you are always online when you have to restart.''

* Connect to [irc://irc.mozilla.org irc.mozilla.org]
* Join the #testday channel

'''Other Options of if you don't use IRC:
'''
*Use Instant Messenger - http://www.aim.com/. A moderator will be online under the screen name "MozillaTestDay". Please send your screenname to [mailto:marcia@mozilla.org marcia@mozilla.org] before the test day so you can be invited to the chatroom, or just message "MozillaTestDay" during the day to figure out what to do.

=== OK, I am in the channel, now what? ===

Let the moderators know if you have any questions or encounter any problems. If you are not familiar with our [https://bugzilla.mozilla.org/index.cgi bugzilla bug tracking system], feel free to report your problems to a moderator and they can log any bugs for you.

=== What build should I test? ===

We will be testing the Bon Echo nightly candidate builds:

'''Firefox:''' http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/latest-mozilla1.8

=== What specifically will we be testing? ===

We will be testing the new tabbed browsing features that will be in Firefox 2. A quick overview of the new features:
* '''Tab overflow''' - now when a lot of tabs are open, scroll buttons appear on the left and right side of the tab bar allowing you to scroll through tabs.
* '''All Tabs button''' - a button that shows on the right side of the tab bar that lists all open tabs.
* '''Close button on tabs''' - instead of having the close button on the right side of the tab bar, now close buttons are on each individual tabs.
* '''Warn if closing too many tabs''' - now if you try to open too many tabs at once (more than 15), you will be asked if you want to open those tabs.
* '''Tab focusing behavior''' - when you open a new tab from a link on a page and then close that tab, you will go back to the page the tab was opened from

Existing open bugs:

*Tabbed browsing bugs: http://tinyurl.com/q549h

=== Testing Instructions ===

''Note: The nightly builds will still be branded with Bon Echo. The release builds will be branded Firefox.''

Follow these instructions:

# Download a Bon Echo build from the nightly directory: ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/latest-mozilla1.8
# Go to [http://litmus.mozilla.org Litmus] and run the FF2.0 Full Functional Tests for Tabbed browsing. (link to more on litmus)

Some other ways you can help:

* Think of some test cases that aren't already included in Litmus (we love suggestions!).
* Do some exploratory testing with tabbed browsing. Do a combination of things to try to explore the feature fully.

=== Where do I find Litmus? ===

* Go to the [http://litmus.mozilla.org/ Litmus start page].
* [http://litmus.mozilla.org/login.cgi Log in] or [http://litmus.mozilla.org/login.cgi create an account] if you don't already have one and then select [http://litmus.mozilla.org/run_tests.cgi run tests].
* Enter the appropriate information and click Submit.
* Choose a test group and then a subgroup and then click Submit to start testing!

Tips:
* Make sure you enter the correct information for your platform, version of Firefox, etc.
* Feel free to ask on IRC or AIM if you need help or have any questions.

=== Who will be moderating the #testday channel? ===
The moderator's nicks for this test day will be:
* tracy
* bc
* marcia
* juanb
* coop
* alice
* mw22
* ispiked

=== How do I file bugs? ===
First of all, let one of the moderators know so they can check if it is already a known problem. Then they can guide you to either provide more details, [https://bugzilla.mozilla.org/index.cgi update an existing bug or file a new bug].

If filing a new bug, please do a quick check to see if the bug already exists. This can easily be done by searching for the error message, window name, or some over identifing feature of the bug.

In the case of any testing endeavor, it is important to include the list of extensions that you have installed since they can often cause strange issues to crop up.

=== How do I send feedback? ===
Please use the [mailto:testday@mozilla.org testday@mozilla.org] to send feedback about how the testday went, any overall thoughts about Bon Echo, and roll up of issues found and bugs filed. We really appreciate your help today and your feedback is very valuable.

=== Rewards for this Test Day ===
The top 5 testers will all earn $25 gift certificates to amazon.com. If you are located outside of the U.S, you will be awarded a $25 gift certificate to the Mozilla Store.

== Results ==

=== Total Test Results By Locale ===
{| border="1" cellpadding="2"
! style="background:#efefef" | '''Locale'''
! style="background:#efefef" | '''# Results'''
|-
| en-US
| 470
|-
| pl
| 39
|}

=== Total Test Results By Platform ===

{| border="1" cellpadding="2"
! style="background:#efefef" | '''Platform'''
! style="background:#efefef" | '''# Results'''
|-
| Windows
| 359
|-
| Linux
| 122
|-
| Mac
| 28
|}

=== Total Test Results By Result Status ===

{| border="1" cellpadding="2"
! style="background:#efefef" | '''Result Status'''
! style="background:#efefef" | '''# Results'''
|-
| Pass
| 499
|-
| Fail
| 7
|-
| Test unclear/broken
| 3
|}

=== Total Test Results By Subgroup ===
{| border="1" cellpadding="2"
! style="background:#efefef" | '''Subgroup'''
! style="background:#efefef" | '''# Results'''
! style="background:#efefef" | '''# Testcases in Subgroup'''
|-
| Firefox:1.5 Full Functional Tests (FFTs):XMLHttpRequest
| 1
| 3
|-
| Firefox:1.5 Full Functional Tests (FFTs):Bookmarks
| 1
| 34
|-
| Firefox:2.0 Basic Functional Tests (BFTs):FX 2.0 - Installation
| 4
| 4
|-
| Firefox:2.0 Basic Functional Tests (BFTs):FX 2.0 - Menu Bar
| 8
| 10
|-
| Firefox:2.0 Basic Functional Tests (BFTs):FX 2.0 - Help
| 2
| 2
|-
| Firefox:2.0 Basic Functional Tests (BFTs):FX 2.0 - Options (Preferences)
| 6
| 5
|-
| Firefox:2.0 Basic Functional Tests (BFTs):FX 2.0 - General
| 29
| 13
|-
| Firefox:2.0 Basic Functional Tests (BFTs):FX 2.0 - Tabbed Browsing
| 202
| 18
|-
| Firefox:2.0 Basic Functional Tests (BFTs):FX 2.0 - Search
| 1
| 11
|-
| Firefox:2.0 Basic Functional Tests (BFTs):FX 2.0 - Bookmarks
| 1
| 14
|-
| Firefox:2.0 Basic Functional Tests (BFTs):RSS
| 7
| 7
|-
| Firefox:2.0 Basic Functional Tests (BFTs):History
| 4
| 4
|-
| Firefox:2.0 Basic Functional Tests (BFTs):FX 2.0 - Technical Tools
| 7
| 9
|-
| Firefox:2.0 Basic Functional Tests (BFTs):Security and Certs
| 2
| 3
|-
| Firefox:2.0 Basic Functional Tests (BFTs):Import
| 1
| 1
|-
| Firefox:2.0 Basic Functional Tests (BFTs):Uninstall
| 2
| 2
|-
| Firefox:2.0 Full Functional Tests (FFTs):FX 2.0 - Installation
| 4
| 8
|-
| Firefox:2.0 Full Functional Tests (FFTs):FX 2.0 - Menu Bar
| 8
| 10
|-
| Firefox:2.0 Full Functional Tests (FFTs):FX 2.0 - Help
| 6
| 7
|-
| Firefox:2.0 Full Functional Tests (FFTs):FX 2.0 - Options (Preferences)
| 8
| 13
|-
| Firefox:2.0 Full Functional Tests (FFTs):FX 2.0 - General
| 26
| 10
|-
| Firefox:2.0 Full Functional Tests (FFTs):FX 2.0 - Location Bar & Autocomplete
| 1
| 4
|-
| Firefox:2.0 Full Functional Tests (FFTs):FX 2.0 - Tabbed Browsing
| 412
| 40
|-
| Firefox:2.0 Full Functional Tests (FFTs):FX 2.0 - Search
| 1
| 18
|-
| Firefox:2.0 Full Functional Tests (FFTs):FX 2.0 - Bookmarks
| 1
| 33
|-
| Firefox:2.0 Full Functional Tests (FFTs):Microsummaries
| 6
| 6
|-
| Firefox:2.0 Full Functional Tests (FFTs):RSS
| 5
| 18
|-
| Firefox:2.0 Full Functional Tests (FFTs):Security and Certs
| 2
| 9
|-
| Firefox:2.0 Full Functional Tests (FFTs):Import
| 1
| 4
|-
| Firefox:2.0 Full Functional Tests (FFTs):Top Sites
| 3
| 9
|-
| Firefox:2.0 Full Functional Tests (FFTs):XMLHttpRequest
| 4
| 4
|-
| Firefox:2.0 Full Functional Tests (FFTs):FX 2.0 - Technical Tools
| 7
| 9
|-
| Firefox:2.0 Smoketests:FX 2.0 - Install and Startup
| 4
| 4
|-
| Firefox:2.0 Smoketests:FX 2.0 - Functionality
| 45
| 27
|-
| Firefox:2.0 Surf's Up - A Fun Smoketest!:Common Operations
| 1
| 3
|}

=== Top Testers ===

{| border="1" cellpadding="2"
! style="background:#efefef" | '''Tester'''
! style="background:#efefef" | '''# Results'''
|-
| Bobby
| 103
|-
| jpozlovsky
| 86
|-
| mkairys
| 81
|-
| stevee
| 45
|-
| staszyna
| 39
|-
| LonelyBob
| 39
|-
| ctalbert
| 39
|-
| juanb
| 28
|-
| easic
| 22
|-
| halabund
| 18
|-
| jimjames
| 8
|-
| Komarq
| 1
|}

=== Result Status Breakdown By Tester ===

{| border="1" cellpadding="2"
! style="background:#efefef" | '''Tester'''
! style="background:#efefef" | '''Pass'''
! style="background:#efefef" | '''Fail'''
! style="background:#efefef" | '''Unclear'''
|-
| Bobby
| 102
| 1
| 0
|-
| Komarq
| 1
| 0
| 0
|-
| LonelyBob
| 39
| 0
| 0
|-
| ctalbert
| 39
| 0
| 0
|-
| easic
| 22
| 0
| 0
|-
| halabund
| 17
| 1
| 0
|-
| jimjames
| 8
| 0
| 0
|-
| jpozlovsky
| 80
| 4
| 2
|-
| juanb
| 28
| 0
| 0
|-
| mkairys
| 81
| 0
| 0
|-
| staszyna
| 38
| 0
| 1
|-
| stevee
| 44
| 1
| 0
|}