QA/Firefox3/TestResults/M9/Testday

« QA/Firefox3/TestResults/M9

Testday 9. November 2007

Testday Moderators

• QA Team Marcia, Tracy, Tchung, Ctalbert, Stephend, Coop, Tomcat, Juanb and many more
• Developer : Dietrich, Cbarrett and more

Also a lot of MoCo folks joined the testday and answered questions from the Community.

The Community was very interested in Firefox 3 and asked a lot a of questions.

Many thanks to everyone that made this testday so successful !

Testday Results

• Because of a lot of people in the #testday channel we have started the testday before the regular testday time 7am PST. The Testday Report can also be found here: https://litmus.mozilla.org/testday_report.cgi?testday_id=68. The testday report also including the litmus admins is here : https://litmus.mozilla.org/testday_report.cgi?testday_id=68&include_admin=on

Overall:

Platform # Results

• Windows 960
• Linux 231
• Mac (Intel) 76
• Mac (PPC) 68
• = 1335 tests from the community

Breakdown by locales

Locale # Results

• en-US 813
• de 376
• fr 67
• fy-NL 25
• nl 19
• es-ES 13
• be-BY 12
• fi 5
• ru 5

A great success for l10n testing since 522 tests were run with l10n builds

Breakdown by result status

Result Status # Results

• Pass 1211
• Test unclear/broken 66
• Fail 58

Note: This 58 failed results are not all bugs. Some are known bugs and some are unclear testcases or tests that no longer work on Firefox 3 Beta 1 because of feature changes. QA is investigating the failed and unclear results to make Litmus better

Over the weekend i started to check the results and so far it seems that no critcal / show stopper was found - Tomcat

Bugs found /bugs confirmed on this testday

• bug 402316 opening bookmarks folder in tabs opens one bookmark if that bookmark had been hovered
• bug 403185 Error - Litmus has suffered a serious fatal internal error - Invalid UTF8 from database in column 'steps'
• bug 403216 New: !!! ASSERTION: Removing item we don't have: 'Not Reached' , file
• bug 403246 Last line of Anti Phishing Warning Page contains de and en-US text
• bug 403257 Localized Extension description not maintained when the Add-on is disabled

bug 403231 [10.5] Duplicate / Two "File" Menus (Note: this bug was a dupe, but this Bug in general seems to be blocker for Firefox 3 on 10.5 - tomcat)

-more bugs will added after the failed result triage is completed

General Impression from this testday

From the Community Impression and Feeling, People are excited about Firefox 3 and very impressed by the work that was done so far:

(as example: [23:41] <snerfu> Pretty solid, I spawned 19 tabs containing various youtube videos and fast updating java websites with only 123mb of memory used.)

So i think we are on a good way with Firefox 3 :-) and so lets keep find and fix the rest of open bugs :)

Testday 16 November 2007

Testday Moderators

• QA Team Marcia, Tchung, Stephend, Tomcat

Testday Results

The Testday Report can also be found here: https://litmus.mozilla.org/testday_report.cgi?testday_id=69. The testday report also including the litmus admins is here : https://litmus.mozilla.org/testday_report.cgi?testday_id=69&include_admin=on

Overall:

Platform # Results

• Windows 233
• Linux 198
• Mac (Intel) 2

• 433 overall tests !

Breakdown by locales

Locale # Results

• en-US 334
• fr 65
• de 19
• fi-FI 15

Breakdown by result status

Result Status # Results

• Pass 402
• Fail 23
• Test unclear/broken 8

Note: This 58 failed results are not all bugs. Some are known bugs and some are unclear testcases or tests that no longer work on Firefox 3 Beta 1 because of feature changes. QA is investigating the failed and unclear results to make Litmus better

Bugs found /bugs confirmed on this testday

• bug 404081 "Warn me when i close multiple tabs" Pref can be overridden
• bug 404074 Clear Private Data Menu is cut off in french firefox 3 beta 1
• bug 404102 Pop-up blocker icon remains in status bar until restart
• bug 402661 crash [@ RtlpCoalesceFreeBlocks][@ XPCWrappedNative::CallMethod(XPCCallContext&, XPCWrappedNative::CallMode)] - we maybe have now steps to reproduce because of this testday !