QA/Firefox3/TestResults/M9/Testday

From MozillaWiki
< QA‎ | Firefox3‎ | TestResults‎ | M9
Jump to: navigation, search

« QA/Firefox3/TestResults/M9

Tracking Page of Results for the Firefox 3 Beta 1 Testdays

Testday 9. November 2007

Testday Moderators

  • QA Team Marcia, Tracy, Tchung, Ctalbert, Stephend, Coop, Tomcat, Juanb and many more
  • Developer : Dietrich, Cbarrett and more

Also a lot of MoCo folks joined the testday and answered questions from the Community.

The Community was very interested in Firefox 3 and asked a lot a of questions.

Many thanks to everyone that made this testday so successful !

Testday Results

Overall:

Platform # Results

  • Windows 960
  • Linux 231
  • Mac (Intel) 76
  • Mac (PPC) 68
  • = 1335 tests from the community

Breakdown by locales

Locale # Results

  • en-US 813
  • de 376
  • fr 67
  • fy-NL 25
  • nl 19
  • es-ES 13
  • be-BY 12
  • fi 5
  • ru 5

A great success for l10n testing since 522 tests were run with l10n builds

Breakdown by result status

Result Status # Results

  • Pass 1211
  • Test unclear/broken 66
  • Fail 58

Note: This 58 failed results are not all bugs. Some are known bugs and some are unclear testcases or tests that no longer work on Firefox 3 Beta 1 because of feature changes. QA is investigating the failed and unclear results to make Litmus better

Over the weekend i started to check the results and so far it seems that no critcal / show stopper was found - Tomcat

Bugs found /bugs confirmed on this testday

  • bug 402316 opening bookmarks folder in tabs opens one bookmark if that bookmark had been hovered
  • bug 403185 Error - Litmus has suffered a serious fatal internal error - Invalid UTF8 from database in column 'steps'
  • bug 403216 New: !!! ASSERTION: Removing item we don't have: 'Not Reached' , file
  • bug 403246 Last line of Anti Phishing Warning Page contains de and en-US text
  • bug 403257 Localized Extension description not maintained when the Add-on is disabled

bug 403231 [10.5] Duplicate / Two "File" Menus (Note: this bug was a dupe, but this Bug in general seems to be blocker for Firefox 3 on 10.5 - tomcat)

-more bugs will added after the failed result triage is completed

General Impression from this testday

From the Community Impression and Feeling, People are excited about Firefox 3 and very impressed by the work that was done so far:

(as example: [23:41] <snerfu> Pretty solid, I spawned 19 tabs containing various youtube videos and fast updating java websites with only 123mb of memory used.)

So i think we are on a good way with Firefox 3 :-) and so lets keep find and fix the rest of open bugs :)


Testday 16 November 2007

Testday Moderators

  • QA Team Marcia, Tchung, Stephend, Tomcat


Testday Results

The Testday Report can also be found here: https://litmus.mozilla.org/testday_report.cgi?testday_id=69. The testday report also including the litmus admins is here : https://litmus.mozilla.org/testday_report.cgi?testday_id=69&include_admin=on

Overall:

Platform # Results

  • Windows 233
  • Linux 198
  • Mac (Intel) 2
  • 433 overall tests !

Breakdown by locales

Locale # Results

  • en-US 334
  • fr 65
  • de 19
  • fi-FI 15


Breakdown by result status

Result Status # Results

  • Pass 402
  • Fail 23
  • Test unclear/broken 8

Note: This 58 failed results are not all bugs. Some are known bugs and some are unclear testcases or tests that no longer work on Firefox 3 Beta 1 because of feature changes. QA is investigating the failed and unclear results to make Litmus better


Bugs found /bugs confirmed on this testday

  • bug 404081 "Warn me when i close multiple tabs" Pref can be overridden
  • bug 404074 Clear Private Data Menu is cut off in french firefox 3 beta 1
  • bug 404102 Pop-up blocker icon remains in status bar until restart
  • bug 402661 crash [@ RtlpCoalesceFreeBlocks][@ XPCWrappedNative::CallMethod(XPCCallContext&, XPCWrappedNative::CallMode)] - we maybe have now steps to reproduce because of this testday !