QA/Firefox3/TestResults/M10: Difference between revisions

 
(40 intermediate revisions by 4 users not shown)
Line 9: Line 9:
* [http://wiki.mozilla.org/QA/Firefox3/TestResults/M10/Updates Update snippets Test Results]
* [http://wiki.mozilla.org/QA/Firefox3/TestResults/M10/Updates Update snippets Test Results]
* [http://wiki.mozilla.org/QA/Firefox3/TestResults/M10/L10N L10n Spotchecks Test Results]
* [http://wiki.mozilla.org/QA/Firefox3/TestResults/M10/L10N L10n Spotchecks Test Results]
* [http://wiki.mozilla.org/QA/Firefox3/TestPlan/UIAccessibility#Schedule.2Fmilestones Accessibility Test Results]
* [[QA/Firefox3/TestResults/M10/Testday|Beta 2 Testday Results]]
* [[QA/Firefox3/TestResults/M10/Testday|Beta 2 Testday Results]]


Line 23: Line 24:
* signed win32 en-us & l10n 12/12
* signed win32 en-us & l10n 12/12


;QA test signoff: ETA 12/20
;QA test signoff: ETA 12/18
* Smoketests, BFTs - 12/10 to 12/13 (3 testers)
* Smoketests, BFTs - 12/10 to 12/13 (3 testers)
** Smoketest '''Completed'''
** Smoketest '''100% Completed'''
** BFTs ''' 85% done.  vista and leopard remain'''
** BFTs ''' 100% Completed'''
* Mem Leaks tests - 12/13 (1 tester)
* Mem Leaks tests - 12/13 (1 tester)
** '''Completed with smoketests'''
** '''100% Completed with smoketests'''
* Top Extensions tests - 12/13 (2 testers)
* Top Extensions tests - 12/13 (2 testers)
**'''In Progress. 35% done.'''
**'''100% Completed.'''
* Bug Verifications - 12/13 - 12/14 (4 testers)
* Bug Verifications - 12/13 - 12/14 (4 testers)
**'''In Progress. 60% done'''  
**'''In Progress. 65% done'''  
* Full Testday - 12/14 (3 testers)
* Full Testday - 12/14 (community)
**'''In Progress.'''
**'''100% Completed'''
* L10n, Accessibility - 12/17 to 12/18 (2 testers + 1 accessibility tester)
* L10n, Accessibility - 12/17 to 12/18 (2 testers + 1 accessibility tester)
** Accessibility '''100% Completed'''
** Accessibility '''100% Completed'''
** L10n '''20% done'''
** L10n '''100% done'''
* Updates tests - 12/19 (3 testers)
* Updates tests - 12/18 (3 testers)
** '''30% done'''
** '''100% completed on betatest channel''' 
** '''100% completed on releasetest channel'''
** '''100% completed on beta channel'''
* Release notes, websites - 12/20 (2 testers)
* Release notes, websites - 12/20 (2 testers)
** '''In progress.  dependent on web team'''
** '''100% completed'''
;Beta 2 Live: ETA 12/21
;Beta 2 Live: ETA 12/19


== Release Notes ==  
== Release Notes ==  
Line 97: Line 100:
| BFT
| BFT
| Tomcat (running leak tests) - '''PASS'''  
| Tomcat (running leak tests) - '''PASS'''  
| Tomcat (running leak tests) - '''result. include Vista Litmus Test Suite''' in Progress
| Tomcat (running leak tests) - '''PASS. include Vista Litmus Test Suite''' '''PASS'''
| Tracy - '''PASS'''
| Tracy - '''PASS'''
| Marcia - '''PASS for BFT. Still running Leopard Litmus Test Suite'''   
| Marcia - '''PASS. Include Leopard Litmus Test Suite'''   
| Tomcat (running leak tests) - '''PASS'''
| Tomcat (running leak tests) - '''PASS'''
|-
|-
| Top Extensions Testing (see below)
| Top Extensions Testing (see below)
| Abillings - '''result'''
| Abillings - '''PASS'''
| N/A  
| N/A  
| Abillings - '''result'''
| Abillings - '''PASS'''
| N/A
| N/A
| Tracy - '''PASS'''  
| Tracy - '''PASS'''  
|-
|-
| Updates Testing (see below)
| Updates Testing (see below)
| Tomcat - '''result'''
| Tomcat - '''Pass'''
| Marcia - '''result'''
| Marcia - '''Pass'''
| Tomcat - '''result'''
| Tomcat - '''Pass'''
| Marcia - '''result'''
| Marcia - '''Pass'''
| Tchung - '''result'''  
| Tchung - '''Pass'''  
|-
|-
| l10N Pri 1 locales
| l10N Pri 1 locales
| Tracy (nl, fi, it) - '''result''' - Tomcat (de, pa-IN) '''result'''  
| Tomcat/Tracy (nl, fi, it) - '''pass''' - Tomcat (de, pa-IN) '''PASS'''  
| N/A  
| N/A  
| Tchung (ja-JP, es-ES, pa-IN, zh-CN) - '''PASS'''
| Tchung (ja-JP, es-ES, pa-IN, zh-CN) - '''PASS'''
| N/A
| N/A
| Tracy (fr, zh-CN) - '''results'''
| Tracy (fr, zh-CN) - '''PASS'''
|-
|-
| Accessibility (see below)
| Accessibility (see below)
Line 151: Line 154:
* Switch profiles with different extensions, and confirm they do not get carried over.
* Switch profiles with different extensions, and confirm they do not get carried over.


[[QA/Firefox3/TestResults/M10/Top Extensions|Extensions Test Results]] - '''result'''
[[QA/Firefox3/TestResults/M10/Top Extensions|Extensions Test Results]] - '''PASS'''


=== Updates Testing ===
=== Updates Testing ===
Line 158: Line 161:
Will be available on ''betatest'', ''releasetest'', and ''beta'' channels
Will be available on ''betatest'', ''releasetest'', and ''beta'' channels


* Betatest channel - '''result'''
* Betatest channel - '''PASS'''
* Releasetest channel - '''result'''
* Releasetest channel - '''PASS'''
* Beta channel (live) - '''result'''
* Beta channel (live) - '''PASS'''


Testcases and Results are tracked [http://wiki.mozilla.org/QA/Firefox3/TestResults/M10/Updates here].
Testcases and Results are tracked [http://wiki.mozilla.org/QA/Firefox3/TestResults/M10/Updates here].
Line 179: Line 182:
P1 Locales to be tested:
P1 Locales to be tested:
* '''UPDATE - not ready''' <del>English (en-GB) '''Result'''</del>
* '''UPDATE - not ready''' <del>English (en-GB) '''Result'''</del>
* French (fr) '''Result'''
* French (fr) '''PASS'''
* Chinese (zh-CN) '''Result'''
* Chinese (zh-CN) '''PASS'''
* German (de) '''Result'''
* German (de) '''PASS'''
* Japanese (ja) '''Result'''
* Japanese (ja) '''PASS'''
* Spanish (es-ES) '''Result'''
* Spanish (es-ES) '''PASS'''
* Netherlands (nl) '''Result'''
* Netherlands (nl) '''PASS'''
* Italian (it) '''Result'''
* Italian (it) '''PASS'''
* Finnish (fi) '''Result'''
* Finnish (fi) '''PASS'''
* Indian (pa-IN) '''Result'''
* Indian (pa-IN) '''PASS'''


I put all the beta1 available P1's through a Minotaur check against 2.0.0.9. That looked good; nothing glaringly bad jumped out at me. However, I need to get those files loaded up somewhere so Axel and Mic can have a look.  
I put all the beta1 available P1's through a Minotaur check against 2.0.0.9. That looked good; nothing glaringly bad jumped out at me. However, I need to get those files loaded up somewhere so Axel and Mic can have a look.  
Line 198: Line 201:
* Frontend bugs: http://tinyurl.com/2b39gs - '''Result'''
* Frontend bugs: http://tinyurl.com/2b39gs - '''Result'''
* Platform bugs: http://tinyurl.com/2d9akf - '''Result'''
* Platform bugs: http://tinyurl.com/2d9akf - '''Result'''
=== Testday ===
A beta 2 testday will be held and call for the community support to assist with testing.  Activities include executing litmus testcases, bug verifications, and focus on the new feature areas that are being implemented.  More can be found at the [http://quality.mozilla.org/en/node/1131 QMO post].
Testday results are posted [http://wiki.mozilla.org/QA/Firefox3/TestResults/M10/Testday here].


== <FONT COLOR = "RED">Detailed Results </FONT> ==
== <FONT COLOR = "RED">Detailed Results </FONT> ==
Line 214: Line 222:
** Windows XP '''PASS'''
** Windows XP '''PASS'''
*** Build ID : Build ID: Mozilla/5.0 Windows; U; Windows NT 5.1; en-US; rv:1.9b2) Gecko/2007121120
*** Build ID : Build ID: Mozilla/5.0 Windows; U; Windows NT 5.1; en-US; rv:1.9b2) Gecko/2007121120
** Windows Vista
*** Build id: #  Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9b2) Gecko/2007121120 Firefox/3.0b2 '''PASS'''
**** Bugs filed :  
**** Bugs filed :  
* {{Bug|407229}} Breakpad fails to send on Fedora F8
* {{Bug|407229}} Breakpad fails to send on Fedora F8
Line 220: Line 230:
* {{Bug|407192}} Comment added to NS_ERROR_XPC_JS_THREW_STRING error in console when dragging bookmark from URL bar to toolbar
* {{Bug|407192}} Comment added to NS_ERROR_XPC_JS_THREW_STRING error in console when dragging bookmark from URL bar to toolbar
* {{Bug|407988}} Windows Firefox 3 Beta 2 Builds broken !
* {{Bug|407988}} Windows Firefox 3 Beta 2 Builds broken !
* {{Bug|408443}}Update from Gran Paradiso Alpha 2, Alpha 3, and Alpha 4 -> FF Beta 2 cause [Exception... "Component returned failure code: 0x80004005 (NS_ERROR_FAILURE) [nsIDocShellHistory.useGlobalHistory]


===Tchung Results===
===Tchung Results===
Line 227: Line 238:
*** Status : '''PASS''' Results in Litmus
*** Status : '''PASS''' Results in Litmus
* {{Bug|408092}} - Crash Reporter window is missing text for "Include URL in crash report".  This is for pa-IN.  minor bug.
* {{Bug|408092}} - Crash Reporter window is missing text for "Include URL in crash report".  This is for pa-IN.  minor bug.
* {{Bug|408313}} - Places folder exist in Bookmark toolbar after updating b1 -> b2Filed during update testing.
* {{Bug|381357}} - FR locale fails to load default RSS feedsStill investigating if its a build problem or the feed site is down.


===marcia Results===
===marcia Results===
Line 243: Line 254:


* Issues noted
* Issues noted
** At times my Error Console would fill quickly when loading certain sites. ebay.com was one example I would get this error all the time: Error: uncaught exception: [Exception... "Access to property denied"  code: "1010" nsresult: "0x805303f2 (NS_ERROR_DOM_PROP_ACCESS_DENIED)"  location: "<unknown>"]. The same error was generated for lots of other sites.
** At times my Error Console would fill quickly when loading certain sites. ebay.com was one example I would get this error all the time: Error: uncaught exception: [Exception... "Access to property denied"  code: "1010" nsresult: "0x805303f2 (NS_ERROR_DOM_PROP_ACCESS_DENIED)"  location: "<unknown>"]. The same error was generated for lots of other sites. {{Bug|314787}} is the only bug in Bugzilla I could find that included the error, but I got enough of them with sites such as espn.go.com that it was very noticeable. I filed a new bug to address this error - you can see it below in my list of bugs.


*Bugs filed :  
*Bugs filed :  
Line 252: Line 263:
** {{Bug|408281}} onxblclick exception in Error Console during work in Places Organizer.
** {{Bug|408281}} onxblclick exception in Error Console during work in Places Organizer.
** {{Bug|408426}} Website content not shown - "x-pointplus" is not "text/css" error
** {{Bug|408426}} Website content not shown - "x-pointplus" is not "text/css" error
** {{Bug|408432}} Unable to add a security exception to this page
** {{Bug 408852}} Many instances of NS_ERROR_DOM_PROP_ACCESS_DENIED in console when loading espn.go.com


*Bugs Noted that are problematic
*Bugs Noted that are problematic
Line 261: Line 274:


*Bugs Specific to the proto theme
*Bugs Specific to the proto theme
**With Proto 0.8.2, if you switch to Error Console or Add Ons the Firefox app is minimized and the dialog is shown by itself. This does not happen using the default theme.
**With Proto 0.8.2, if you switch to Error Console or Add Ons the Firefox app is minimized and the dialog is shown by itself. This does not happen using the default theme. Please see https://bugzilla.mozilla.org/show_bug.cgi?id=397723#c176
 
*Wanted for Final
**{{Bug|400296}}
**{{Bug|390568}} Crash reporter fails to submit on Vista
 
*Icon Issues Noted
**I added a comment to the Bug Tracking icon changes. The update icon in the add ons manager displays in a very poor resolution. I want to make sure it doesn't get missed as part of the visual refresh.
 
*Tab Switching Results: Leopard Beta w2 versus Leopard Bon Echo nightly
**http://wiki.mozilla.org/QA/Firefox3/TestPlan/Tab_Switching


===Marcoz results===
===Marcoz results===
Known issues (these should be folded into the release notes):
Known issues (these should be folded into the release notes):
* Various issues with popups like the new AutoComplete popup on the location bar, the Add Bookmarks dialog (CTRL+D), the Download Manager's Info button. Some screen readers get confused by these panels announcing themselves as "menu". This issue is dealt with in bug bug 407359, but only for beta 3.
* {{bug|407359}} - Various issues with popups like the new AutoComplete popup on the location bar, the Add Bookmarks dialog (CTRL+D), the Download Manager's Info button. Some screen readers get confused by these panels announcing themselves as "menu". This issue is dealt with in the bug, but only for beta 3.
* Larry UI not keyboard accessible. This will also be dealt with in bug 407359.
* {{bug|407359}} - Larry UI not keyboard accessible. This will also be dealt with in .
* Site button has no keyboard shortcut, have to use Tools/Page Info dialog, Security and Privacy tab to get info.
* Site button has no keyboard shortcut, have to use Tools/Page Info dialog, Security and Privacy tab to get info.


Confirmed users
6,361

edits