MozillaWiki

QA/Firefox3/TestResults/M9: Difference between revisions

Page Discussion

QA/Firefox3/TestResults/M9 (view source)

Revision as of 07:09, 20 November 2007

468 bytes removed ,  20 November 2007
→‎Live Spot Checks for M9
 
(27 intermediate revisions by 6 users not shown)
Line 1: Line 1:
<small>[[MozillaQualityAssurance:Home_Page:Firefox_3.0_TestPlan|Back to QA Fx3 Home]]</small>
<small>[[QA/Firefox3/TestResults|&laquo; QA/Firefox3/TestResults]]</small>


= Firefox 3 M9 Test Results =
= Firefox 3 M9 Test Results =


== Nightly Smoke Test Results on 11/6/2007 ==
== Related Pages ==
[http://wiki.mozilla.org/index.php?title=MozillaQualityAssurance:Home_Page:Firefox_3.0_TestPlan:M9_Results:11062007_SmokeTest_Results Test Results] from the nightly smoke test before the official M9 builds.
Most of these pages are linked below in this document.
 
* [[QA/Firefox3/TestResults/M9/20071106-SmokeTests|Smoketests from 2007-11-06]]
* [[QA/Firefox3/TestResults/M9/Release Notes|Wishlist of Release Notes for M9]]
* [[QA/Firefox3/TestResults/M9/Top Extensions|Extensions Test Results]]
* [[QA/Firefox3/TestResults/M9/L10N|L10n Spotchecks]]
* [[QA/Firefox3/TestResults/M9/Leopard|Leopard & Mac Testing]]
* [[QA/Firefox3/TestResults/M9/Smoketests|RC3 Smoketest Results]]
* [[QA/Firefox3/TestResults/M9/Testday|Results from test days]]


== Contact Info ==  
== Contact Info ==  
Line 16: Line 24:


== Release Notes ==  
== Release Notes ==  
* [http://wiki.mozilla.org/index.php?title=MozillaQualityAssurance:Home_Page:Firefox_3.0_TestPlan:M9_Results:Release_Notes QA Release notes] wishlist for M9
* [[QA/Firefox3/TestResults/M9/Release Notes|Wishlist of Release Notes for M9]]


== Build Location and IDs ==
== Build Location and IDs ==
RC1:
[http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/1.9b1-candidates/rc1/ RC1 builds]
* Mac/Linux builds: http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/1.9b1-candidates/rc1/
 
* Windows builds: http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/1.9b1-candidates/rc1/unsigned/
------
* Mac Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9b1) Gecko/2007110618 Firefox/3.0b1
* Mac Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9b1) Gecko/2007110618 Firefox/3.0b1
* Vista Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9b1) Gecko/2007110703 Firefox/3.0b1
* Vista Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9b1) Gecko/2007110703 Firefox/3.0b1
* XP Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9b1) Gecko/2007110703 Firefox/3.0b1
* XP Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9b1) Gecko/2007110703 Firefox/3.0b1
* Linux Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9b1) Gecko/2007110618 Firefox/3.0b1
* Linux Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9b1) Gecko/2007110618 Firefox/3.0b1
RC2:
* Mac/Linux builds: http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/1.9b1-candidates/rc2/
* Windows builds: http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/1.9b1-candidates/rc2/unsigned/
------
------
* Mac Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9b1)Gecko/2007110810 Firefox/3.0b1
[http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/1.9b1-candidates/rc3/ RC3 builds]
* Vista Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9b1)Gecko/2007110811 Firefox/3.0b1
* XP Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9b1)Gecko/2007110811 Firefox/3.0b1
* Linux Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9b1) Gecko/2007110810 Firefox/3.0b1


RC3:
* Mac/Linux builds: http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/1.9b1-candidates/rc3/
* Windows builds: http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/1.9b1-candidates/rc3/unsigned/
------
* Mac Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9b1) Gecko/2007110903 Firefox/3.0b1  
* Mac Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9b1) Gecko/2007110903 Firefox/3.0b1  
* Vista Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9b1) Gecko/2007110904 Firefox/3.0b1
* Vista Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9b1) Gecko/2007110904 Firefox/3.0b1
* Linux Build Id: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9b1) Gecko/2007110903 Firefox/3.0b1  
* Linux Build Id: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9b1) Gecko/2007110903 Firefox/3.0b1  
 
* XP Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9b1) Gecko/2007110904 Firefox/3.0b1
* XP Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9b1)
Gecko/2007110904 Firefox/3.0b1


== Features landed ==  
== Features landed ==  
Line 100: Line 90:
| Tomcat - '''PASS'''
| Tomcat - '''PASS'''
| Tomcat (partial) - '''PASS'''  
| Tomcat (partial) - '''PASS'''  
| Tchung - '''in progress - 70% complete'''
| Tchung - '''PASS'''
| Marcia - '''in progress, 60% complete'''
| Marcia - '''PASS'''
| Tomcat - '''PASS'''
| Tomcat - '''PASS'''
|-
|-
Line 107: Line 97:
| Juanb - '''PASS''' <BR> bc (automation) - '''[http://bclary.com/log/2007/11/06/assert.htm results]'''
| Juanb - '''PASS''' <BR> bc (automation) - '''[http://bclary.com/log/2007/11/06/assert.htm results]'''
| N/A  
| N/A  
| Juanb - '''in-progress'''
| Juanb - '''PASS'''
| N/A
| N/A
| bc (automation) - '''[http://bclary.com/log/2007/11/06/assert.htm results]'''
| bc (automation) - '''[http://bclary.com/log/2007/11/06/assert.htm results]'''
|-
|-
| Top Extensions Testing (see below)
| Top Extensions Testing (see below)
| Abillings - '''RESULT'''
| Abillings - '''PASS'''
| N/A  
| N/A  
| Abillings - '''RESULT'''
| Abillings - '''PASS'''
| N/A
| N/A
| Tracy - '''PASS''' (only Adblock Plus and Gmail nofication compatible)
| Tracy - '''PASS''' (only Adblock Plus and Gmail nofication compatible)
Line 126: Line 116:
|-
|-
| l10N Pri 1 locales
| l10N Pri 1 locales
| Tracy (de, en-GB, pl, fr) - '''RESULT''' - Tomcat (DE) '''PASS''' (one regression found, see results)
| Tracy (de, en-GB, pl, fr) - '''PASS, en-GB is n/a''' - Tomcat (DE) '''PASS''' (one regression found, see results)
| N/A  
| N/A  
| Tchung (ja, es-ES) - '''PASS'''
| Tchung (ja, es-ES) - '''PASS'''
Line 133: Line 123:
|-
|-
| Bug Verifications
| Bug Verifications
| Everyone
| Everyone - '''PASS'''
| Everyone
| Everyone - '''PASS'''
| Everyone
| Everyone - '''PASS'''
| Everyone
| Everyone - '''PASS'''
| Everyone
| Everyone - '''PASS'''
|}
|}


Line 151: Line 141:
** Yahoo Mail not working on Fx3: [https://bugzilla.mozilla.org/show_bug.cgi?id=398381 Bug 398381]
** Yahoo Mail not working on Fx3: [https://bugzilla.mozilla.org/show_bug.cgi?id=398381 Bug 398381]
** aol.com has a layout problem [https://bugzilla.mozilla.org/show_bug.cgi?id=396821 bug 396821]
** aol.com has a layout problem [https://bugzilla.mozilla.org/show_bug.cgi?id=396821 bug 396821]
* [http://wiki.mozilla.org/MozillaQualityAssurance:Home_Page:Firefox_3.0_TestPlan:Fx3_QA_Banking banking financial institutions]
* [[QA/Firefox3/TestPlan/Banking|Banking and financial institutions]]
** '''need a way to coordinate this with the community'''
** '''need a way to coordinate this with the community'''


Line 178: Line 168:
* Switch profiles with different extensions, and confirm they do not get carried over.
* Switch profiles with different extensions, and confirm they do not get carried over.


[[MozillaQualityAssurance:Home_Page:Firefox_3.0_TestPlan:M9_Results:Top_Extensions |Extensions Test Results]]
[[QA/Firefox3/TestResults/M9/Top Extensions|Extensions Test Results]]


=== Top Plugins Testing ===
=== Top Plugins Testing ===
Line 219: Line 209:
I put all the beta1 available P1's through a Minotaur check against 2.0.0.9. That looked good; nothing glaringly bad jumped out at me. However, I need to get those files loaded up somewhere so Axel and Mic can have a look.  
I put all the beta1 available P1's through a Minotaur check against 2.0.0.9. That looked good; nothing glaringly bad jumped out at me. However, I need to get those files loaded up somewhere so Axel and Mic can have a look.  


Testcases and Results are tracked [http://wiki.mozilla.org/MozillaQualityAssurance:Home_Page:Firefox_3.0_TestPlan:M9_Results:l10N_spotchecks here].
Testcases and Results are tracked [[QA/Firefox3/TestResults/M9/L10N]].


=== Bug Verifications ===
=== Bug Verifications ===
Bugs that are marked RESOLVED FIXED that are checked in for beta.  Please verify them.
Bugs that are marked RESOLVED FIXED that are checked in for beta.  Please verify them.


* Frontend bugs: http://tinyurl.com/22whpr  
* Frontend bugs: http://tinyurl.com/22whpr - '''PASS!  Zarro boogs'''
* Platform bugs: http://tinyurl.com/yvqd4u
* Platform bugs: http://tinyurl.com/yvqd4u - '''PASS!  Zarro boogs'''


== <FONT COLOR = "RED">Detailed Results </FONT> ==
== <FONT COLOR = "RED">Detailed Results </FONT> ==
Line 232: Line 222:
* '''UPDATE: dupe of {{Bug|396259}}''' <del>Opened [https://bugzilla.mozilla.org/show_bug.cgi?id=403082 Bug 403083 - new Hotmail interface does not load in Fx3 beta 1].  Not a blocker, but assigned to techevangelism to consult with Microsoft.</del>
* '''UPDATE: dupe of {{Bug|396259}}''' <del>Opened [https://bugzilla.mozilla.org/show_bug.cgi?id=403082 Bug 403083 - new Hotmail interface does not load in Fx3 beta 1].  Not a blocker, but assigned to techevangelism to consult with Microsoft.</del>
* Opened [https://bugzilla.mozilla.org/show_bug.cgi?id=403686 bug 403083 - Search plugins get multi-selected when moving up and down list].  minor bug found when running litmus search FFT.
* Opened [https://bugzilla.mozilla.org/show_bug.cgi?id=403686 bug 403083 - Search plugins get multi-selected when moving up and down list].  minor bug found when running litmus search FFT.
 
* Opened {{Bug|403942}} - Cancelling "add new toolbar" will freeze tab switching functionality.  Nominating for b2 since restoring means force > quitting
;marcia's leopard bugs and problem areas
;marcia's leopard bugs and problem areas
*[http://wiki.mozilla.org/index.php?title=MozillaQualityAssurance:Home_Page:Firefox_3.0_TestPlan:M9_Results_Leopard Leopard Bugs and Mac issues uncovered]
*[[QA/Firefox3/TestResults/M9/Leopard|Leopard Bugs and Mac issues uncovered]]


;Tomcat Results:
;Tomcat Results:
*[http://wiki.mozilla.org/MozillaQualityAssurance:Home_Page:Firefox_3.0_TestPlan:M9_Results:RC3Smoketests RC 3 Results] all '''PASS'''
*[[QA/Firefox3/TestResults/M9/Smoketests|RC 3 Results]] all '''PASS'''


* FFT`s PASS
* FFT`s PASS
** Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9b1) Gecko/2007110904 Firefox/3.0b1  
** Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9b1) Gecko/2007110904 Firefox/3.0b1  
** Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9b1) Gecko/2007110904 Firefox/3.0b1  
** Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9b1) Gecko/2007110904 Firefox/3.0b1  
Focus testing Windows / Windows Vista : '''PASS'''
** Bugs filed:
** Bugs filed:
*** {{bug|403497}} Places Toolbar Folder not renamed when language version is changed
*** {{bug|403497}} Places Toolbar Folder not renamed when language version is changed
Line 251: Line 245:
*** {{bug|392919}}'''Breakpad System itself is broken on Fedora 8 - this should block a beta 2 i guess'''
*** {{bug|392919}}'''Breakpad System itself is broken on Fedora 8 - this should block a beta 2 i guess'''
*** {{bug|403842}} Default RSS Feed (Aktuelle Nachrichten) fails to load on DE Firefox 3 Beta 1 RC - Dupe of Bug [https://bugzilla.mozilla.org/show_bug.cgi?id=381357 381357 ]
*** {{bug|403842}} Default RSS Feed (Aktuelle Nachrichten) fails to load on DE Firefox 3 Beta 1 RC - Dupe of Bug [https://bugzilla.mozilla.org/show_bug.cgi?id=381357 381357 ]
*** {{bug|404081}} "Warn me when i close multiple tabs" Pref can be overridden
*** {{bug|404074}} Clear Private Data Menu is cut off in french firefox 3 beta 1
*** {{bug|403937}} Missing title on Mac for "about Mozilla Firefox" Window


* DE Locale Spot Check - '''PASS''' was running into {{Bug|403842}}, see above
* DE Locale Spot Check - '''PASS''' was running into {{Bug|403842}}, see above
Line 264: Line 262:
;11/9/07 Testday Results
;11/9/07 Testday Results


Full Summary [http://wiki.mozilla.org/MozillaQualityAssurance:Home_Page:Firefox_3.0_TestPlan:M9_Results:TestdayResults here].
Full Summary [[QA/Firefox3/TestResults/M9/Testday|here]].
Highlights:
Highlights:
* 1300 litmus tests by Community
* 1300 litmus tests by Community
Line 276: Line 274:
When we go live at 3 PM it would be great team members could download an M9 build quickly and make sure everything looks ok.
When we go live at 3 PM it would be great team members could download an M9 build quickly and make sure everything looks ok.


*Windows XP -> Tomcat - '''TBD'''
*Windows XP -> abillings - '''PASS'''
*Windows Vista  -> abillings '''TBD'''
*Windows Vista  -> stephend/abillings (en-US, de) - '''PASS'''
*Mac PPC/Intel-> tchung '''TBD'''
*Mac PPC/Intel-> tchung - '''PASS'''
*Mac Leopard -> Marcia
*Mac Leopard -> abillings - '''PASS'''
*Linux -> stephend '''TBD'''
*Linux -> stephend - (en-US/nl) '''PASS'''


== Blocker Bugs for M9 ==
== DevTracking Bugs for M9 ==
Refer to dev-tracking bugs at: [http://tinyurl.com/3d8y8w [M9 firefox]]|[http://tinyurl.com/34xe45 [M9 platform]]
Refer to dev-tracking bugs at: [http://tinyurl.com/3d8y8w [M9 firefox]]|[http://tinyurl.com/34xe45 [M9 platform]]
Abillings
canmove, Confirmed users
4,854

edits

Retrieved from "https://wiki.mozilla.org/Special:MobileDiff/74744...75339"