MozillaWiki

QA/Firefox3/TestResults/M9: Difference between revisions

Page Discussion

QA/Firefox3/TestResults/M9 (view source)

Revision as of 07:09, 20 November 2007

871 bytes added ,  20 November 2007
→‎Live Spot Checks for M9
 
(48 intermediate revisions by 9 users not shown)
Line 1: Line 1:
<small>[[MozillaQualityAssurance:Home_Page:Firefox_3.0_TestPlan|Back to QA Fx3 Home]]</small>
<small>[[QA/Firefox3/TestResults|&laquo; QA/Firefox3/TestResults]]</small>


= Firefox 3 M9 Test Results =
= Firefox 3 M9 Test Results =


== Nightly Smoke Test Results on 11/6/2007 ==
== Related Pages ==
[http://wiki.mozilla.org/index.php?title=MozillaQualityAssurance:Home_Page:Firefox_3.0_TestPlan:M9_Results:11062007_SmokeTest_Results Test Results] from the nightly smoke test before the official M9 builds.
Most of these pages are linked below in this document.
 
* [[QA/Firefox3/TestResults/M9/20071106-SmokeTests|Smoketests from 2007-11-06]]
* [[QA/Firefox3/TestResults/M9/Release Notes|Wishlist of Release Notes for M9]]
* [[QA/Firefox3/TestResults/M9/Top Extensions|Extensions Test Results]]
* [[QA/Firefox3/TestResults/M9/L10N|L10n Spotchecks]]
* [[QA/Firefox3/TestResults/M9/Leopard|Leopard & Mac Testing]]
* [[QA/Firefox3/TestResults/M9/Smoketests|RC3 Smoketest Results]]
* [[QA/Firefox3/TestResults/M9/Testday|Results from test days]]


== Contact Info ==  
== Contact Info ==  
Line 16: Line 24:


== Release Notes ==  
== Release Notes ==  
* TBD
* [[QA/Firefox3/TestResults/M9/Release Notes|Wishlist of Release Notes for M9]]


== Build Location and IDs ==
== Build Location and IDs ==
RC1:
[http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/1.9b1-candidates/rc1/ RC1 builds]
* Mac/Linux builds: http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/1.9b1-candidates/rc1/
 
* Windows builds: http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/1.9b1-candidates/rc1/unsigned/
------
* Mac Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9b1) Gecko/2007110618 Firefox/3.0b1
* Mac Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9b1) Gecko/2007110618 Firefox/3.0b1
* Vista Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9b1) Gecko/2007110703 Firefox/3.0b1
* Vista Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9b1) Gecko/2007110703 Firefox/3.0b1
* XP Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9b1) Gecko/2007110703 Firefox/3.0b1
* XP Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9b1) Gecko/2007110703 Firefox/3.0b1
* Linux Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9b1) Gecko/2007110618 Firefox/3.0b1
* Linux Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9b1) Gecko/2007110618 Firefox/3.0b1
RC2:
* Mac/Linux builds: http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/1.9b1-candidates/rc2/
* Windows builds: http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/1.9b1-candidates/rc2/unsigned/
------
------
* Mac Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9b1)Gecko/2007110810 Firefox/3.0b1
[http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/1.9b1-candidates/rc3/ RC3 builds]
* Vista Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9b1)Gecko/2007110811 Firefox/3.0b1
* XP Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9b1)Gecko/2007110811 Firefox/3.0b1
* Linux Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9b1) Gecko/2007110810 Firefox/3.0b1


RC3:
* Mac/Linux builds: http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/1.9b1-candidates/rc3/
* Windows builds: http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/1.9b1-candidates/rc3/unsigned/
------
* Mac Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9b1) Gecko/2007110903 Firefox/3.0b1  
* Mac Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9b1) Gecko/2007110903 Firefox/3.0b1  
* Vista Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9b1) Gecko/2007110904 Firefox/3.0b1
* Vista Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9b1) Gecko/2007110904 Firefox/3.0b1
* Linux Build Id: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9b1) Gecko/2007110903 Firefox/3.0b1  
* Linux Build Id: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9b1) Gecko/2007110903 Firefox/3.0b1  
 
* XP Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9b1) Gecko/2007110904 Firefox/3.0b1
* XP Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9b1)
Gecko/2007110904 Firefox/3.0b1


== Features landed ==  
== Features landed ==  
Line 98: Line 88:
|-
|-
| FFT
| FFT
| Tomcat - '''in progress'''
| Tomcat - '''PASS'''
| Tomcat (partial) - '''PASS'''  
| Tomcat (partial) - '''PASS'''  
| Tchung - '''RESULT'''
| Tchung - '''PASS'''
| Marcia - '''RESULT'''
| Marcia - '''PASS'''
| Tomcat - '''PASS'''
| Tomcat - '''PASS'''
|-
|-
| Top Sites Testing (see below)
| Top Sites Testing (see below)
| Juanb - '''in-progress''' <BR> bc (automation) - '''[http://bclary.com/log/2007/11/06/assert.htm results]'''
| Juanb - '''PASS''' <BR> bc (automation) - '''[http://bclary.com/log/2007/11/06/assert.htm results]'''
| N/A  
| N/A  
| Juanb - '''in-progress'''
| Juanb - '''PASS'''
| N/A
| N/A
| bc (automation) - '''[http://bclary.com/log/2007/11/06/assert.htm results]'''
| bc (automation) - '''[http://bclary.com/log/2007/11/06/assert.htm results]'''
|-
|-
| Top Extensions Testing (see below)
| Top Extensions Testing (see below)
| Abillings - '''RESULT'''
| Abillings - '''PASS'''
| N/A  
| N/A  
| Abillings - '''RESULT'''
| Abillings - '''PASS'''
| N/A
| N/A
| Tracy - '''RESULT'''
| Tracy - '''PASS''' (only Adblock Plus and Gmail nofication compatible)
|-
|-
| Top Plugins Testing (see below)
| Top Plugins Testing (see below)
Line 123: Line 113:
| Stephend (Marcia, really, in her FFT testing; thanks Marcia!) - '''PASS'''
| Stephend (Marcia, really, in her FFT testing; thanks Marcia!) - '''PASS'''
| N/A
| N/A
| Tracy - '''RESULT'''
| Tracy - '''PASS''' (only able to install Flash and PDF)
|-
|-
| l10N Pri 1 locales
| l10N Pri 1 locales
| Tracy (en-GB, pl, fr) - '''RESULT''', <BR> Tomcat (de) - '''RESULT'''
| Tracy (de, en-GB, pl, fr) - '''PASS, en-GB is n/a''' - Tomcat (DE) '''PASS''' (one regression found, see results)
| N/A  
| N/A  
| Tchung (ja, es-ES) - '''RESULT'''
| Tchung (ja, es-ES) - '''PASS'''
| N/A
| N/A
| N/A
| N/A
|-
|-
| Bug Verifications
| Bug Verifications
| Everyone
| Everyone - '''PASS'''
| Everyone
| Everyone - '''PASS'''
| Everyone
| Everyone - '''PASS'''
| Everyone
| Everyone - '''PASS'''
| Everyone
| Everyone - '''PASS'''
|}
|}


Line 148: Line 138:


* [http://www.alexa.com Alexa Top 50]
* [http://www.alexa.com Alexa Top 50]
** Note: Used Alexa's Top Global list
** Yahoo Mail not working on Fx3: [https://bugzilla.mozilla.org/show_bug.cgi?id=398381 Bug 398381]
** Yahoo Mail not working on Fx3: [https://bugzilla.mozilla.org/show_bug.cgi?id=398381 Bug 398381]
** aol.com has a layout problem [https://bugzilla.mozilla.org/show_bug.cgi?id=396821 bug 396821]
** aol.com has a layout problem [https://bugzilla.mozilla.org/show_bug.cgi?id=396821 bug 396821]
* [http://wiki.mozilla.org/MozillaQualityAssurance:Home_Page:Firefox_3.0_TestPlan:Fx3_QA_Banking banking financial institutions]
* [[QA/Firefox3/TestPlan/Banking|Banking and financial institutions]]
** '''need a way to coordinate this with the community'''
** '''need a way to coordinate this with the community'''


Line 176: Line 167:
* Updating old extension versions to the latest if applicable
* Updating old extension versions to the latest if applicable
* Switch profiles with different extensions, and confirm they do not get carried over.
* Switch profiles with different extensions, and confirm they do not get carried over.
[[QA/Firefox3/TestResults/M9/Top Extensions|Extensions Test Results]]


=== Top Plugins Testing ===
=== Top Plugins Testing ===
Line 199: Line 192:
Issue found:
Issue found:


Pre-existing [https://bugzilla.mozilla.org/show_bug.cgi?id=328675 bug 328765]
Pre-existing [https://bugzilla.mozilla.org/show_bug.cgi?id=328675 bug 328675]


=== L10N P1 Spotchecks ===
=== L10N P1 Spotchecks ===
Visual inspection: Go through the P1 list of locales, and run a spotcheck to see if everything visually looks fine.  Refer to [http://wiki.mozilla.org/Firefox3/L10n_Requirements L10N Requirements] for more specifics.
Visual inspection: Go through the P1 list of locales, and run a spotcheck to see if everything visually looks fine.  Refer to [http://wiki.mozilla.org/Firefox3/L10n_Requirements L10N Requirements] for more specifics.


Automation: We'll us beta 1 to create the reference files.  Will be running minotaur in Beta 2 and beyond.
Automation: We'll use 2.0.0.9 to create the Minotaur reference files.   


P1 Locales to be tested:
P1 Locales to be tested:
* English (en-GB)
* English (en-GB) ''not available, localizer not ready''
* French (fr)
* French (fr) '''PASS'''
* German (de)
* German (de) '''PASS'''
* Japanese (ja)
* Japanese (ja) '''PASS'''
* Polish (pl)
* Polish (pl) '''PASS'''
* Spanish (es-ES)
* Spanish (es-ES) '''PASS'''
 
I put all the beta1 available P1's through a Minotaur check against 2.0.0.9. That looked good; nothing glaringly bad jumped out at me. However, I need to get those files loaded up somewhere so Axel and Mic can have a look.


Testcases and Results are tracked [http://wiki.mozilla.org/MozillaQualityAssurance:Home_Page:Firefox_3.0_TestPlan:M9_Results:l10N_spotchecks here].
Testcases and Results are tracked [[QA/Firefox3/TestResults/M9/L10N]].


=== Bug Verifications ===
=== Bug Verifications ===
Bugs that are marked RESOLVED FIXED that are checked in for beta.  Please verify them.
Bugs that are marked RESOLVED FIXED that are checked in for beta.  Please verify them.


* Frontend bugs: http://tinyurl.com/22whpr  
* Frontend bugs: http://tinyurl.com/22whpr - '''PASS!  Zarro boogs'''
* Platform bugs: http://tinyurl.com/yvqd4u
* Platform bugs: http://tinyurl.com/yvqd4u - '''PASS!  Zarro boogs'''


== <FONT COLOR = "RED">Detailed Results </FONT> ==
== <FONT COLOR = "RED">Detailed Results </FONT> ==
;Tchung Results:
;Tchung Results:
* Opened [https://bugzilla.mozilla.org/show_bug.cgi?query_format=specific&order=relevance+desc&bug_status=__open__&id=402964 Bug 402964 – Import Safari bookmarks shows up in Bookmarks Toolbar].  Found on Mac OSX FFT.
* Opened [https://bugzilla.mozilla.org/show_bug.cgi?query_format=specific&order=relevance+desc&bug_status=__open__&id=402964 Bug 402964 – Import Safari bookmarks shows up in Bookmarks Toolbar].  Found on Mac OSX FFT.
* Opened [https://bugzilla.mozilla.org/show_bug.cgi?id=403082 Bug 403083 - new Hotmail interface does not load in Fx3 beta 1].  Not a blocker, but assigned to techevangelism to consult with Microsoft.
* '''UPDATE: dupe of {{Bug|396259}}''' <del>Opened [https://bugzilla.mozilla.org/show_bug.cgi?id=403082 Bug 403083 - new Hotmail interface does not load in Fx3 beta 1].  Not a blocker, but assigned to techevangelism to consult with Microsoft.</del>
 
* Opened [https://bugzilla.mozilla.org/show_bug.cgi?id=403686 bug 403083 - Search plugins get multi-selected when moving up and down list].  minor bug found when running litmus search FFT.
* Opened {{Bug|403942}} - Cancelling "add new toolbar" will freeze tab switching functionality.  Nominating for b2 since restoring means force > quitting
;marcia's leopard bugs and problem areas
;marcia's leopard bugs and problem areas
*[http://wiki.mozilla.org/index.php?title=MozillaQualityAssurance:Home_Page:Firefox_3.0_TestPlan:M9_Results_Leopard Leopard Bugs]
*[[QA/Firefox3/TestResults/M9/Leopard|Leopard Bugs and Mac issues uncovered]]


;Tomcat Results:
;Tomcat Results:
*[http://wiki.mozilla.org/MozillaQualityAssurance:Home_Page:Firefox_3.0_TestPlan:M9_Results:RC3Smoketests RC 3 Results] all '''PASS'''
*[[QA/Firefox3/TestResults/M9/Smoketests|RC 3 Results]] all '''PASS'''
 
* FFT`s PASS
** Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9b1) Gecko/2007110904 Firefox/3.0b1
** Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9b1) Gecko/2007110904 Firefox/3.0b1
 
Focus testing Windows / Windows Vista : '''PASS'''


* Vista FFT - PASS
** Bugs filed:
** Bugs filed:
*** {{bug|403497}} Places Toolbar Folder not renamed when language version is changed
*** {{bug|403497}} Places Toolbar Folder not renamed when language version is changed
Line 240: Line 242:
*** {{bug|403246}} Last line of Anti Phishing Warning Page contains de and en-US text
*** {{bug|403246}} Last line of Anti Phishing Warning Page contains de and en-US text
*** {{bug|403185}} "Open All in Tabs" appends, rather than replaces, current tabset
*** {{bug|403185}} "Open All in Tabs" appends, rather than replaces, current tabset
*** '''{{bug|403628}} Failed to load module "gnomebreakpad - Error output on Trunk Start with Fedora 8 - the problem on this bug is, that also the Breakpad System itself is broken on Fedora 8 - see https://bugzilla.mozilla.org/show_bug.cgi?id=392919 - this should block a beta 2 i guess'''
*** {{bug|403628}} Failed to load module "gnomebreakpad - Error output on Trunk Start with Fedora 8 -  
*** {{bug|392919}}'''Breakpad System itself is broken on Fedora 8 - this should block a beta 2 i guess'''
*** {{bug|403842}} Default RSS Feed (Aktuelle Nachrichten) fails to load on DE Firefox 3 Beta 1 RC - Dupe of Bug [https://bugzilla.mozilla.org/show_bug.cgi?id=381357 381357 ]
*** {{bug|404081}} "Warn me when i close multiple tabs" Pref can be overridden
*** {{bug|404074}} Clear Private Data Menu is cut off in french firefox 3 beta 1
*** {{bug|403937}} Missing title on Mac for "about Mozilla Firefox" Window
 
 
* DE Locale Spot Check - '''PASS''' was running into {{Bug|403842}}, see above




;Stephend Results:  
;Stephend Results:  
*Prexisting [https://bugzilla.mozilla.org/show_bug.cgi?id=328765 bug 328765] - I nominated it for "blocking-1.9?", but jst claims plugins aren't really being actively worked on :-(  
*Prexisting [https://bugzilla.mozilla.org/show_bug.cgi?id=328675 bug 328675] - I nominated it for "blocking-1.9?", but jst claims plugins aren't really being actively worked on :-(  


;Juanb results: (topsite)
;Juanb results: (topsite)
Line 252: Line 262:
;11/9/07 Testday Results
;11/9/07 Testday Results


Full Summary [http://wiki.mozilla.org/MozillaQualityAssurance:Home_Page:Firefox_3.0_TestPlan:M9_Results:TestdayResults here].
Full Summary [[QA/Firefox3/TestResults/M9/Testday|here]].
Highlights:
Highlights:
* 1300 litmus tests by Community
* 1300 litmus tests by Community
Line 264: Line 274:
When we go live at 3 PM it would be great team members could download an M9 build quickly and make sure everything looks ok.
When we go live at 3 PM it would be great team members could download an M9 build quickly and make sure everything looks ok.


*Windows XP -> Tomcat - '''TBD'''
*Windows XP -> abillings - '''PASS'''
*Windows Vista  -> abillings '''TBD'''
*Windows Vista  -> stephend/abillings (en-US, de) - '''PASS'''
*Mac PPC/Intel-> tchung '''TBD'''
*Mac PPC/Intel-> tchung - '''PASS'''
*Mac Leopard -> Marcia
*Mac Leopard -> abillings - '''PASS'''
*Linux -> stephend '''TBD'''
*Linux -> stephend - (en-US/nl) '''PASS'''


== Blocker Bugs for M9 ==
== DevTracking Bugs for M9 ==
Refer to dev-tracking bugs at: [http://tinyurl.com/3d8y8w [M9 firefox]]|[http://tinyurl.com/34xe45 [M9 platform]]
Refer to dev-tracking bugs at: [http://tinyurl.com/3d8y8w [M9 firefox]]|[http://tinyurl.com/34xe45 [M9 platform]]
Abillings
canmove, Confirmed users
4,854

edits

Retrieved from "https://wiki.mozilla.org/Special:MobileDiff/74250...75339"