Firefox:1.5.0.10-2.0.0.2:Test Plan:BFT: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
No edit summary
 
(78 intermediate revisions by 4 users not shown)
Line 1: Line 1:
=== Smoketests ===
=== Smoketests RC5 ===


{| border="1" cellpadding="5" cellspacing="0"
{| border="1" cellpadding="5" cellspacing="0"
Line 5: Line 5:
!  
!  
! style="background:#ffdead;" | FF2002
! style="background:#ffdead;" | FF2002
! style="background:#ffdead;" | FF1510


|-
|-
| style="background:#ffdead;" | '''Windows'''
| style="background:#ffdead;" | '''Windows'''
|  ()
|  (Tomcat/juanb) '''PASS'''
|  ()


|-
|-
| style="background:#ffdead;" | '''Mac'''
| style="background:#ffdead;" | '''Mac'''
|  ()
|  (juanb) '''PASS'''
|  ()


|-
|-
| style="background:#ffdead;" | '''Linux'''
| style="background:#ffdead;" | '''Linux'''
|  ()
|  (juanb) '''PASS'''
|  ()
 
|-
|}
 
=== Smoketests RC4 ===
 
{| border="1" cellpadding="5" cellspacing="0"
|-
!
! style="background:#ffdead;" | FF2002
! style="background:#ffdead;" | FF15010
 
|-
| style="background:#ffdead;" | '''Windows'''
|  (juanb) '''PASS'''
|  (juanb) '''PASS'''
 
|-
| style="background:#ffdead;" | '''Mac'''
|  (juanb) '''PASS'''
|  (marcia) '''PASS'''
 
|-
| style="background:#ffdead;" | '''Linux'''
|  (juanb) '''PASS'''
|  (tomcat) '''PASS'''
 
|-
|}
 
=== Smoketests (up to RC2) ===
 
{| border="1" cellpadding="5" cellspacing="0"
|-
!
! style="background:#ffdead;" | FF2002
! style="background:#ffdead;" | FF15010
 
|-
| style="background:#ffdead;" | '''Windows'''
|  (tomcat) '''PASS'''
|  (juanb) '''PASS'''
 
|-
| style="background:#ffdead;" | '''Mac'''
|  (juanb) '''PASS'''
|  (juanb) '''PASS'''
 
|-
| style="background:#ffdead;" | '''Linux'''
|  (tomcat) '''PASS'''
|  (juanb) '''PASS'''


|-
|-
Line 31: Line 79:
!  
!  
! style="background:#ffdead;" | FF2002
! style="background:#ffdead;" | FF2002
! style="background:#ffdead;" | FF1510
! style="background:#ffdead;" | FF15010
|-
|-
| style="background:#ffdead;" | '''Windows'''
| style="background:#ffdead;" | '''Windows'''
|  ()
|  (juanb/tomcat) '''PASS'''
|  ()
|  (tomcat) '''PASS'''
|-
|-
| style="background:#ffdead;" | '''Mac'''
| style="background:#ffdead;" | '''Mac'''
| optional
| (marcia) '''PASS'''
| optional
| optional
|-
|-
| style="background:#ffdead;" | '''Linux'''
| style="background:#ffdead;" | '''Linux'''
|  ()
|  (tchung) '''PASS'''
| optional
| optional
|-
|-
|}
|}


'''The FFT on Vista will be run by tomcat'''
'''FFT Vista PASS'''


=== Detailed Results ===
=== Detailed Results ===
Line 60: Line 108:
== FFT Result (Vista) ==
== FFT Result (Vista) ==
* Tester : tomcat
* Tester : tomcat
* Date:  
* Date: 9 - 11 February 2007
* Plattform :  
* Platform : Windows Vista Ultimate
* Build ID:  
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.8.1.2) Gecko/2007020823 Firefox/2.0.0.2
* Results :  
* Results : '''PASS''' -  Some confirmed Bugs regarding IE7 import - 355538, 369910, 369916 and some testcases needs to be updated - marked as unclear - Results in Litmus
 
'''Top Site Testings :'''http://wiki.mozilla.org/Firefox:1.5.0.10-2.0.0.2:Test_Plan:BFT:topsites
 
'''Addon Testing :''' http://wiki.mozilla.org/Firefox:1.5.0.10-2.0.0.2:Test_Plan:BFT:addons
 
New Bugs:
**[Bug 370123] Crash while starting Firefox with a Web-Shortcut and enabled Profile Manager
**[Bug 370073] Failure to load a web shortcut if Firefox is not already running


== BFT Result ==
== BFT Result ==
* Tester :  
* Tester : marcia
* Date:  
* Date: BFT was run over several days, up to 2-14-07
* Plattform :  
* Platform : Intel Mac and PPC Mac
* Build ID:  
* The following sections of the BFT were run on the Intel Mac:
* Results :  
**Installation, Menu Bar, Help, Location Bar, Find in Page, RSS, Add ons, Session Store, History, PW Manager, Tech Tools, Uninstall, Search and Plugins
* The following sections of the BFT were run on my PPC mac (10.3.9)
**Popups, Bookmarks, Toolbar, Form Manager, Downloading, Anti Phishing, Security Certs, Tabbed Browsing, Cookies and Microsummaries
* Build ID: 2007020823
* Results : '''PASS''', results are in Litmus under PPC and Intel Mac (2 separate runs)
* One crash noted while installing an extension, looks like a firefox-bin crash
* Issues noted in Litmus regarding Safari import - some test cases need to be updated to include the information about what is supported/not supported during import and migration.
* The Mac still has annoying drag and drop issues that make it difficult to drag URLs to the toolbar very easily.
 
My plan is to run a BFT and check all the Windows Operating systems, such as Win 98, Win 2k, and Win XP.
 
* Tester : tchung
* Date: 2/11/2007
* Platform : Linux Fedora 6
* Build ID: 2007020822 / Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.2) Gecko/20070208 Firefox/2.0.0.2
* Results : '''PASS''' Results in Litmus
** Test cases ignored that are mac and windows only
** Bugs: https://bugzilla.mozilla.org/show_bug.cgi?id=370200
 
* Tester : tomcat
* Date: 02/13/2007
* Platform : Windows XP x64
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.0.10) Gecko/20070209 Firefox/1.5.0.10 Mnenhy/0.7.5.0 ID:2007020900
* Results : '''PASS'''
* [Bug 369910] Cookies not imported from IE 7 PASS on XP and 15010
Passwords and forms are not migrated
 
* Tester : tomcat (assisting juan on a few areas down from area: downloads)
* Date: 02/13/2007
* Platform : Windows XP SP2
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.2) Gecko/2007020823 Firefox/2.0.0.2 (RC2)
* Results : '''PASS''' - Results in Litmus - also import from IE7 PASS


== Smoketest Result ==
== Smoketest Result ==
* Tester :
* Date:
* Plattform :
* Build ID:
* Results :


=== 2.0.0.2 RC 1-RC2 Results ===
<font color=lightgray>
* Tester : juanb (using Eggplant)
* Date: 2007/02/09
* Platform : Mac
* Build ID: 2007020823 (2002rc1)
* Results : '''PASS'''
* Tester : tomcat, juanb (also did a run with Eggplant)
* Date: 2007/02/09
* Platform : Linux
* Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.2) Gecko/20070208 Firefox/2.0.0.2 ID:2007020822
* Results : '''PASS''' Results in Litmus
* Tester : tomcat, juanb (also did a run with Eggplant)
* Date: 2007/02/09
* Platform : Windows XP x64
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.1.2) Gecko/20070208 Firefox/2.0.0.2 ID:2007020823
* Results : '''PASS''' Results in Litmus
* Tester : marcia
* Date: 2007/02/09
* Platform : Windows Vista Home Basic
* Build ID:  Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.8.1.2) Gecko/2007020823 Firefox/2.0.0.2
* Results : '''PASS''', results in Litmus under buildid=2007020825 with the following bugs noted:
**https://bugzilla.mozilla.org/show_bug.cgi?id=355554
**https://bugzilla.mozilla.org/show_bug.cgi?id=353948 - reopened due to an error in listing mozilla.org instead of mozilla.com
</font>
=== 2.0.0.2 RC4 Results ===
* Tester: Tomcat
* Date: 2007/02/16
* Platform: Windows Vista - Ultimate
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.8.1.2) Gecko/20070215 Firefox/2.0.0.2 ID:2007021518
* Results: '''PASS''' Results in Litmus - done also the Vista Test Suite
* Tester: juanb (using Eggplant)
* Date: 2007/02/16
* Platform: WinXP
* Build ID: 2007021518 - Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.2) Gecko/20070215 Firefox/2.0.0.2
* Results: '''PASS'''
* Notes: Issues detecting MSN logo, detecting zip saved file, and adding live bookmarks. Manually these ran fine.
* Tester: juanb (using Eggplant)
* Date: 2007/02/16
* Platform: Mac (Intel)
* Build ID: 2007021518 - Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.2) Gecko/20070215 Firefox/2.0.0.2
* Results: '''PASS'''
* Notes:
* Tester: juanb (using Eggplant)
* Date: 2007/02/16
* Platform: Linux FC5
* Build ID: 2007021518 - Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.2) Gecko/20070215 Firefox/2.0.0.2
* Results: '''PASS'''
* Notes: Issues detecting saved zip file, and adding live bookmarks. Both passed with a manual test.
=== 2.0.0.2 RC5 Results ===
* Tester: Tomcat
* Date: 2007/02/20
* Platform: Windows Vista - Ultimate
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.8.1.2) Gecko/2007021917 Firefox/2.0.0.2
* Results: '''PASS''' Results in Litmus -
* Tester: Tomcat
* Date: 2007/02/20
* Platform: Windows XP x64
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.2; pt-BR; rv:1.8.0.9) Gecko/20061206 Firefox/1.5.0.9 Mnenhy/0.7.5.0 ID:2007021917
* Results: '''PASS''' Results in Litmus
* Tester: marcia
* Date: 2007/02/20
* Platform: PPC Mac running 10.3.9
* Build ID: Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.8.1.2) Gecko/2007021917 Firefox/2.0.0.2
* Results: '''PASS''' Results in Litmus -
* Tester: juanb (using Eggplant)
* Date: 2007/02/20
* Platform: Windows XP
* BuildID:
* Results: '''PASS'''
* Tester: juanb (using Eggplant)
* Date: 2007/02/20
* Platform: Mac (Intel)
* BuildID:
* Results: '''PASS'''
* Tester: juanb (using Eggplant)
* Date: 2007/02/20
* Platform: Linux FC6
* BuildID:
* Results: '''PASS'''
=== 1.5.0.10 Results RC1 ===
<font color=lightgray>
* Tester: juanb
* Date: 2007/02/09
* Platform: Mac (Intel)
* Build ID: 2007020900 - Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.0.10) Gecko/20070209 Firefox/1.5.0.10
* Results: '''PASS''' Results in Litmus
* Tester: juanb
* Date: 2007/02/09
* Platform: WinXP (vm)
* Build ID: 2007020900 - Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.10) Gecko/20070209 Firefox/1.5.0.10
* Results: '''PASS''' Results in Litmus
* Notes: A few bugs were confirmed, related to data migration from IE 7, 355538, 369910, 369916
* Tester: juanb
* Date: 2007/02/12
* Platform: Linux Ubuntu 6.10 (vm)
* Build ID: 2007020823 - Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.0.10) Gecko/20070208 Firefox/1.5.0.10
* Results: '''PASS''' Results in Litmus
* Notes: Bug 370299, home page migration from Seamonkey 1.1 doesn't work.
</font>
=== 1.5.0.10 Results RC2 ===
*  Tester: juanb
* Date: 2007/02/16
* Platform: WinXP (vm)
* Build ID: 2007021601 - Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.10) Gecko/20070216 Firefox/1.5.0.10
* Results: '''PASS''' Results in Litmus
* Notes:


*  Tester: tomcat
* Date: 2007/02/16
* Platform: Linux Fedora FC6
* Build ID: Firefox 1.5.0.10 ID:2007021600
* Results: '''PASS''' Results in Litmus
* Notes:


*  Tester: marcia
* Date: 2007/02/16
* Platform: PPC Mac running 10.3.9
* Build ID: 2007021601
* Results: '''PASS''' Results in Litmus
* Notes:


[http://litmus.mozilla.org/run_tests.cgi Litmus Test Suites]
[http://litmus.mozilla.org/run_tests.cgi Litmus Test Suites]

Latest revision as of 00:38, 21 February 2007

Smoketests RC5

FF2002
Windows (Tomcat/juanb) PASS
Mac (juanb) PASS
Linux (juanb) PASS

Smoketests RC4

FF2002 FF15010
Windows (juanb) PASS (juanb) PASS
Mac (juanb) PASS (marcia) PASS
Linux (juanb) PASS (tomcat) PASS

Smoketests (up to RC2)

FF2002 FF15010
Windows (tomcat) PASS (juanb) PASS
Mac (juanb) PASS (juanb) PASS
Linux (tomcat) PASS (juanb) PASS

Basic Functional Tests (BFTs)

FF2002 FF15010
Windows (juanb/tomcat) PASS (tomcat) PASS
Mac (marcia) PASS optional
Linux (tchung) PASS optional

FFT Vista PASS

Detailed Results

Any smoketest and/or BFTs assignments and detailed results should be tracked here. Please include the following information:

  • Product and release tested
  • Type of test (smoketest/BFT)
  • Platform (Windows, Linux, MacOS X), architecture for Mac (PPC or MacIntel)
  • Build ID (from master.ini or using Nightly Tester Tools extension)
  • Tester and date
  • Results

FFT Result (Vista)

  • Tester : tomcat
  • Date: 9 - 11 February 2007
  • Platform : Windows Vista Ultimate
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.8.1.2) Gecko/2007020823 Firefox/2.0.0.2
  • Results : PASS - Some confirmed Bugs regarding IE7 import - 355538, 369910, 369916 and some testcases needs to be updated - marked as unclear - Results in Litmus

Top Site Testings :http://wiki.mozilla.org/Firefox:1.5.0.10-2.0.0.2:Test_Plan:BFT:topsites

Addon Testing : http://wiki.mozilla.org/Firefox:1.5.0.10-2.0.0.2:Test_Plan:BFT:addons

New Bugs:

    • [Bug 370123] Crash while starting Firefox with a Web-Shortcut and enabled Profile Manager
    • [Bug 370073] Failure to load a web shortcut if Firefox is not already running

BFT Result

  • Tester : marcia
  • Date: BFT was run over several days, up to 2-14-07
  • Platform : Intel Mac and PPC Mac
  • The following sections of the BFT were run on the Intel Mac:
    • Installation, Menu Bar, Help, Location Bar, Find in Page, RSS, Add ons, Session Store, History, PW Manager, Tech Tools, Uninstall, Search and Plugins
  • The following sections of the BFT were run on my PPC mac (10.3.9)
    • Popups, Bookmarks, Toolbar, Form Manager, Downloading, Anti Phishing, Security Certs, Tabbed Browsing, Cookies and Microsummaries
  • Build ID: 2007020823
  • Results : PASS, results are in Litmus under PPC and Intel Mac (2 separate runs)
  • One crash noted while installing an extension, looks like a firefox-bin crash
  • Issues noted in Litmus regarding Safari import - some test cases need to be updated to include the information about what is supported/not supported during import and migration.
  • The Mac still has annoying drag and drop issues that make it difficult to drag URLs to the toolbar very easily.

My plan is to run a BFT and check all the Windows Operating systems, such as Win 98, Win 2k, and Win XP.

  • Tester : tchung
  • Date: 2/11/2007
  • Platform : Linux Fedora 6
  • Build ID: 2007020822 / Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.2) Gecko/20070208 Firefox/2.0.0.2
  • Results : PASS Results in Litmus
  • Tester : tomcat
  • Date: 02/13/2007
  • Platform : Windows XP x64
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.0.10) Gecko/20070209 Firefox/1.5.0.10 Mnenhy/0.7.5.0 ID:2007020900
  • Results : PASS
  • [Bug 369910] Cookies not imported from IE 7 PASS on XP and 15010

Passwords and forms are not migrated

  • Tester : tomcat (assisting juan on a few areas down from area: downloads)
  • Date: 02/13/2007
  • Platform : Windows XP SP2
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.2) Gecko/2007020823 Firefox/2.0.0.2 (RC2)
  • Results : PASS - Results in Litmus - also import from IE7 PASS

Smoketest Result

2.0.0.2 RC 1-RC2 Results

  • Tester : juanb (using Eggplant)
  • Date: 2007/02/09
  • Platform : Mac
  • Build ID: 2007020823 (2002rc1)
  • Results : PASS
  • Tester : tomcat, juanb (also did a run with Eggplant)
  • Date: 2007/02/09
  • Platform : Linux
  • Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.2) Gecko/20070208 Firefox/2.0.0.2 ID:2007020822
  • Results : PASS Results in Litmus
  • Tester : tomcat, juanb (also did a run with Eggplant)
  • Date: 2007/02/09
  • Platform : Windows XP x64
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.1.2) Gecko/20070208 Firefox/2.0.0.2 ID:2007020823
  • Results : PASS Results in Litmus

2.0.0.2 RC4 Results

  • Tester: Tomcat
  • Date: 2007/02/16
  • Platform: Windows Vista - Ultimate
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.8.1.2) Gecko/20070215 Firefox/2.0.0.2 ID:2007021518
  • Results: PASS Results in Litmus - done also the Vista Test Suite
  • Tester: juanb (using Eggplant)
  • Date: 2007/02/16
  • Platform: WinXP
  • Build ID: 2007021518 - Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.2) Gecko/20070215 Firefox/2.0.0.2
  • Results: PASS
  • Notes: Issues detecting MSN logo, detecting zip saved file, and adding live bookmarks. Manually these ran fine.
  • Tester: juanb (using Eggplant)
  • Date: 2007/02/16
  • Platform: Mac (Intel)
  • Build ID: 2007021518 - Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.2) Gecko/20070215 Firefox/2.0.0.2
  • Results: PASS
  • Notes:
  • Tester: juanb (using Eggplant)
  • Date: 2007/02/16
  • Platform: Linux FC5
  • Build ID: 2007021518 - Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.2) Gecko/20070215 Firefox/2.0.0.2
  • Results: PASS
  • Notes: Issues detecting saved zip file, and adding live bookmarks. Both passed with a manual test.

2.0.0.2 RC5 Results

  • Tester: Tomcat
  • Date: 2007/02/20
  • Platform: Windows Vista - Ultimate
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.8.1.2) Gecko/2007021917 Firefox/2.0.0.2
  • Results: PASS Results in Litmus -
  • Tester: Tomcat
  • Date: 2007/02/20
  • Platform: Windows XP x64
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.2; pt-BR; rv:1.8.0.9) Gecko/20061206 Firefox/1.5.0.9 Mnenhy/0.7.5.0 ID:2007021917
  • Results: PASS Results in Litmus
  • Tester: marcia
  • Date: 2007/02/20
  • Platform: PPC Mac running 10.3.9
  • Build ID: Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.8.1.2) Gecko/2007021917 Firefox/2.0.0.2
  • Results: PASS Results in Litmus -
  • Tester: juanb (using Eggplant)
  • Date: 2007/02/20
  • Platform: Windows XP
  • BuildID:
  • Results: PASS
  • Tester: juanb (using Eggplant)
  • Date: 2007/02/20
  • Platform: Mac (Intel)
  • BuildID:
  • Results: PASS
  • Tester: juanb (using Eggplant)
  • Date: 2007/02/20
  • Platform: Linux FC6
  • BuildID:
  • Results: PASS

1.5.0.10 Results RC1

  • Tester: juanb
  • Date: 2007/02/09
  • Platform: Mac (Intel)
  • Build ID: 2007020900 - Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.0.10) Gecko/20070209 Firefox/1.5.0.10
  • Results: PASS Results in Litmus
  • Tester: juanb
  • Date: 2007/02/09
  • Platform: WinXP (vm)
  • Build ID: 2007020900 - Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.10) Gecko/20070209 Firefox/1.5.0.10
  • Results: PASS Results in Litmus
  • Notes: A few bugs were confirmed, related to data migration from IE 7, 355538, 369910, 369916
  • Tester: juanb
  • Date: 2007/02/12
  • Platform: Linux Ubuntu 6.10 (vm)
  • Build ID: 2007020823 - Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.0.10) Gecko/20070208 Firefox/1.5.0.10
  • Results: PASS Results in Litmus
  • Notes: Bug 370299, home page migration from Seamonkey 1.1 doesn't work.

1.5.0.10 Results RC2

  • Tester: juanb
  • Date: 2007/02/16
  • Platform: WinXP (vm)
  • Build ID: 2007021601 - Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.10) Gecko/20070216 Firefox/1.5.0.10
  • Results: PASS Results in Litmus
  • Notes:
  • Tester: tomcat
  • Date: 2007/02/16
  • Platform: Linux Fedora FC6
  • Build ID: Firefox 1.5.0.10 ID:2007021600
  • Results: PASS Results in Litmus
  • Notes:
  • Tester: marcia
  • Date: 2007/02/16
  • Platform: PPC Mac running 10.3.9
  • Build ID: 2007021601
  • Results: PASS Results in Litmus
  • Notes:

Litmus Test Suites

Retrieved from "https://wiki.mozilla.org/index.php?title=Firefox:1.5.0.10-2.0.0.2:Test_Plan:BFT&oldid=49609"