Firefox:1.5.0.12-2.0.0.4:Test Plan:BFT: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(5 intermediate revisions by 2 users not shown)
Line 1: Line 1:
== RC2 Builds ==
=== BFT's ===
=== BFT's ===
There were very few changes between RC1, RC2, and RC3(Firefox 2.0.0.4), so the bft results of rc1 should remain valid. However we can use the test cases in the BFT to test around the bug fixes that went into RC2 and RC3 such as Bookmarks, and CJKT default search engines.
There were very few changes between RC1, RC2, and RC3(Firefox 2.0.0.4), so the bft results of rc1 should remain valid. However we can use the test cases in the BFT to test around the bug fixes that went into RC2 and RC3 such as Bookmarks, and CJKT default search engines.
Line 8: Line 7:
|-
|-
!  
!  
! style="background:#ffdead;" | FF2004
! style="background:#ffdead;" | FF2004rc3
! style="background:#ffdead;" | FF15012
! style="background:#ffdead;" | FF15012rc2
! style="background:#ffdead;" | TB15012
! style="background:#ffdead;" | TB15012rc2


|-
|-
Line 46: Line 45:
=== Smoketest Results ===
=== Smoketest Results ===


==== Firefox 2004 RC 3 ====
==== Firefox 2004 RC3 ====


* Windows Smoketests RC3 Signed Builds :Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.8.1.4) Gecko/2007051502 Firefox/2.0.0.4, tomcat - PASS
* Windows Smoketests RC3 Signed Builds :Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.8.1.4) Gecko/2007051502 Firefox/2.0.0.4, tomcat - PASS
Line 53: Line 52:
** Common Operations
** Common Operations


* Windows XP, smoketest (using Eggplant), 2.0.0.4rc3, BuildID, tracy: '''PASS'''


==== Firefox 2004 ====
* Mac, smoketest (using Eggplant), 2.0.0.4rc3, BuildID, tracy: '''PASS'''
 
* Linux, smoketest (using Eggplant), 2.0.0.4rc3, BuildID, tracy: '''PASS'''
 
 
==== Firefox 2004 RC2 ====
* Windows XP, smoketest (using Eggplant), 2.0.0.4rc2, BuildID, tracy: '''PASS'''
* Windows XP, smoketest (using Eggplant), 2.0.0.4rc2, BuildID, tracy: '''PASS'''


Line 70: Line 75:
**Updating all plugins
**Updating all plugins


==== Firefox 15012 ====
==== Firefox 15012 RC2 ====
* Windows XP, smoketests, 1.5.0.12rc2(unsigned), 2007050813, juanb, 5/09: '''PASS'''
* Windows XP, smoketests, 1.5.0.12rc2(unsigned), 2007050813, juanb, 5/09: '''PASS'''


Line 81: Line 86:
* MacIntel, smoketests, 1.5.0.12rc2, 2007050815, juanb, 5/10: '''PASS'''
* MacIntel, smoketests, 1.5.0.12rc2, 2007050815, juanb, 5/10: '''PASS'''


==== Thunderbird 15012 ====
==== Thunderbird 15012 RC2 ====


===== Windows =====
===== Windows =====
Line 91: Line 96:
* Status: '''PASS''' (results in Litmus)
* Status: '''PASS''' (results in Litmus)
* Issues: Difficult importing mail from Windows Mail, it didn't like our IMAP configuration.
* Issues: Difficult importing mail from Windows Mail, it didn't like our IMAP configuration.
===== Windows Vista =====
* Test: 1.5.0.12 Smoketest on Win Vista
* Tester: tomcat
* Date: 19.May 2007
* Version ID: version 1.5.0.12 (20070509)
* Build ID: 2007050903
* Status: '''PASS''' (results in Litmus)


===== Mac =====
===== Mac =====

Latest revision as of 16:55, 21 May 2007

BFT's

There were very few changes between RC1, RC2, and RC3(Firefox 2.0.0.4), so the bft results of rc1 should remain valid. However we can use the test cases in the BFT to test around the bug fixes that went into RC2 and RC3 such as Bookmarks, and CJKT default search engines.

Smoketests

FF2004rc3 FF15012rc2 TB15012rc2
Windows (tracy) PASS (juanb) PASS (marcia) opt
Vista (marcia, tomcat) PASS (tomcat) PASS (marcia) PASS
Mac (tracy) PASS (juanb) PASS (marcia) PASS
Linux (tomcat, tracy) PASS (juanb) PASS (tomcat) PASS

Detailed Results

Any smoketest and/or BFTs assignments and detailed results should be tracked here. Please include the following information:

  • Product and release tested
  • Type of test (smoketest/BFT)
  • Platform (Windows, Linux, MacOS X), architecture for Mac (PPC or MacIntel)
  • Build ID (from master.ini or using Nightly Tester Tools extension)
  • Tester and date
  • Results

Smoketest Results

Firefox 2004 RC3

  • Windows Smoketests RC3 Signed Builds :Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.8.1.4) Gecko/2007051502 Firefox/2.0.0.4, tomcat - PASS
    • Focus on Signed Files
    • Focus on Top Site Compatibility
    • Common Operations
  • Windows XP, smoketest (using Eggplant), 2.0.0.4rc3, BuildID, tracy: PASS
  • Mac, smoketest (using Eggplant), 2.0.0.4rc3, BuildID, tracy: PASS
  • Linux, smoketest (using Eggplant), 2.0.0.4rc3, BuildID, tracy: PASS


Firefox 2004 RC2

  • Windows XP, smoketest (using Eggplant), 2.0.0.4rc2, BuildID, tracy: PASS
  • Mac, smoketest (using Eggplant), 2.0.0.4rc2, BuildID, tracy: PASS
  • Linux, smoketest (using Eggplant), 2.0.0.4rc2, BuildID, tracy: PASS
  • Windows Vista, smoketest , 2.0.0.4rc2, BuildID Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv :1.8.1.4) Gecko/2007050903 Firefox/2.0.0.4 unsigned, tomcat: PASS

Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.8.1.4) Gecko/2007051502 Firefox/2.0.0.4

  • General Testing of Firefox 2.0.0.4 on Vista, emphasizing the following [marcia]
    • Bookmarks (ran a regression suite)
    • Common operations
    • Updating all plugins

Firefox 15012 RC2

  • Windows XP, smoketests, 1.5.0.12rc2(unsigned), 2007050813, juanb, 5/09: PASS
  • Linux Ubuntu (vm), smoketests, 1.5.0.12rc2, 2007050813, juanb, 5/09: PASS
  • Windows Vista, smoketests, 1.5.0.12rc2(unsigned), Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.8.0.12) Gecko/20070508 , tomcat, 5/09: PASS
  • Windows Vista, smoketests, 1.5.0.12 rc2(signed),Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.8.0.12) Gecko/20070508 , tomcat, 5/09: PASS
  • MacIntel, smoketests, 1.5.0.12rc2, 2007050815, juanb, 5/10: PASS

Thunderbird 15012 RC2

Windows
  • Test: 1.5.0.12 Smoketest on Win Vista Home Basic
  • Tester: marcia
  • Date: 5/9
  • Version ID: version 1.5.0.12 (20070509)
  • Build ID: 2007050903
  • Status: PASS (results in Litmus)
  • Issues: Difficult importing mail from Windows Mail, it didn't like our IMAP configuration.
Windows Vista
  • Test: 1.5.0.12 Smoketest on Win Vista
  • Tester: tomcat
  • Date: 19.May 2007
  • Version ID: version 1.5.0.12 (20070509)
  • Build ID: 2007050903
  • Status: PASS (results in Litmus)
Mac
  • Test: 1.5.0.12 Smoketest on MacIntel
  • Tester: marcia
  • Date: 5/9
  • Version ID: version 1.5.0.12 (20070509)
  • Build ID: 2007050903,
  • Status: PASS (results in Litmus)
  • Issues: I crashed once, in this stack: PL_DHashTableOperate + 27. Looks to be the same stack as https://bugzilla.mozilla.org/show_bug.cgi?id=349463
Linux
  • Test: 1.5.0.12 Smoketest Fedora FC 5
  • Tester: tomcat
  • Date: 5/10
  • Version ID: version 1.5.0.12 (20070509)
  • Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.0.12)Gecko/20070509 Thunderbird/1.5.0.12 ID:2007050903
  • Status: PASS (results in Litmus)
  • Issues: Some JS Errors on First Start with new Profile and new Account setup, gone after restart

Bugs Filed during RC2 testing

RC1 Builds

Results moved to this page: 15012/2004 RC1 Results