MozillaWiki

Releases/Firefox 3.6.13/Test Plan:Smoketests: Difference between revisions

< Releases‎ | Firefox 3.6.13
 
(32 intermediate revisions by 3 users not shown)
Line 4: Line 4:


= Firefox 3.6.13 Smoketest and BFT Results =
= Firefox 3.6.13 Smoketest and BFT Results =
= Smoketests for Build 3 =
* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=246 Click] to run the Smoketests
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=246 Smoketest Report]
'''Build IDs'''
* Windows: 20101203075014
* OS X: 20101203074432
* Linux: 20101203074139
== Windows XP (abillings)  ==
*Date: 12/3/2010
*Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.13) Gecko/20101203 Firefox/3.6.13
*Mozmill '''PASS''' 
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/2c37a7c1942414e420c43bdb348421ca PASS] (Known Failures)
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/2c37a7c1942414e420c43bdb348429cf PASS] (Known Failures)
*Status: '''PASS''' in Litmus (Mozmill and Manual)
**Notes:
== Windows 7 (abillings) ==
*Date: 12/3/2010
*Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.13) Gecko/20101203 Firefox/3.6.13
*Mozmill '''PASS''' 
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/2c37a7c1942414e420c43bdb34842794 PASS] (Known Failures)
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/2c37a7c1942414e420c43bdb3484357a PASS] (Known Failures)
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)
**Notes:
== Windows Vista (abillings) ==
*Date: 12/3/2010
*Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.13) Gecko/20101203 Firefox/3.6.13
*Mozmill '''PASS''' 
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/2c37a7c1942414e420c43bdb34842893 PASS] (Known Failures)
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/2c37a7c1942414e420c43bdb34844991 PASS] (Known Failures)
*Status: '''PASS''' in Litmus (Mozmill and Manual)
**Notes:
== Mac OS X 10.6 (gmealer) ==
*Date: 2010-12-03
*Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.13) Gecko/20101203 Firefox/3.6.13
*Mozmill '''PASS''' 
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/2c37a7c1942414e420c43bdb348425f2 PASS] (Known Failures)
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/2c37a7c1942414e420c43bdb34844005 PASS] (Known Failures)
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)
**Notes:
== Linux (abillings) ==
*Date: 12/3/2010
*Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.13) Gecko/20101203 Firefox/3.6.13
*Mozmill '''PASS''' 
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/2c37a7c1942414e420c43bdb3482963d PASS] (Known Failures)
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/2c37a7c1942414e420c43bdb348431fe PASS] (Known Failures)
*Status: '''PASS''' in Litmus (Mozmill and Manual)
**Notes:


= Smoketests for Build 2 =
= Smoketests for Build 2 =
Line 23: Line 77:
**Notes:
**Notes:


== Windows 7 (abillings) ==
== Windows 7 (gmontagu) ==
*Date:  
*Date: 11/30/2010
*Build ID:  
*Build ID:  
*Mozmill '''RESULTS'''   
*Mozmill '''PASS'''   
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4241a40ae220f2ac4d991412f16b305f PASS] (known failures)
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4241a40ae220f2ac4d991412f16b305f PASS] (known failures)
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4241a40ae220f2ac4d991412f16b98d7 PASS] (known failures)  
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4241a40ae220f2ac4d991412f16b98d7 PASS] (known failures)  
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)  
*Status: '''PASS''' in Litmus (Mozmill and Manual)  
**Notes:
**Notes:


== Windows Vista (abillings) ==
== Windows Vista (abillings) ==
Line 43: Line 96:


== Mac OS X 10.6 (abillings) ==
== Mac OS X 10.6 (abillings) ==
*Date:  
*Date: 11/30/2010
*Build ID:  
*Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.13) Gecko/20101130 Firefox/3.6.13
*Mozmill '''RESULTS'''   
*Mozmill '''PASS'''   
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4241a40ae220f2ac4d991412f16b3b7d PASS] (known failures)  
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4241a40ae220f2ac4d991412f16b3b7d PASS] (known failures)  
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4241a40ae220f2ac4d991412f16ba687 PASS] (known AMO bug)  
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4241a40ae220f2ac4d991412f16ba687 PASS] (known AMO bug)  
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)  
*Status: '''PASS''' in Litmus (Mozmill and Manual)  
**Notes:
**Notes:


Line 54: Line 107:
*Date: 11/30/2010
*Date: 11/30/2010
*Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.13) Gecko/20101130 Firefox/3.6.13
*Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.13) Gecko/20101130 Firefox/3.6.13
*Mozmill '''RESULTS'''   
*Mozmill '''PASS'''   
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4241a40ae220f2ac4d991412f16aea1f PASS] (known failures)  
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4241a40ae220f2ac4d991412f16aea1f PASS] (known failures)  
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4241a40ae220f2ac4d991412f16b8425 PASS] (known AMO bug)  
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4241a40ae220f2ac4d991412f16b8425 PASS] (known AMO bug)  
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)  
*Status: '''PASS''' in Litmus (Mozmill and Manual)  
**Notes:
**Notes:


Line 115: Line 168:


= BFTs=  
= BFTs=  
== Build 3 ==
* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=247 Click] to run the BFT
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=247 BFT Report]


== Build 2 ==
== Build 2 ==
Line 147: Line 206:


= Other OS Spot Checks =
= Other OS Spot Checks =
== Windows 2000 (tester) ==
== Windows 2000 (abillings) ==
* Date:  
* Date: 11/30/2010
* Build ID:  
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.9.2.13) Gecko/20101130 Firefox/3.6.13
* Status: '''RESULTS'''
* Status: '''PASS'''

Latest revision as of 23:35, 3 December 2010

« Firefox:3.6.13:Test_Plan

Smoketests and BFTs are run partially though Mozmill automation and partially through manual testing (where automation does not currently exist). This means that the Mozmill automation is first run and results logged on this page. Then testers will run the leftover manual tests that the Mozmill testing did not cover. Because of this, please speak with QA (usually Hskupin and Abillings) before beginning manual testing if Mozmill results are not logged to the page below.

Firefox 3.6.13 Smoketest and BFT Results

Smoketests for Build 3

Build IDs

  • Windows: 20101203075014
  • OS X: 20101203074432
  • Linux: 20101203074139

Windows XP (abillings)

  • Date: 12/3/2010
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.13) Gecko/20101203 Firefox/3.6.13
  • Mozmill PASS
    • Normal: PASS (Known Failures)
    • Restart: PASS (Known Failures)
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Windows 7 (abillings)

  • Date: 12/3/2010
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.13) Gecko/20101203 Firefox/3.6.13
  • Mozmill PASS
    • Normal: PASS (Known Failures)
    • Restart: PASS (Known Failures)
  • Status: RESULTS in Litmus (Mozmill and Manual)
    • Notes:

Windows Vista (abillings)

  • Date: 12/3/2010
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.13) Gecko/20101203 Firefox/3.6.13
  • Mozmill PASS
    • Normal: PASS (Known Failures)
    • Restart: PASS (Known Failures)
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Mac OS X 10.6 (gmealer)

  • Date: 2010-12-03
  • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.13) Gecko/20101203 Firefox/3.6.13
  • Mozmill PASS
    • Normal: PASS (Known Failures)
    • Restart: PASS (Known Failures)
  • Status: RESULTS in Litmus (Mozmill and Manual)
    • Notes:

Linux (abillings)

  • Date: 12/3/2010
  • Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.13) Gecko/20101203 Firefox/3.6.13
  • Mozmill PASS
    • Normal: PASS (Known Failures)
    • Restart: PASS (Known Failures)
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Smoketests for Build 2

Build IDs

  • Windows: 20101130064308
  • OS X: 20101130064313
  • Linux: 20101130065329

Windows XP (abillings)

  • Date: 11/30/2010
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.13) Gecko/20101130 Firefox/3.6.13
  • Mozmill PASS
    • Normal: PASS (known failures)
    • Restart: PASS (known AMO bug)
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Windows 7 (gmontagu)

  • Date: 11/30/2010
  • Build ID:
  • Mozmill PASS
    • Normal: PASS (known failures)
    • Restart: PASS (known failures)
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Windows Vista (abillings)

  • Date: 11/30/2010
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.13) Gecko/20101130 Firefox/3.6.13
  • Mozmill PASS
    • Normal: PASS (known failures)
    • Restart: PASS (known AMO bug)
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Mac OS X 10.6 (abillings)

  • Date: 11/30/2010
  • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.13) Gecko/20101130 Firefox/3.6.13
  • Mozmill PASS
    • Normal: PASS (known failures)
    • Restart: PASS (known AMO bug)
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Linux (abillings)

  • Date: 11/30/2010
  • Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.13) Gecko/20101130 Firefox/3.6.13
  • Mozmill PASS
    • Normal: PASS (known failures)
    • Restart: PASS (known AMO bug)
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Smoketests for Build 1

Build IDs

  • Windows: 20101122053531
  • OS X: 20101122044323
  • Linux: 20101122045408

Windows XP (abillings)

  • Date: 11/22/2010
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.13) Gecko/20101122 Firefox/3.6.13
  • Mozmill PASS (known failures)
    • Normal: PASS
    • Restart: PASS (known failures)
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Windows 7 (gmontagu)

  • Date: 11/22/2010
  • Build ID: 20101122053531
  • Mozmill PASS (known failures)
    • Normal: PASS
    • Restart: PASS (known failures)
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes: Hovering over/wearing personas doesn't change the UI. (Al note: I tested this scenario and it works fine on my machine.)

Windows Vista (abillings)

  • Date: 11/22/2010
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.13) Gecko/20101122 Firefox/3.6.13
  • Mozmill PASS (known failures)
    • Normal: PASS
    • Restart: PASS (known failures)
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Mac OS X 10.6 (gmealer)

  • Date: 2010-11-22
  • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.13) Gecko/20101122 Firefox/3.6.13
  • Mozmill RESULTS (known failures)
    • Normal: PASS
    • Restart: PASS (known failures)
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Linux (abillings)

  • Date: 11/22/2010
  • Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.13) Gecko/20101122 Firefox/3.6.13
  • Mozmill PASS (known failures)
    • Normal: PASS (known failures)
    • Restart: PASS (known failures)
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

BFTs

Build 3


Build 2


Build 1

Windows XP (Waverley)

  • Date: 2010/11/23
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.13) Gecko/20101122 Firefox/3.6.13

The Manual section of the BFT will be divided up in four sections.

  • Sections (from Litmus in order)
    • Installation - Tabbed Browsing (andreea.pod)
      • Results: PASS in Litmus
    • Search - Addons (andreea.pod)
      • Results: PASS in Litmus
      • Notes: known failures
    • Downloading - Cookies (teodosia.pop)
      • Results: PASS in Litmus
    • Security - Uninstall (teodosia.pop)
      • Results: PASS in Litmus
      • Notes: known failures

Other OS Spot Checks

Windows 2000 (abillings)

  • Date: 11/30/2010
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.9.2.13) Gecko/20101130 Firefox/3.6.13
  • Status: PASS
Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_3.6.13/Test_Plan:Smoketests&oldid=271794"