MozillaWiki

Releases/Firefox 3.5.16/Test Plan:Smoketests: Difference between revisions

< Releases‎ | Firefox 3.5.16
 
(8 intermediate revisions by the same user not shown)
Line 15: Line 15:


== Windows XP (abillings)  ==
== Windows XP (abillings)  ==
*Date:  
*Date: 11/30/2010
*Build ID:  
*Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.16) Gecko/20101130 Firefox/3.5.16
*Mozmill '''RESULTS'''  
*Mozmill '''PASS'''  
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4241a40ae220f2ac4d991412f16d72bd PASS] (known failures)
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4241a40ae220f2ac4d991412f16d72bd PASS] (known failures)
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4241a40ae220f2ac4d991412f16dc16b PASS] (known failures)  
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4241a40ae220f2ac4d991412f16dc16b PASS] (known failures)  
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)  
*Status: '''PASS''' in Litmus (Mozmill and Manual)  
**Notes:
**Notes:


Line 33: Line 33:


== Windows Vista (abillings) ==
== Windows Vista (abillings) ==
*Date:  
*Date: 11/30/2010
*Build ID:  
*Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1.16) Gecko/20101130 Firefox/3.5.16
*Mozmill '''RESULTS'''  
*Mozmill '''PASS'''  
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4241a40ae220f2ac4d991412f16d8fd1 PASS] (known failures)
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4241a40ae220f2ac4d991412f16d8fd1 PASS] (known failures)
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4241a40ae220f2ac4d991412f16dfe90 PASS] (known AMO bug)  
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4241a40ae220f2ac4d991412f16dfe90 PASS] (known AMO bug)  
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)  
*Status: '''PASS''' in Litmus (Mozmill and Manual)  
**Notes:
**Notes:


== Mac OS X 10.6 (gmealer) ==
== Mac OS X 10.6 (abillings) ==
*Date:  
*Date: 11/30/2010
*Build ID:  
*Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.1.16) Gecko/20101130 Firefox/3.5.16
*Mozmill '''RESULTS'''  
*Mozmill '''PASS'''  
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4241a40ae220f2ac4d991412f16db162 PASS] (known failures)
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4241a40ae220f2ac4d991412f16db162 PASS] (known failures)
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4241a40ae220f2ac4d991412f16e126f PASS] (known failures)  
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4241a40ae220f2ac4d991412f16e126f PASS] (known failures)  
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)  
*Status: '''PASS''' in Litmus (Mozmill and Manual)  
**Notes:
**Notes:


== Linux (abillings) ==
== Linux (abillings) ==
*Date:  
*Date: 11/30/2010
*Build ID:  
*Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1.16) Gecko/20101130 Firefox/3.5.16
*Mozmill '''RESULTS'''  
*Mozmill '''PASS'''  
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4241a40ae220f2ac4d991412f16d7d45 PASS] (known failures)
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4241a40ae220f2ac4d991412f16d7d45 PASS] (known failures)
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4241a40ae220f2ac4d991412f16de8b0 PASS] (some new failures due to the modal dialog change)  
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4241a40ae220f2ac4d991412f16de8b0 PASS] (some new failures due to the modal dialog change)  
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)  
*Status: '''PASS''' in Litmus (Mozmill and Manual)  
**Notes:
**Notes:


Line 145: Line 145:


= Other OS Spot Checks =
= Other OS Spot Checks =
== Windows 2000 (tester) ==
== Windows 2000 (abillings) ==
* Date:  
* Date: 11/30/2010
* Build ID:  
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.9.1.16) Gecko/20101130 Firefox/3.5.16
* Status: '''RESULTS'''
* Status: '''PASS'''

Latest revision as of 01:50, 1 December 2010

« Firefox:3.5.16:Test_Plan

Smoketests and BFTs are run partially though Mozmill automation and partially through manual testing (where automation does not currently exist). This means that the Mozmill automation is first run and results logged on this page. Then testers will run the leftover manual tests that the Mozmill testing did not cover. Because of this, please speak with QA (usually Hskupin and Abillings) before beginning manual testing if Mozmill results are not logged to the page below.

Firefox 3.5.16 Smoketest and BFT Results

Smoketests for Build 2

Build IDs

  • Windows: 20101130074636
  • OS X: 20101130074220
  • Linux: 20101130074614

Windows XP (abillings)

  • Date: 11/30/2010
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.16) Gecko/20101130 Firefox/3.5.16
  • Mozmill PASS
    • Normal: PASS (known failures)
    • Restart: PASS (known failures)
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Windows 7 (gmontagu)

  • Date: 11/30/2010
  • Build ID:
  • Mozmill RESULTS
    • Normal: PASS (known failures)
    • Restart: PASS (known failures)
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Windows Vista (abillings)

  • Date: 11/30/2010
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1.16) Gecko/20101130 Firefox/3.5.16
  • Mozmill PASS
    • Normal: PASS (known failures)
    • Restart: PASS (known AMO bug)
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Mac OS X 10.6 (abillings)

  • Date: 11/30/2010
  • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.1.16) Gecko/20101130 Firefox/3.5.16
  • Mozmill PASS
    • Normal: PASS (known failures)
    • Restart: PASS (known failures)
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Linux (abillings)

  • Date: 11/30/2010
  • Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1.16) Gecko/20101130 Firefox/3.5.16
  • Mozmill PASS
    • Normal: PASS (known failures)
    • Restart: PASS (some new failures due to the modal dialog change)
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Smoketests for Build 1

Build IDs

  • Windows: 2001122063257
  • OS X: 20101122054656
  • Linux: 20101122054930

Windows XP (abillings)

  • Date: 11/22/2010
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.16) Gecko/20101122 Firefox/3.5.16
  • Mozmill PASS (known failures)
    • Normal: PASS (partly known failures)
    • Restart: PASS (known failures)
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Windows 7 (gmontagu)

  • Date: Nov 22
  • Build ID: 20101122063257
  • Mozmill PASS (known failures)
    • Normal: PASS (partly known failures)
    • Restart: PASS (known failures)
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Windows Vista (abillings)

  • Date: 11/22/2010
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1.16) Gecko/20101122 Firefox/3.5.16
  • Mozmill PASS (known failures)
    • Normal: PASS (partly known failures)
    • Restart: PASS (known failures)
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Mac OS X 10.6 (gmealer)

  • Date: 2010-11-22
  • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.1.16) Gecko/20101122 Firefox/3.5.16
  • Mozmill RESULTS (known failures)
    • Normal: PASS (partly known failures)
    • Restart: PASS (known failures)
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Linux (abillings)

  • Date: 11/22/2010
  • Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1.16) Gecko/20101122 Firefox/3.5.16
  • Mozmill PASS (known failures)
    • Normal: PASS (partly known failures)
    • Restart: PASS (known failures)
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

BFTs

Build 2


Build 1

Windows XP (Waverley)

  • Date: 11/23/2010
  • Build ID: Mozilla/5.0 (Windows; Windows NT 5.1; en-US;rv:1.9.1.16) Gecko/20101122 Firefox/3.5.16

The Manual section of the BFT will be divided up in four sections.

  • Sections (from Litmus in order)
    • Installation - Tabbed Browsing (vlad)
      • Results: PASS - Results in Litmus
    • Search - Addons (vlad)
      • Results: PASS - Results in Litmus
    • Downloading - Cookies (vlad)
      • Results: PASS - Results in Litmus
    • Security - Uninstall (vlad)
      • Results: PASS - Results in Litmus
      • Notes: No new/blocking issues found

Other OS Spot Checks

Windows 2000 (abillings)

  • Date: 11/30/2010
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.9.1.16) Gecko/20101130 Firefox/3.5.16
  • Status: PASS
Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_3.5.16/Test_Plan:Smoketests&oldid=271061"