Releases/Firefox 3.5.8/Test Plan:Smoketests

From MozillaWiki
Jump to: navigation, search

« Firefox:3.5.8:Test_Plan

Smoketests and BFTs are run partially though Mozmill automation and partially through manual testing (where automation does not currently exist). This means that the Mozmill automation is first run and results logged on this page. Then testers will run the leftover manual tests that the Mozmill testing did not cover. Because of this, please speak with QA (usually Hskupin and Abillings) before beginning manual testing if Mozmill results are not logged to the page below.

Firefox 3.5.8 Smoketest and BFT Results

Build IDs

  • Windows: 20100202165920
  • OS X: 20100202152834
  • Linux: 20100202153512

Smoketests for Build 1

Windows XP (hskupin/abillings)

  • Date: 2/3/2010
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.8) Gecko/20100202 Firefox/3.5.8
  • Mozmill Results:
    • Normal: 1120 / 10
    • Restart: 290 / 4
    • Known failures of Mozmill tests - no real regression
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Windows Vista (hskupin/abillings)

  • Date: 2/3/2010
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1.8) Gecko/20100202 Firefox/3.5.8
  • Mozmill Results:
    • Normal: 294 / 2
    • Restart: 1129 / 7
    • Known failures of Mozmill tests - no real regression
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Windows 7 (hskupin/abillings)

  • Date: 2/3/2010
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.1.8) Gecko/20100202 Firefox/3.5.8
  • Mozmill Results:
    • Normal: 1145 / 6
    • Restart: 298 / 2
    • Known failures of Mozmill tests - no real regression
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Mac OS X 10.5 (hskupin/abillings)

  • Date: 2/3/2010
  • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.1.8) Gecko/20100202 Firefox/3.5.8
  • Mozmill Results:
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Linux (hskupin/abillings)

  • Date: 2/3/2010
  • Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1.8) Gecko/20100202 Firefox/3.5.8
  • Mozmill Results:
    • Normal: 987 / 16
    • Restart: 290 / 6
    • Known failures of Mozmill tests - no real regression
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

BFT's Windows XP (hskupin/abillings)

The BFT will be divided up in four sections.

  • Date: 2/3 - 2/4/2010
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.8) Gecko/20100202 Firefox/3.5.8
    • Installation - Tabbed Browsing (hskupin/abillings)
      • Results: PASS - Results in Litmus
    • Search - Addons (hskupin/abillings)
      • Results: PASS - Results in Litmus
    • Downloading - Cookies (hskupin/abillings)
      • Results: PASS - Results in Litmus
    • Security - Uninstall (hskupin/abillings)
      • Results: PASS - Results in Litmus
  • Notes:

Other OS Spot Checks

Windows 2000 (tester)

  • Date: 2/4/2010
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.9.1.8) Gecko/20100202 Firefox/3.5.8
  • Status: PASS

Bug verification

  • bug 531364 - Security wrappers (not fixed for 1.9.1.8/1.9.0.18)