Releases/Firefox 3.6.19/Test Plan:Smoketests

From MozillaWiki
Jump to: navigation, search

« Firefox:3.6.19:Test_Plan

Smoketests and BFTs are run partially though Mozmill automation and partially through manual testing (where automation does not currently exist). This means that the Mozmill automation is first run and results logged on this page. Then testers will run the leftover manual tests that the Mozmill testing did not cover. Because of this, please speak with QA (usually Hskupin and Abillings) before beginning manual testing if Mozmill results are not logged to the page below.

Firefox 3.6.19 Smoketest and BFT Results

Smoketests for Build 1

Build IDs

  • Windows: 20110707195905
  • OS X: 20110707195905
  • Linux: 20110707195905

Windows XP (tracy)

  • Date: 20110708
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.19) Gecko/20110707 Firefox/3.6.19
  • Mozmill RESULTS
    • Normal: PASS
    • Restart: FAILURES (needs manual testing of 2 Litmus tests)
  • Status: PASS in Litmus (Mozmill and Manual)

Windows 7 (abillings)

  • Date: 07/08/2011
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.19) Gecko/20110707 Firefox/3.6.19
  • Mozmill RESULTS
    • Normal: PASS
    • Restart: FAILURES (needs manual testing of 2 Litmus tests)
  • Status: RESULTS in Litmus (Mozmill and Manual)

Mac OS X 10.6 (tracy)

  • Date: 20110708
  • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.19) Gecko/20110707 Firefox/3.6.19
  • Mozmill RESULTS
    • Normal: PASS
    • Restart: FAILURES (needs manual testing of 2 Litmus tests)
  • Status: PASS in Litmus (Mozmill and Manual)

Mac OS X 10.7 (marcia)

  • Date: 20110708
  • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.7; en-US; rv:1.9.2.19) Gecko/20110707 Firefox/3.6.19
  • Mozmill RESULTS
    • Normal: PASS
    • Restart: FAILURES (needs manual testing of 1 Litmus test)
  • Status: PASS in Litmus (Mozmill and Manual)
  • Issues:
    • Scrollbars don't work right and probably should be released noted.

Linux (Geo)

  • Date: 2011-07-08
  • Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.19) Gecko/20110707 Firefox/3.6.19
  • Mozmill RESULTS
    • Normal: FAILURES (needs manual testing of 2 Litmus tests)
    • Restart: FAILURES (needs manual testing of 2 Litmus tests)
  • Status: PASS in Litmus (Mozmill and Manual)

BFTs

Build 1

Build 1 Manual OS X 10.7 (George)

  • Date: 07/11/2011
  • Build ID: 20110707195905

The Manual section of the BFT will be divided up in four sections.

  • Sections (from Litmus in order)
    • Installation - Tabbed Browsing (George)
      • Results: PASS in Litmus with known issues
    • Search - Addons (George)
      • Results: bug 670655 - Accessing Java site freezes Firefox 3.6.19 on Mac OS X 10.7
    • Downloading - Cookies (George)
      • Results: bug 670668 - Zoom is not preserved across tabs
    • Security - Uninstall (George)
      • Results: PASS in Litmus with known issues

Other OS Spot Checks

Windows 2000 (abillings)

  • Date: 7/11/2011
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.9.2.19) Gecko/20110707 Firefox/3.6.19
  • Mozmill RESULTS
    • Normal: PASS
    • Restart: FAILURES (needs manual testing of 2 Litmus tests)
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes: