Releases/Firefox 3.5.7/Test Plan:Smoketests: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
Line 14: Line 14:
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=86 Smoketest Report]
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=86 Smoketest Report]


== Windows XP (Henrik/Mozmill/juanb) ==
== Windows XP (Henrik/Mozmill/retornam/juanb) ==
* Date: Dec 22
* Date: Dec 22
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.7) Gecko/20091221 Firefox/3.5.7
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.7) Gecko/20091221 Firefox/3.5.7
Line 22: Line 22:
* Status: '''PASS''' in Litmus (Mozmill and Manual)
* Status: '''PASS''' in Litmus (Mozmill and Manual)
** Notes: Manually ran tests that are not covered by Mozmill.
** Notes: Manually ran tests that are not covered by Mozmill.
**Manual Tests in Litmus passed


== Windows Vista (abillings) ==
== Windows Vista (abillings) ==

Revision as of 21:18, 22 December 2009

« Firefox:3.5.7:Test_Plan

Smoketests and BFTs are run partially though Mozmill automation and partially through manual testing (where automation does not currently exist). This means that the Mozmill automation is first run and results logged on this page. Then testers will run the leftover manual tests that the Mozmill testing did not cover. Because of this, please speak with QA (usually Hskupin and Abillings) before beginning manual testing if Mozmill results are not logged to the page below.

Firefox 3.5.7 Smoketest and BFT Results

Build IDs

  • Windows: 20091221164558
  • OS X: 20091221151141
  • Linux: 20091221152502

Smoketests for Build 1

Windows XP (Henrik/Mozmill/retornam/juanb)

  • Date: Dec 22
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.7) Gecko/20091221 Firefox/3.5.7
  • Mozmill Results:
    • Normal: Passed 168 :: Failed 10 :: Skipped 0
    • Restart: Passed 42 :: Failed 0 :: Skipped 0
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes: Manually ran tests that are not covered by Mozmill.
    • Manual Tests in Litmus passed

Windows Vista (abillings)

  • Date: 12/22/2009
  • Build ID:
  • Mozmill Results:
    • Normal:
    • Restart:
  • Status: RESULT in Litmus (Mozmill and Manual)

Windows 7 (tester)

  • Date:
  • Build ID:
  • Mozmill Results:
    • Normal: Passed 167 :: Failed 11 :: Skipped 0
    • Restart: Passed 42 :: Failed 0 :: Skipped 0
  • Status: RESULT in Litmus (Mozmill and Manual)

Mac OS X 10.5 (tester)

  • Date:
  • Build ID:
  • Mozmill Results:
    • Normal: Passed 172 :: Failed 6  :: Skipped 0
    • Restart: Passed 42 :: Failed 0 :: Skipped 0
  • Status: RESULT in Litmus (Mozmill and Manual)

Linux (juanb)

  • Date: Dec 22
  • Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1.7) Gecko/20091221 Firefox/3.5.7
  • Mozmill Results:
    • Normal: Passed 169 :: Failed 9 :: Skipped 0
    • Restart: Passed 42 :: Failed 0 :: Skipped 0
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes: Manually ran those tests not covered by Mozmill.

BFT's Windows XP (team)

The BFT will be divided up in four sections.

  • Date:
  • Build ID:
    • Installation - Tabbed Browsing (tester)
      • Results: RESULTS - Results in Litmus
    • Search - Addons (tester)
      • Results: RESULTS - Results in Litmus
    • Downloading - Cookies (tester)
      • Results: RESULTS - Results in Litmus
    • Security - Uninstall (tester)
      • Results: RESULTS - Results in Litmus
  • Notes:

Other OS Spot Checks

Mac OS X 10.5 (tester)

  • Date:
  • Build ID:
  • Status: RESULT

Windows 2000 (tester)

  • Date:
  • Build ID:
  • Status: RESULT