Releases/Firefox 3.5.15/Test Plan:Smoketests: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
Line 17: Line 17:
*Date:  
*Date:  
*Build ID:  
*Build ID:  
*Mozmill '''RESULTS''' (known failures)
*Mozmill '''PASS'''
**Normal: [xx Results]  
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4a2217a8a22f02aec478e6684a1397c7 PASS] (known failures)
**Restart: [xx Results]  
**Restart: [xx Results]  
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)  
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)  
Line 26: Line 26:
*Date:  
*Date:  
*Build ID:  
*Build ID:  
*Mozmill '''RESULTS''' (known failures)
*Mozmill '''PASS'''
**Normal: [xx Results]  
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4a2217a8a22f02aec478e6684a13b320 PASS] (known failures)
**Restart: [xx Results]  
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4a2217a8a22f02aec478e6684a13c82c PASS]  
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)  
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)  
**Notes:
**Notes:
Line 36: Line 36:
*Date:  
*Date:  
*Build ID:  
*Build ID:  
*Mozmill '''RESULTS''' (known failures)
*Mozmill '''PASS'''
**Normal: [xx Results]  
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4a2217a8a22f02aec478e6684a136357 PASS] (known failures)
**Restart: [xx Results]  
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4a2217a8a22f02aec478e6684a138a5f PASS] (intermittent failure) 
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)  
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)  
**Notes:
**Notes:
Line 45: Line 45:
*Date:  
*Date:  
*Build ID:  
*Build ID:  
*Mozmill '''RESULTS''' (known failures)
*Mozmill '''PASS'''
**Normal: [xx Results]  
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4a2217a8a22f02aec478e6684a1344c7 PASS] (known failures)
**Restart: [xx Results]  
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4a2217a8a22f02aec478e6684a138360 PASS] (known failures)
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)  
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)  
**Notes:
**Notes:
Line 54: Line 54:
*Date:  
*Date:  
*Build ID:  
*Build ID:  
*Mozmill '''RESULTS''' (known failures)
*Mozmill '''PASS'''
**Normal: [xx Results]  
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4a2217a8a22f02aec478e6684a135aa2 PASS] (known failures)
**Restart: [xx Results]  
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4a2217a8a22f02aec478e6684a137852 PASS] (known failure)
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)  
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)  
**Notes:
**Notes:

Revision as of 08:57, 27 October 2010

« Firefox:3.5.15:Test_Plan

Smoketests and BFTs are run partially though Mozmill automation and partially through manual testing (where automation does not currently exist). This means that the Mozmill automation is first run and results logged on this page. Then testers will run the leftover manual tests that the Mozmill testing did not cover. Because of this, please speak with QA (usually Hskupin and Abillings) before beginning manual testing if Mozmill results are not logged to the page below.

Firefox 3.5.15 Smoketest and BFT Results

Smoketests for Build 1

Build IDs

  • Windows: 20101026205513
  • OS X: 20101026200251
  • Linux: 20101026195820

Windows XP (tester)

  • Date:
  • Build ID:
  • Mozmill PASS
    • Normal: PASS (known failures)
    • Restart: [xx Results]
  • Status: RESULTS in Litmus (Mozmill and Manual)
    • Notes:

Windows 7 (tester)

  • Date:
  • Build ID:
  • Mozmill PASS
    • Normal: PASS (known failures)
    • Restart: PASS
  • Status: RESULTS in Litmus (Mozmill and Manual)
    • Notes:


Windows Vista (tester)

  • Date:
  • Build ID:
  • Mozmill PASS
    • Normal: PASS (known failures)
    • Restart: PASS (intermittent failure)
  • Status: RESULTS in Litmus (Mozmill and Manual)
    • Notes:

Mac OS X 10.6 (tester)

  • Date:
  • Build ID:
  • Mozmill PASS
    • Normal: PASS (known failures)
    • Restart: PASS (known failures)
  • Status: RESULTS in Litmus (Mozmill and Manual)
    • Notes:

Linux (tester)

  • Date:
  • Build ID:
  • Mozmill PASS
    • Normal: PASS (known failures)
    • Restart: PASS (known failure)
  • Status: RESULTS in Litmus (Mozmill and Manual)
    • Notes:

BFTs for Build 1

Windows XP (Team)

  • Date:
  • Build ID:

The Manual section of the BFT will be divided up in four sections.

  • Sections (from Litmus in order)
    • Installation - Tabbed Browsing (tester)
      • Results: RESULTS - Results in Litmus
    • Search - Addons (tester)
      • Results: RESULTS - Results in Litmus
    • Downloading - Cookies (tester)
      • Results: RESULTS - Results in Litmus
    • Security - Uninstall (tester)
      • Results: RESULTS - Results in Litmus
      • Notes:

Other OS Spot Checks

Windows 2000 (tester)

  • Date:
  • Build ID:
  • Status: RESULTS