MozillaWiki

Releases/Firefox 3.6.18/Test Plan:Smoketests: Difference between revisions

< Releases‎ | Firefox 3.6.18
 
(21 intermediate revisions by 6 users not shown)
Line 4: Line 4:


= Firefox 3.6.18 Smoketest and BFT Results =
= Firefox 3.6.18 Smoketest and BFT Results =
= Smoketests for Build 2 =
* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=311 Click] to run the Smoketests
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=311 Smoketest Report]
'''Build IDs'''
* Windows: 20110614230723
* OS X: 20110614230723
* Linux: 20110614230723
== Windows XP (geo) ==
*Date: 6/15/2011
*Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.18) Gecko/20110614 Firefox/3.6.18
*Mozmill '''PASS''' (Failures)
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/2b64351051ea3e92cb4169d42c8e192f RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/2b64351051ea3e92cb4169d42c8ea7d1 RESULTS]
*Status: '''PASS''' in Litmus (Mozmill and Manual)
== Windows 7 (ABillings) ==
*Date: 6/15/2011
*Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.18) Gecko/20110614 Firefox/3.6.18
*Mozmill '''PASS''' (Failures) 
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/2b64351051ea3e92cb4169d42c8def71 RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/2b64351051ea3e92cb4169d42c8e786a RESULTS]
*Status: '''PASS''' in Litmus (Mozmill and Manual)
== Windows Vista (ABillings) ==
*Date: 6/15/2011
*Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.18) Gecko/20110614 Firefox/3.6.18
*Mozmill '''PASS''' (Failures) 
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/2b64351051ea3e92cb4169d42c8df375 RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/2b64351051ea3e92cb4169d42c8e5c39 RESULTS]
*Status: '''PASS''' in Litmus (Mozmill and Manual)
== Mac OS X 10.6 (geo) ==
*Date: 6/15/2011
*Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.18) Gecko/20110614 Firefox/3.6.18
*Mozmill '''PASS''' (Failures) 
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/2b64351051ea3e92cb4169d42c8e39b3 RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/2b64351051ea3e92cb4169d42c8eb953 RESULTS]
*Status: '''PASS''' in Litmus (Mozmill and Manual)
== Linux (ABillings) ==
*Date: 6/15/2011
*Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.18) Gecko/20110614 Firefox/3.6.18
*Mozmill '''PASS''' (Failures) 
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/2b64351051ea3e92cb4169d42c8df2de RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/2b64351051ea3e92cb4169d42c8e6a72 RESULTS]
*Status: '''PASS''' in Litmus (Mozmill and Manual)


= Smoketests for Build 1 =
= Smoketests for Build 1 =
Line 28: Line 77:
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/fa6151691f6ffd37c8fe1b01b3731688 RESULTS]  
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/fa6151691f6ffd37c8fe1b01b3731688 RESULTS]  
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/fa6151691f6ffd37c8fe1b01b3734ef9 RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/fa6151691f6ffd37c8fe1b01b3734ef9 RESULTS]
*Status: '''PASS''' in Litmus (Mozmill and Manual) Pop-ups aren't blocked.
*Status: '''PASS''' in Litmus (Mozmill and Manual)


== Windows Vista (ABillings) ==
== Windows Vista (ABillings) ==
Line 55: Line 104:


= BFTs=  
= BFTs=  
== Build 2 ==
* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=312 Click] to run the BFT
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=312 BFT Report]


== Build 1 ==
== Build 1 ==
Line 61: Line 115:
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=308 BFT Report]
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=308 BFT Report]


== Manual Windows XP (VladG, George, Andrei, Simona)  ==
=== Build 1 Manual Windows XP (VladG, George, Andrei)  ===


*Date:  
*Date: 06/14/2011
*Build ID: (from about:)
*Build ID: (from about:) Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.18) Gecko/20110613 Firefox/3.6.18 (.NET CLR 3.5.30729)


The Manual section of the BFT will be divided up in four sections.  
The Manual section of the BFT will be divided up in four sections.  


*Sections (from Litmus in order)  
*Sections (from Litmus in order)  
**Installation - Tabbed Browsing ('''Simona''')  
**Installation - Tabbed Browsing ('''VladG''')  
***Results: '''RESULTS''' in Litmus
***Results: '''PASS''' in Litmus with known issues
**Search - Addons ('''Andrei''')  
**Search - Addons ('''Andrei''')  
***Results: '''RESULTS''' in Litmus   
***Results: '''PASS''' in Litmus  with known issues
**Downloading - Cookies ('''George''')  
**Downloading - Cookies ('''George''')  
***Results: '''RESULTS''' in Litmus
***Results: '''PASS''' in Litmus with known issues
**Security - Uninstall ('''VladG''')  
**Security - Uninstall ('''VladG''')  
***Results: '''RESULTS''' in Litmus
***Results: '''PASS''' in Litmus with known issues


= Other OS Spot Checks =
= Other OS Spot Checks =
Line 82: Line 136:
*Date:  
*Date:  
*Build ID:  
*Build ID:  
*Mozmill '''RESULTS'''   
*Mozmill '''PASS'''   
**Normal: [x RESULTS]  
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/2b64351051ea3e92cb4169d42c8deda0 RESULTS]  
**Restart: [x RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/2b64351051ea3e92cb4169d42c8e4df5 RESULTS]
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)  
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)  
**Notes:
**Notes:

Latest revision as of 22:20, 15 June 2011

« Firefox:3.6.18:Test_Plan

Smoketests and BFTs are run partially though Mozmill automation and partially through manual testing (where automation does not currently exist). This means that the Mozmill automation is first run and results logged on this page. Then testers will run the leftover manual tests that the Mozmill testing did not cover. Because of this, please speak with QA (usually Hskupin and Abillings) before beginning manual testing if Mozmill results are not logged to the page below.

Firefox 3.6.18 Smoketest and BFT Results

Smoketests for Build 2

Build IDs

  • Windows: 20110614230723
  • OS X: 20110614230723
  • Linux: 20110614230723

Windows XP (geo)

  • Date: 6/15/2011
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.18) Gecko/20110614 Firefox/3.6.18
  • Mozmill PASS (Failures)
  • Status: PASS in Litmus (Mozmill and Manual)

Windows 7 (ABillings)

  • Date: 6/15/2011
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.18) Gecko/20110614 Firefox/3.6.18
  • Mozmill PASS (Failures)
  • Status: PASS in Litmus (Mozmill and Manual)

Windows Vista (ABillings)

  • Date: 6/15/2011
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.18) Gecko/20110614 Firefox/3.6.18
  • Mozmill PASS (Failures)
  • Status: PASS in Litmus (Mozmill and Manual)

Mac OS X 10.6 (geo)

  • Date: 6/15/2011
  • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.18) Gecko/20110614 Firefox/3.6.18
  • Mozmill PASS (Failures)
  • Status: PASS in Litmus (Mozmill and Manual)

Linux (ABillings)

  • Date: 6/15/2011
  • Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.18) Gecko/20110614 Firefox/3.6.18
  • Mozmill PASS (Failures)
  • Status: PASS in Litmus (Mozmill and Manual)

Smoketests for Build 1

Build IDs

  • Windows: 20110613024313
  • OS X: 20110613024313
  • Linux: 20110613024313

Windows XP (geo)

  • Date: 2011-06-13
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.18) Gecko/20110613 Firefox/3.6.18
  • Mozmill PASS (Failures)
  • Status: PASS in Litmus (Mozmill and Manual)

Windows 7 (GMontagu)

  • Date: 6/13/11
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.18) Gecko/20110613 Firefox/3.6.18
  • Mozmill PASS (Failures)
  • Status: PASS in Litmus (Mozmill and Manual)

Windows Vista (ABillings)

  • Date: 6/13/2011
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.18) Gecko/20110613 Firefox/3.6.18
  • Mozmill PASS (Failures)
  • Status: PASS in Litmus (Mozmill and Manual)

Mac OS X 10.6 (geo)

  • Date: 2011-06-13
  • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.18) Gecko/20110613 Firefox/3.6.18
  • Mozmill PASS (Failures)
  • Status: PASS in Litmus (Mozmill and Manual)

Linux (ABillings)

  • Date: 6/13/2011
  • Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.18) Gecko/20110613 Firefox/3.6.18
  • Mozmill PASS (Failures)
  • Status: PASS in Litmus (Mozmill and Manual)

BFTs

Build 2

Build 1

Build 1 Manual Windows XP (VladG, George, Andrei)

  • Date: 06/14/2011
  • Build ID: (from about:) Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.18) Gecko/20110613 Firefox/3.6.18 (.NET CLR 3.5.30729)

The Manual section of the BFT will be divided up in four sections.

  • Sections (from Litmus in order)
    • Installation - Tabbed Browsing (VladG)
      • Results: PASS in Litmus with known issues
    • Search - Addons (Andrei)
      • Results: PASS in Litmus with known issues
    • Downloading - Cookies (George)
      • Results: PASS in Litmus with known issues
    • Security - Uninstall (VladG)
      • Results: PASS in Litmus with known issues

Other OS Spot Checks

Windows 2000 (tester)

  • Date:
  • Build ID:
  • Mozmill PASS
  • Status: RESULTS in Litmus (Mozmill and Manual)
    • Notes:
Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_3.6.18/Test_Plan:Smoketests&oldid=319638"