Releases/Firefox 3.6.20/Test Plan:Smoketests: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(20 intermediate revisions by 5 users not shown)
Line 15: Line 15:


== Windows XP (SimonaB) ==
== Windows XP (SimonaB) ==
*Date:  
*Date: 08/04/2011
*Build ID:  
*Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.20) Gecko/20110803 Firefox/3.6.20
*Mozmill '''PASS''' (some failures)
*Mozmill '''PASS''' (some failures)
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/15a8b41a151956b8d71bd0934ba289c5 RESULTS]  
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/15a8b41a151956b8d71bd0934ba289c5 RESULTS]  
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/15a8b41a151956b8d71bd0934ba2d2ae RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/15a8b41a151956b8d71bd0934ba2d2ae RESULTS]
*Status: '''RESULT''' in Litmus (Mozmill and Manual)
*Status: '''PASS''' in Litmus (Mozmill and Manual)


== Windows 7 (AndreiD) ==
== Windows 7 (AndreiD) ==
Line 31: Line 31:


== Windows Vista (SimonaB) ==
== Windows Vista (SimonaB) ==
*Date:  
*Date: 08/04/2011
*Build ID:  
*Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.20) Gecko/20110803 Firefox/3.6.20
*Mozmill '''PASS''' (some failures)
*Mozmill '''PASS''' (some failures)
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/15a8b41a151956b8d71bd0934ba284a2 RESULTS]  
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/15a8b41a151956b8d71bd0934ba284a2 RESULTS]  
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/15a8b41a151956b8d71bd0934ba2cc5b RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/15a8b41a151956b8d71bd0934ba2cc5b RESULTS]
*Status: '''RESULT''' in Litmus (Mozmill and Manual)
*Status: '''PASS''' in Litmus (Mozmill and Manual)


== Mac OS X 10.7 (VladG) ==
== Mac OS X 10.7 (VladG) ==
Line 48: Line 48:
== Mac OS X 10.6 (VladG) ==
== Mac OS X 10.6 (VladG) ==
*Date: 04/08/2011
*Date: 04/08/2011
*Build ID:  
*Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.20) Gecko/20110803 Firefox/3.6.20
*Mozmill '''PASS''' (some failures)
*Mozmill '''PASS''' (some failures)
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/15a8b41a151956b8d71bd0934ba2a6e4 RESULTS]  
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/15a8b41a151956b8d71bd0934ba2a6e4 RESULTS]  
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/15a8b41a151956b8d71bd0934ba2fced RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/15a8b41a151956b8d71bd0934ba2fced RESULTS]
*Status: '''RESULT''' in Litmus (Mozmill and Manual)
*Status: '''PASS''' in Litmus (Mozmill and Manual)


== Linux (AndreiD) ==
== Linux (AndreiD) ==
*Date:  
*Date: 08/04/2011
*Build ID:  
*Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.20) Gecko/20110803 Firefox/3.6.20
*Mozmill '''PASS''' (some failures)
*Mozmill '''PASS''' (some failures)
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/15a8b41a151956b8d71bd0934b9d44e5 RESULTS]  
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/15a8b41a151956b8d71bd0934b9d44e5 RESULTS]  
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/15a8b41a151956b8d71bd0934ba2b351 RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/15a8b41a151956b8d71bd0934ba2b351 RESULTS]
*Status: '''RESULT''' in Litmus (Mozmill and Manual)
*Status: '''PASS''' in Litmus (Mozmill and Manual)
 
== Windows 2000 (Alin) ==
*Date: 04/08/2011
*Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.9.2.20) Gecko/20110803 Firefox/3.6.20
*Mozmill '''PASS''' 
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/15a8b41a151956b8d71bd0934ba28d6a RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/15a8b41a151956b8d71bd0934ba2c1cb RESULTS]
*Status: '''PASS''' in Litmus (Mozmill and Manual)


= BFTs=  
= BFTs=  
Line 77: Line 85:


*Sections (from Litmus in order)  
*Sections (from Litmus in order)  
**Installation - Tabbed Browsing ('''tester''')  
**Installation - Tabbed Browsing ('''Andrei''')  
***Results: '''RESULT''' in Litmus
***Results: '''PASS''' in Litmus
**Search - Addons ('''tester''')  
**Search - Addons ('''Alin, George''')  
***Results: '''RESULT''' in Litmus
***Results: '''PASS''' in Litmus
**Downloading - Cookies ('''tester''')  
**Downloading - Cookies ('''Simona''')  
***Results: '''RESULT''' in Litmus
***Results: '''PASS''' in Litmus
**Security - Uninstall ('''tester''')  
**Security - Uninstall ('''VladG''')  
***Results: '''RESULT''' in Litmus
***Results: '''PASS''' With known issues in Litmus
 
= Other OS Spot Checks =
== Windows 2000 (SimonaB) ==
*Date:
*Build ID:
*Mozmill '''RESULTS''' 
**Normal: [x RESULTS]
**Restart: [x RESULTS]
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)
**Notes:

Latest revision as of 14:51, 4 August 2011

« Firefox:3.6.20:Test_Plan

Smoketests and BFTs are run partially though Mozmill automation and partially through manual testing (where automation does not currently exist). This means that the Mozmill automation is first run and results logged on this page. Then testers will run the leftover manual tests that the Mozmill testing did not cover. Because of this, please speak with QA (usually Hskupin and Abillings) before beginning manual testing if Mozmill results are not logged to the page below.

Firefox 3.6.20 Smoketest and BFT Results

Smoketests for Build 1

Build IDs

  • Windows: 20110803131630
  • OS X: 20110803131630
  • Linux: 20110803131630

Windows XP (SimonaB)

  • Date: 08/04/2011
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.20) Gecko/20110803 Firefox/3.6.20
  • Mozmill PASS (some failures)
  • Status: PASS in Litmus (Mozmill and Manual)

Windows 7 (AndreiD)

  • Date: 08/04/2011
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.20) Gecko/20110803 Firefox/3.6.20
  • Mozmill PASS (some failures)
  • Status: PASS in Litmus (Mozmill and Manual)

Windows Vista (SimonaB)

  • Date: 08/04/2011
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.20) Gecko/20110803 Firefox/3.6.20
  • Mozmill PASS (some failures)
  • Status: PASS in Litmus (Mozmill and Manual)

Mac OS X 10.7 (VladG)

  • Date: 04/08/2011
  • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.7; en-US; rv:1.9.2.20) Gecko/20110803 Firefox/3.6.20
  • Mozmill PASS (some failures)
  • Status: PASS in Litmus (Mozmill and Manual)

Mac OS X 10.6 (VladG)

  • Date: 04/08/2011
  • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.20) Gecko/20110803 Firefox/3.6.20
  • Mozmill PASS (some failures)
  • Status: PASS in Litmus (Mozmill and Manual)

Linux (AndreiD)

  • Date: 08/04/2011
  • Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.20) Gecko/20110803 Firefox/3.6.20
  • Mozmill PASS (some failures)
  • Status: PASS in Litmus (Mozmill and Manual)

Windows 2000 (Alin)

  • Date: 04/08/2011
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.9.2.20) Gecko/20110803 Firefox/3.6.20
  • Mozmill PASS
  • Status: PASS in Litmus (Mozmill and Manual)

BFTs

Build 1

Build 1 Manual Windows XP (Waverly)

  • Date:
  • Build ID: (from about:)

The Manual section of the BFT will be divided up in four sections.

  • Sections (from Litmus in order)
    • Installation - Tabbed Browsing (Andrei)
      • Results: PASS in Litmus
    • Search - Addons (Alin, George)
      • Results: PASS in Litmus
    • Downloading - Cookies (Simona)
      • Results: PASS in Litmus
    • Security - Uninstall (VladG)
      • Results: PASS With known issues in Litmus