Releases/Firefox 3.5.19/Test Plan:Smoketests: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(21 intermediate revisions by 4 users not shown)
Line 4: Line 4:


= Firefox 3.5.19 Smoketest and BFT Results =
= Firefox 3.5.19 Smoketest and BFT Results =
= Smoketests for Build 2 =
* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=290 Click] to run the Smoketests
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=290 Smoketest Report]
'''Build IDs'''
* Windows: 20110420144310
* OS X: 20110420144310
* Linux: 20110420144310
== Windows XP (geo) ==
*Date: 2011-04-21
*Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.19) Gecko/20110420 Firefox/3.5.19
*Mozmill '''PASS''' 
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/9410f62953a74cf4090891bc634e3eb6 RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/9410f62953a74cf4090891bc634e5373 RESULTS]
*Status: '''PASS''' in Litmus (Manual)
**Notes:
== Windows 7 (gmontagu) ==
*Date: April 21, 2011
*Build ID: 20110420144310 ( Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.1.19) Gecko/20110420 Firefox/3.5.19)
*Mozmill '''PASS''' 
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/9410f62953a74cf4090891bc634e3eb6 RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/9410f62953a74cf4090891bc634e661b RESULTS]
*Status: '''PASS''' in Litmus (Manual)
**Notes:
== Windows Vista (Abillings) ==
*Date: 4/21/2011
*Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1.19) Gecko/20110420 Firefox/3.5.19
*Mozmill '''PASS''' 
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/9410f62953a74cf4090891bc634e606a RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/9410f62953a74cf4090891bc634e66c2 RESULTS]
*Status: '''PASS''' in Litmus (Manual)
**Notes:
== Mac OS X 10.6 (geo) ==
*Date: 2011-04-22
*Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.1.19) Gecko/20110420 Firefox/3.5.19
*Mozmill '''PASS''' 
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/9410f62953a74cf4090891bc634e662e RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/9410f62953a74cf4090891bc634e6da8 RESULTS]
*Status: '''RESULTS''' in Litmus (Manual)
**Notes:
== Linux (ABillings) ==
*Date: 4/21/2011
*Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1.19) Gecko/20110420 Firefox/3.5.19
*Mozmill '''PASS''' (known failures)
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/9410f62953a74cf4090891bc634e1b22 RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/9410f62953a74cf4090891bc634e4ab3 RESULTS]
*Status: '''PASS''' in Litmus (Manual)
**Notes:


= Smoketests for Build 1 =
= Smoketests for Build 1 =
Line 69: Line 123:


= BFTs=  
= BFTs=  
== Build 2 ==
* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=291 Click] to run the BFT
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=291 BFT Report]


== Build 1 ==
== Build 1 ==

Latest revision as of 22:43, 21 April 2011

« Firefox:3.5.19:Test_Plan

Smoketests and BFTs are run partially though Mozmill automation and partially through manual testing (where automation does not currently exist). This means that the Mozmill automation is first run and results logged on this page. Then testers will run the leftover manual tests that the Mozmill testing did not cover. Because of this, please speak with QA (usually Hskupin and Abillings) before beginning manual testing if Mozmill results are not logged to the page below.

Firefox 3.5.19 Smoketest and BFT Results

Smoketests for Build 2

Build IDs

  • Windows: 20110420144310
  • OS X: 20110420144310
  • Linux: 20110420144310

Windows XP (geo)

  • Date: 2011-04-21
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.19) Gecko/20110420 Firefox/3.5.19
  • Mozmill PASS
  • Status: PASS in Litmus (Manual)
    • Notes:

Windows 7 (gmontagu)

  • Date: April 21, 2011
  • Build ID: 20110420144310 ( Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.1.19) Gecko/20110420 Firefox/3.5.19)
  • Mozmill PASS
  • Status: PASS in Litmus (Manual)
    • Notes:

Windows Vista (Abillings)

  • Date: 4/21/2011
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1.19) Gecko/20110420 Firefox/3.5.19
  • Mozmill PASS
  • Status: PASS in Litmus (Manual)
    • Notes:

Mac OS X 10.6 (geo)

  • Date: 2011-04-22
  • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.1.19) Gecko/20110420 Firefox/3.5.19
  • Mozmill PASS
  • Status: RESULTS in Litmus (Manual)
    • Notes:

Linux (ABillings)

  • Date: 4/21/2011
  • Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1.19) Gecko/20110420 Firefox/3.5.19
  • Mozmill PASS (known failures)
  • Status: PASS in Litmus (Manual)
    • Notes:

Smoketests for Build 1

Build IDs

  • Windows: 20110414083440
  • OS X: 20110414083440
  • Linux: 20110414083440

Windows XP (Alex)

  • Date: 2011-04-15
  • Build ID: 20110414083440
  • Mozmill PASS
  • Status: PASS in Litmus (Manual)
    • Notes:

Windows 7 (Andrei)

  • Date: 2011-04-15
  • Build ID: 20110414083440
  • Mozmill PASS
  • Status: Results in Litmus (Mozmill and Manual)
    • Manual: PASS in Litmus
    • Notes:

Windows Vista (Simona)

  • Date: 2011-04-15
  • Build ID: 20110414083440
  • Mozmill PASS
  • Status: RESULTS in Litmus (Mozmill and Manual)
    • Manual: PASS in Litmus
    • Notes:

Mac OS X 10.6 (Vlad G)

  • Date: 2011-04-15
  • Build ID: 20110414083440
  • Mozmill PASS
  • Status: RESULTS in Litmus (Mozmill and Manual)
    • Manual: PASS in Litmus
    • Notes:

Linux (George)

  • Date: 2011-04-15
  • Build ID: 20110414083440
  • Mozmill PASS
  • Status: RESULTS in Litmus (Mozmill and Manual)
    • Manual: PASS in Litmus with known issues
    • Notes:
      • New issue:
        • bug 650290 - Larry security doorhangers do not display any text
      • Known issues:
        • bug 625063 - Error while drag and drop bookmarks or history entry on desktop
        • bug 434851 - importing data from opera fails

BFTs

Build 2

Build 1

Manual Windows XP (tester)

  • Date: 2011-04-15
  • Build ID: 20110414083440

The Manual section of the BFT will be divided up in four sections.

  • Sections (from Litmus in order)
    • Installation - Tabbed Browsing (Simona)
      • Results: PASS in Litmus
    • Search - Addons (Simona)
      • Results: PASS in Litmus
    • Downloading - Cookies (Vlad G)
      • Results: PASS in Litmus
    • Security - Uninstall (Vlad G)
      • Results: PASS in Litmus

Other OS Spot Checks

Windows 2000 (tester)

  • Date:
  • Build ID:
  • Mozmill PASS
  • Status: RESULTS in Litmus (Mozmill and Manual)
    • Notes: