Releases/Firefox 3.5.15/Test Plan:Smoketests: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
No edit summary
 
(13 intermediate revisions by 4 users not shown)
Line 6: Line 6:


= Smoketests for Build 1 =
= Smoketests for Build 1 =
* <strike>[https://litmus.mozilla.org/run_tests.cgi?test_run_id=232 Click] to run the Smoketests</strike> - '''Need Build IDs'''
* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=232 Click] to run the Smoketests
* <strike>[https://litmus.mozilla.org/test_run_report.cgi?test_run_id=232 Smoketest Report]</strike> - '''Need Build IDs'''
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=232 Smoketest Report]


'''Build IDs'''
'''Build IDs'''
* Windows:  
* Windows: 20101026205513
* OS X:  
* OS X: 20101026200251
* Linux:  
* Linux: 20101026195820


== Windows XP (tester)  ==
== Windows XP (teodosia)  ==
*Date:  
*Date: 10/27/2010
*Build ID:  
*Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.1.15) Gecko/20101026 Firefox/3.5.15
*Mozmill '''RESULTS''' (known failures)
*Mozmill '''PASS'''
**Normal: [xx Results]
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4a2217a8a22f02aec478e6684a1397c7 PASS] (known failures)  
**Restart: [xx Results]  
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4a2217a8a22f02aec478e6684a13d68d PASS]  
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)
*Status: '''PASS''' in Litmus (Manual)  
**Notes:
**Notes: No new issues found
 
== Windows 7 (tester) ==
*Date:
*Build ID:
*Mozmill '''RESULTS'''  (known failures)
**Normal: [xx Results]
**Restart: [xx Results]  
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)  
**Notes:


== Windows 7 (vlad) ==
*Date: 10/27/2010
*Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.1.15) Gecko/20101026 Firefox/3.5.15
*Mozmill '''PASS'''
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4a2217a8a22f02aec478e6684a13b320 PASS] (known failures)
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4a2217a8a22f02aec478e6684a13c82c PASS]
*Status: '''PASS''' in Litmus (Mozmill and Manual)
**Notes: No issues found


== Windows Vista (tester) ==
== Windows Vista (tester) ==
*Date:  
*Date:  
*Build ID:  
*Build ID:  
*Mozmill '''RESULTS''' (known failures)
*Mozmill '''PASS'''
**Normal: [xx Results]  
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4a2217a8a22f02aec478e6684a136357 PASS] (known failures)
**Restart: [xx Results]  
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4a2217a8a22f02aec478e6684a138a5f PASS] (intermittent failure) 
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)  
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)  
**Notes:
**Notes:


== Mac OS X 10.6 (tester) ==
== Mac OS X 10.6 (ahoza) ==
*Date:  
*Date: 10/27/2010
*Build ID:  
*Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.1.15) Gecko/20101026 Firefox/3.5.15
*Mozmill '''RESULTS''' (known failures)
*Mozmill '''PASS'''
**Normal: [xx Results]  
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4a2217a8a22f02aec478e6684a1344c7 PASS] (known failures)
**Restart: [xx Results]  
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4a2217a8a22f02aec478e6684a138360 PASS] (known failures)
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)  
*Status: '''PASS''' in Litmus (Manual)  
**Notes:
**Notes: No issues found


== Linux (tester) ==
== Linux (vlad) ==
*Date:  
*Date: 10/27/2010
*Build ID:  
*Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1.15) Gecko/20101026 Firefox/3.5.15
*Mozmill '''RESULTS''' (known failures)
*Mozmill '''PASS'''
**Normal: [xx Results]  
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4a2217a8a22f02aec478e6684a135aa2 PASS] (known failures)
**Restart: [xx Results]  
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/4a2217a8a22f02aec478e6684a137852 PASS] (known failure)
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)  
*Status: '''PASS''' in Litmus (Manual)  
**Notes:
**Notes: {{bug|601138}} Abnormal look of SSL larry drop down when default theme is on


= BFTs for Build 1 =  
= BFTs for Build 1 =  


* <strike>[https://litmus.mozilla.org/run_tests.cgi?test_run_id=233 Click] to run the BFT</strike> - '''Need Build IDs'''
* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=233 Click] to run the BFT
* <strike>[https://litmus.mozilla.org/test_run_report.cgi?test_run_id=233 BFT Report]</strike> - '''Need Build IDs'''
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=233 BFT Report]


== Windows XP (Team)  ==
== Windows XP (Waverley)  ==


*Date:  
*Date: 10/27/2010
*Build ID:  
*Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.1.15) Gecko/20101026 Firefox/3.5.15


The Manual section of the BFT will be divided up in four sections.  
The Manual section of the BFT will be divided up in four sections.  


*Sections (from Litmus in order)  
*Sections (from Litmus in order)  
**Installation - Tabbed Browsing (tester)  
**Installation - Tabbed Browsing (teodosia)  
***Results: '''RESULTS''' - Results in Litmus
***Results: '''PASS'''  
**Search - Addons (tester)  
**Search - Addons (teodosia)  
***Results: '''RESULTS''' - Results in Litmus
***Results: '''PASS'''
**Downloading - Cookies (tester)  
**Downloading - Cookies (ahoza)  
***Results: '''RESULTS''' - Results in Litmus
***Results: '''PASS'''  
**Security - Uninstall (tester)  
**Security - Uninstall (ahoza)  
***Results: '''RESULTS''' - Results in Litmus
***Results: '''PASS'''  
***Notes:  
**Notes:
*** No new issues found
*** [https://litmus.mozilla.org/advanced_search.cgi?test_run=233&product=&branch=26&testgroup=106&subgroup=&testcase=&platform=1&opsys=4&locale=&result_status=fail&start_date=&timespan=&end_date=Now&search_field1=build_id&match_criteria1=contains_all&search_value1=20101026205513%20&search_field2=&match_criteria2=contains_any&search_value2=&search_field3=&match_criteria3=contains_all&search_value3=&search_field4=&match_criteria4=contains_all&search_value4=&sort_field1=&sort_order1=ASC&sort_field2=&sort_order2=ASC&sort_field3=&sort_order3=ASC&sort_field4=&sort_order4=ASC&limit=15&automated=all&withbugs=all Failed Tests]


= Other OS Spot Checks =
= Other OS Spot Checks =

Latest revision as of 15:49, 27 October 2010

« Firefox:3.5.15:Test_Plan

Smoketests and BFTs are run partially though Mozmill automation and partially through manual testing (where automation does not currently exist). This means that the Mozmill automation is first run and results logged on this page. Then testers will run the leftover manual tests that the Mozmill testing did not cover. Because of this, please speak with QA (usually Hskupin and Abillings) before beginning manual testing if Mozmill results are not logged to the page below.

Firefox 3.5.15 Smoketest and BFT Results

Smoketests for Build 1

Build IDs

  • Windows: 20101026205513
  • OS X: 20101026200251
  • Linux: 20101026195820

Windows XP (teodosia)

  • Date: 10/27/2010
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.1.15) Gecko/20101026 Firefox/3.5.15
  • Mozmill PASS
    • Normal: PASS (known failures)
    • Restart: PASS
  • Status: PASS in Litmus (Manual)
    • Notes: No new issues found

Windows 7 (vlad)

  • Date: 10/27/2010
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.1.15) Gecko/20101026 Firefox/3.5.15
  • Mozmill PASS
    • Normal: PASS (known failures)
    • Restart: PASS
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes: No issues found

Windows Vista (tester)

  • Date:
  • Build ID:
  • Mozmill PASS
    • Normal: PASS (known failures)
    • Restart: PASS (intermittent failure)
  • Status: RESULTS in Litmus (Mozmill and Manual)
    • Notes:

Mac OS X 10.6 (ahoza)

  • Date: 10/27/2010
  • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.1.15) Gecko/20101026 Firefox/3.5.15
  • Mozmill PASS
    • Normal: PASS (known failures)
    • Restart: PASS (known failures)
  • Status: PASS in Litmus (Manual)
    • Notes: No issues found

Linux (vlad)

  • Date: 10/27/2010
  • Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1.15) Gecko/20101026 Firefox/3.5.15
  • Mozmill PASS
    • Normal: PASS (known failures)
    • Restart: PASS (known failure)
  • Status: PASS in Litmus (Manual)
    • Notes: bug 601138 Abnormal look of SSL larry drop down when default theme is on

BFTs for Build 1

Windows XP (Waverley)

  • Date: 10/27/2010
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.1.15) Gecko/20101026 Firefox/3.5.15

The Manual section of the BFT will be divided up in four sections.

  • Sections (from Litmus in order)
    • Installation - Tabbed Browsing (teodosia)
      • Results: PASS
    • Search - Addons (teodosia)
      • Results: PASS
    • Downloading - Cookies (ahoza)
      • Results: PASS
    • Security - Uninstall (ahoza)
      • Results: PASS
    • Notes:

Other OS Spot Checks

Windows 2000 (tester)

  • Date:
  • Build ID:
  • Status: RESULTS
Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_3.5.15/Test_Plan:Smoketests&oldid=263802"