Releases/Firefox 3.6.17/Test Plan:Smoketests: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(36 intermediate revisions by 8 users not shown)
Line 5: Line 5:
= Firefox 3.6.17 Smoketest and BFT Results =
= Firefox 3.6.17 Smoketest and BFT Results =


= Smoketests for Build 1 =
= Smoketests for Build 3 =
* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=287 Click] to run the Smoketests
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=287 Smoketest Report]
 
'''Build IDs'''
* Windows: 20110420140830
* OS X: 20110420140830
* Linux: 20110420140830
 
== Windows XP (geo) ==
*Date: 2011-04-22
*Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.17) Gecko/20110420 Firefox/3.6.17
*Mozmill '''PASS''' 
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/9410f62953a74cf4090891bc634dad2a RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/9410f62953a74cf4090891bc634dd420 RESULTS]
*Status: '''PASS''' in Litmus (Mozmill and Manual)
 
== Windows 7 (GMontagu) ==
*Date: April 21 2011
*Build ID: 20110420140830 (Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.17) Gecko/20110420 Firefox/3.6.17)
*Mozmill '''PASS''' 
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/9410f62953a74cf4090891bc634dd299 RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/9410f62953a74cf4090891bc634ddde6 RESULTS]
*Status: '''PASS''' in Litmus (Mozmill and Manual)
**Notes: When I closed the browser it crashed, crash ID https://crash-stats.mozilla.com/report/index/bp-16252694-cb8f-4a69-8982-9cbad2110421. The crash happened only the first time I closed the browser.
 
== Windows Vista (Abillings) ==
*Date: 4/21/2011
*Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.17) Gecko/20110420 Firefox/3.6.17
*Mozmill '''PASS''' 
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/9410f62953a74cf4090891bc634da532 RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/9410f62953a74cf4090891bc634dc11b RESULTS]
*Status: '''PASS''' in Litmus (Mozmill and Manual)
 
== Mac OS X 10.6 (geo) ==
*Date: 2011-04-22
*Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.17) Gecko/20110420 Firefox/3.6.17
*Mozmill '''PASS''' 
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/9410f62953a74cf4090891bc634ddcb9 RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/9410f62953a74cf4090891bc634de66c RESULTS]
*Status: '''PASS''' in Litmus (Mozmill and Manual)
 
== Linux (ABillings) ==
*Date: 4/21/2011
*Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.17) Gecko/20110420 Firefox/3.6.17
*Mozmill '''PASS''' (known failures) 
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/9410f62953a74cf4090891bc634db519 RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/9410f62953a74cf4090891bc634dc011 RESULTS]
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)
 
= Smoketests for Build 2 =
* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=279 Click] to run the Smoketests
* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=279 Click] to run the Smoketests
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=279 Smoketest Report]
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=279 Smoketest Report]
Line 16: Line 66:
== Windows XP (Alex) ==
== Windows XP (Alex) ==
*Date: 2011-04-15
*Date: 2011-04-15
*Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.17) Gecko/20110414 Firefox/3.6.17
*Build ID: 20110414082317
*Mozmill '''PASS'''   
*Mozmill '''PASS'''   
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/f552bb95ab494bdcc91d9b001a1270c0 RESULTS]  
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/f552bb95ab494bdcc91d9b001a1270c0 RESULTS]  
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/f552bb95ab494bdcc91d9b001a12979a RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/f552bb95ab494bdcc91d9b001a12979a RESULTS]
*Status: '''PASS''' in Litmus (Mozmill and Manual)  
*Status: '''PASS''' in Litmus (Manual)  
**Notes:
**Notes:


== Windows 7 (Andrei) ==
== Windows 7 (Andrei) ==
*Date: 2011-04-15
*Date: 2011-04-15
*Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.17) Gecko/20110414 Firefox/3.6.17
*Build ID: 20110414082317
*Mozmill '''PASS'''   
*Mozmill '''PASS'''   
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/f552bb95ab494bdcc91d9b001a127ad4 RESULTS]  
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/f552bb95ab494bdcc91d9b001a127ad4 RESULTS]  
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/f552bb95ab494bdcc91d9b001a12a672 RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/f552bb95ab494bdcc91d9b001a12a672 RESULTS]
*Status: '''PASS''' in Litmus (Mozmill and Manual)  
*Status: '''Results''' in Litmus (Mozmill and Manual)  
**Notes: All tests are PASS in Litmus
**Manual: '''PASS''' in Litmus
**Notes:


== Windows Vista (Simona) ==
== Windows Vista (Simona) ==
*Date: 2011-04-15  
*Date: 2011-04-15  
*Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.17) Gecko/20110414 Firefox/3.6.17, 20110414082317
*Build ID: 20110414082317
*Mozmill '''PASS'''   
*Mozmill '''PASS'''   
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/f552bb95ab494bdcc91d9b001a12dd6e RESULTS]  
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/f552bb95ab494bdcc91d9b001a12dd6e RESULTS]  
Line 42: Line 93:
**Notes:
**Notes:


== Mac OS X 10.6 (tester) ==
== Mac OS X 10.6 (Vlad G) ==
*Date:  
*Date: 2011-04-15
*Build ID:  
*Build ID: 20110414082317
*Mozmill '''PASS'''   
*Mozmill '''PASS'''   
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/f552bb95ab494bdcc91d9b001a1280bb RESULTS]  
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/f552bb95ab494bdcc91d9b001a1280bb RESULTS]  
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/f552bb95ab494bdcc91d9b001a12aeac RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/f552bb95ab494bdcc91d9b001a12aeac RESULTS]
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)  
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)  
**Manual: '''PASS''' in Litmus
**Notes:
**Notes:


== Linux (George) ==
== Linux (George) ==
*Date: 2011-04-15
*Date: 2011-04-15
*Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.17) Gecko/20110414 Firefox/3.6.17, 20110413222027  
*Build ID: 20110413222027  
*Mozmill '''PASS'''   
*Mozmill '''PASS'''   
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/f552bb95ab494bdcc91d9b001a127708 RESULTS]  
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/f552bb95ab494bdcc91d9b001a127708 RESULTS]  
Line 66: Line 118:
= BFTs=  
= BFTs=  


== Build 1 ==
== Build 3 ==
 
* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=288 Click] to run the BFT
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=288 BFT Report]
 
== Build 2 ==


* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=280 Click] to run the BFT
* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=280 Click] to run the BFT
Line 74: Line 131:


*Date: 2011-04-15
*Date: 2011-04-15
*Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.17) Gecko/20110414 Firefox/3.6.17
*Build ID: 20110414082317


The Manual section of the BFT will be divided up in four sections.  
The Manual section of the BFT will be divided up in four sections.  
Line 80: Line 137:
*Sections (from Litmus in order)  
*Sections (from Litmus in order)  
**Installation - Tabbed Browsing ('''Alex''')  
**Installation - Tabbed Browsing ('''Alex''')  
***Results: '''result''' in Litmus   
***Results: '''PASS''' in Litmus   
**Search - Addons ('''tester''')  
**Search - Addons ('''vlad, Alex''')  
***Results: '''result''' in Litmus   
***Results: '''PASS''' in Litmus   
**Downloading - Cookies ('''Alex''')  
**Downloading - Cookies ('''Alex''')  
***Results: '''result''' in Litmus   
***Results: '''PASS''' in Litmus   
**Security - Uninstall ('''vlad''')  
**Security - Uninstall ('''vlad''')  
***Results: '''result''' in Litmus
***Results: '''PASS''' in Litmus


= Other OS Spot Checks =
= Other OS Spot Checks =
Line 92: Line 149:
*Date:  
*Date:  
*Build ID:  
*Build ID:  
*Mozmill '''RESULTS'''   
*Mozmill '''PASS'''   
**Normal: [x RESULTS]  
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/9410f62953a74cf4090891bc634dc485 RESULTS]  
**Restart: [x RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/9410f62953a74cf4090891bc634dd772 RESULTS]
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)  
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)  
**Notes:
**Notes:

Latest revision as of 23:51, 21 April 2011

« Firefox:3.6.17:Test_Plan

Smoketests and BFTs are run partially though Mozmill automation and partially through manual testing (where automation does not currently exist). This means that the Mozmill automation is first run and results logged on this page. Then testers will run the leftover manual tests that the Mozmill testing did not cover. Because of this, please speak with QA (usually Hskupin and Abillings) before beginning manual testing if Mozmill results are not logged to the page below.

Firefox 3.6.17 Smoketest and BFT Results

Smoketests for Build 3

Build IDs

  • Windows: 20110420140830
  • OS X: 20110420140830
  • Linux: 20110420140830

Windows XP (geo)

  • Date: 2011-04-22
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.17) Gecko/20110420 Firefox/3.6.17
  • Mozmill PASS
  • Status: PASS in Litmus (Mozmill and Manual)

Windows 7 (GMontagu)

Windows Vista (Abillings)

  • Date: 4/21/2011
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.17) Gecko/20110420 Firefox/3.6.17
  • Mozmill PASS
  • Status: PASS in Litmus (Mozmill and Manual)

Mac OS X 10.6 (geo)

  • Date: 2011-04-22
  • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.17) Gecko/20110420 Firefox/3.6.17
  • Mozmill PASS
  • Status: PASS in Litmus (Mozmill and Manual)

Linux (ABillings)

  • Date: 4/21/2011
  • Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.17) Gecko/20110420 Firefox/3.6.17
  • Mozmill PASS (known failures)
  • Status: RESULTS in Litmus (Mozmill and Manual)

Smoketests for Build 2

Build IDs

  • Windows: 20110414082317
  • OS X: 20110414082317
  • Linux: 20110414082317

Windows XP (Alex)

  • Date: 2011-04-15
  • Build ID: 20110414082317
  • Mozmill PASS
  • Status: PASS in Litmus (Manual)
    • Notes:

Windows 7 (Andrei)

  • Date: 2011-04-15
  • Build ID: 20110414082317
  • Mozmill PASS
  • Status: Results in Litmus (Mozmill and Manual)
    • Manual: PASS in Litmus
    • Notes:

Windows Vista (Simona)

  • Date: 2011-04-15
  • Build ID: 20110414082317
  • Mozmill PASS
  • Status: RESULTS in Litmus (Mozmill and Manual)
    • Manual: PASS in Litmus
    • Notes:

Mac OS X 10.6 (Vlad G)

  • Date: 2011-04-15
  • Build ID: 20110414082317
  • Mozmill PASS
  • Status: RESULTS in Litmus (Mozmill and Manual)
    • Manual: PASS in Litmus
    • Notes:

Linux (George)

  • Date: 2011-04-15
  • Build ID: 20110413222027
  • Mozmill PASS
  • Status: RESULTS in Litmus (Mozmill and Manual)
    • Manual: PASS in Litmus with known issues
    • Notes:
      • Known issues:
        • bug 625063 - Error while drag and drop bookmarks or history entry on desktop
        • bug 434851 - importing data from opera fails

BFTs

Build 3

Build 2

Manual Windows XP (Alex, Vlad)

  • Date: 2011-04-15
  • Build ID: 20110414082317

The Manual section of the BFT will be divided up in four sections.

  • Sections (from Litmus in order)
    • Installation - Tabbed Browsing (Alex)
      • Results: PASS in Litmus
    • Search - Addons (vlad, Alex)
      • Results: PASS in Litmus
    • Downloading - Cookies (Alex)
      • Results: PASS in Litmus
    • Security - Uninstall (vlad)
      • Results: PASS in Litmus

Other OS Spot Checks

Windows 2000 (tester)

  • Date:
  • Build ID:
  • Mozmill PASS
  • Status: RESULTS in Litmus (Mozmill and Manual)
    • Notes:
Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_3.6.17/Test_Plan:Smoketests&oldid=301672"