Releases/Firefox 3.5.19/Test Plan:Smoketests: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(32 intermediate revisions by 7 users not shown)
Line 4: Line 4:


= Firefox 3.5.19 Smoketest and BFT Results =
= Firefox 3.5.19 Smoketest and BFT Results =
= Smoketests for Build 2 =
* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=290 Click] to run the Smoketests
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=290 Smoketest Report]
'''Build IDs'''
* Windows: 20110420144310
* OS X: 20110420144310
* Linux: 20110420144310
== Windows XP (geo) ==
*Date: 2011-04-21
*Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.19) Gecko/20110420 Firefox/3.5.19
*Mozmill '''PASS''' 
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/9410f62953a74cf4090891bc634e3eb6 RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/9410f62953a74cf4090891bc634e5373 RESULTS]
*Status: '''PASS''' in Litmus (Manual)
**Notes:
== Windows 7 (gmontagu) ==
*Date: April 21, 2011
*Build ID: 20110420144310 ( Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.1.19) Gecko/20110420 Firefox/3.5.19)
*Mozmill '''PASS''' 
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/9410f62953a74cf4090891bc634e3eb6 RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/9410f62953a74cf4090891bc634e661b RESULTS]
*Status: '''PASS''' in Litmus (Manual)
**Notes:
== Windows Vista (Abillings) ==
*Date: 4/21/2011
*Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1.19) Gecko/20110420 Firefox/3.5.19
*Mozmill '''PASS''' 
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/9410f62953a74cf4090891bc634e606a RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/9410f62953a74cf4090891bc634e66c2 RESULTS]
*Status: '''PASS''' in Litmus (Manual)
**Notes:
== Mac OS X 10.6 (geo) ==
*Date: 2011-04-22
*Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.1.19) Gecko/20110420 Firefox/3.5.19
*Mozmill '''PASS''' 
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/9410f62953a74cf4090891bc634e662e RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/9410f62953a74cf4090891bc634e6da8 RESULTS]
*Status: '''RESULTS''' in Litmus (Manual)
**Notes:
== Linux (ABillings) ==
*Date: 4/21/2011
*Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1.19) Gecko/20110420 Firefox/3.5.19
*Mozmill '''PASS''' (known failures)
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/9410f62953a74cf4090891bc634e1b22 RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/9410f62953a74cf4090891bc634e4ab3 RESULTS]
*Status: '''PASS''' in Litmus (Manual)
**Notes:


= Smoketests for Build 1 =
= Smoketests for Build 1 =
Line 16: Line 70:
== Windows XP (Alex) ==
== Windows XP (Alex) ==
*Date: 2011-04-15
*Date: 2011-04-15
*Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.19) Gecko/20110414 Firefox/3.5.19
*Build ID: 20110414083440
*Mozmill '''PASS'''   
*Mozmill '''PASS'''   
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/f552bb95ab494bdcc91d9b001a12eea4 RESULTS]  
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/f552bb95ab494bdcc91d9b001a12eea4 RESULTS]  
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/f552bb95ab494bdcc91d9b001a13385e RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/f552bb95ab494bdcc91d9b001a13385e RESULTS]
*Status: '''PASS''' in Litmus (Mozmill and Manual)  
*Status: '''PASS''' in Litmus (Manual)  
**Notes:
**Notes:


== Windows 7 (Andrei) ==
== Windows 7 (Andrei) ==
*Date: 2011-04-15
*Date: 2011-04-15
*Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.1.19) Gecko/20110414 Firefox/3.5.19
*Build ID: 20110414083440
*Mozmill '''PASS'''   
*Mozmill '''PASS'''   
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/f552bb95ab494bdcc91d9b001a1315ce RESULTS]  
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/f552bb95ab494bdcc91d9b001a1315ce RESULTS]  
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/f552bb95ab494bdcc91d9b001a1350b4 RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/f552bb95ab494bdcc91d9b001a1350b4 RESULTS]
*Status: '''PASS''' in Litmus (Mozmill and Manual)  
*Status: '''Results''' in Litmus (Mozmill and Manual)  
**Notes: All tests are PASS in Litmus
**Manual: '''PASS''' in Litmus
**Notes:


== Windows Vista (Simona) ==
== Windows Vista (Simona) ==
*Date: 2011-04-15
*Date: 2011-04-15
*Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1.19) Gecko/20110414 Firefox/3.5.19, 20110414083440
*Build ID: 20110414083440
*Mozmill '''PASS'''   
*Mozmill '''PASS'''   
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/f552bb95ab494bdcc91d9b001a12f89f RESULTS]  
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/f552bb95ab494bdcc91d9b001a12f89f RESULTS]  
Line 44: Line 99:
== Mac OS X 10.6 (Vlad G) ==
== Mac OS X 10.6 (Vlad G) ==
*Date: 2011-04-15
*Date: 2011-04-15
*Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.1.19) Gecko/20110414 Firefox/3.5.19, 20110414083440
*Build ID: 20110414083440
*Mozmill '''PASS'''   
*Mozmill '''PASS'''   
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/f552bb95ab494bdcc91d9b001a132af4 RESULTS]  
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/f552bb95ab494bdcc91d9b001a132af4 RESULTS]  
Line 54: Line 109:
== Linux (George) ==
== Linux (George) ==
*Date: 2011-04-15
*Date: 2011-04-15
*Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1.19) Gecko/20110414 Firefox/3.5.19, 20110414083440
*Build ID: 20110414083440
*Mozmill '''PASS'''   
*Mozmill '''PASS'''   
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/f552bb95ab494bdcc91d9b001a132348 RESULTS]  
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/f552bb95ab494bdcc91d9b001a132348 RESULTS]  
Line 61: Line 116:
**Manual: '''PASS''' in Litmus with known issues
**Manual: '''PASS''' in Litmus with known issues
**Notes:
**Notes:
***New issue:
****{{bug|650290}} - Larry security doorhangers do not display any text
***Known issues:
***Known issues:
****{{bug|625063}} - Error while drag and drop bookmarks or history entry on desktop
****{{bug|625063}} - Error while drag and drop bookmarks or history entry on desktop
Line 66: Line 123:


= BFTs=  
= BFTs=  
== Build 2 ==
* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=291 Click] to run the BFT
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=291 BFT Report]


== Build 1 ==
== Build 1 ==
Line 74: Line 136:
== Manual Windows XP (tester)  ==
== Manual Windows XP (tester)  ==


*Date:  
*Date: 2011-04-15
*Build ID:  
*Build ID: 20110414083440


The Manual section of the BFT will be divided up in four sections.  
The Manual section of the BFT will be divided up in four sections.  


*Sections (from Litmus in order)  
*Sections (from Litmus in order)  
**Installation - Tabbed Browsing ('''tester''')  
**Installation - Tabbed Browsing ('''Simona''')  
***Results: '''result''' in Litmus   
***Results: '''PASS''' in Litmus   
**Search - Addons ('''tester''')  
**Search - Addons ('''Simona''')  
***Results: '''result''' in Litmus   
***Results: '''PASS''' in Litmus   
**Downloading - Cookies ('''tester''')  
**Downloading - Cookies ('''Vlad G''')  
***Results: '''result''' in Litmus   
***Results: '''PASS''' in Litmus   
**Security - Uninstall ('''tester''')  
**Security - Uninstall ('''Vlad G''')  
***Results: '''result''' in Litmus
***Results: '''PASS''' in Litmus


= Other OS Spot Checks =
= Other OS Spot Checks =

Latest revision as of 22:43, 21 April 2011

« Firefox:3.5.19:Test_Plan

Smoketests and BFTs are run partially though Mozmill automation and partially through manual testing (where automation does not currently exist). This means that the Mozmill automation is first run and results logged on this page. Then testers will run the leftover manual tests that the Mozmill testing did not cover. Because of this, please speak with QA (usually Hskupin and Abillings) before beginning manual testing if Mozmill results are not logged to the page below.

Firefox 3.5.19 Smoketest and BFT Results

Smoketests for Build 2

Build IDs

  • Windows: 20110420144310
  • OS X: 20110420144310
  • Linux: 20110420144310

Windows XP (geo)

  • Date: 2011-04-21
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.19) Gecko/20110420 Firefox/3.5.19
  • Mozmill PASS
  • Status: PASS in Litmus (Manual)
    • Notes:

Windows 7 (gmontagu)

  • Date: April 21, 2011
  • Build ID: 20110420144310 ( Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.1.19) Gecko/20110420 Firefox/3.5.19)
  • Mozmill PASS
  • Status: PASS in Litmus (Manual)
    • Notes:

Windows Vista (Abillings)

  • Date: 4/21/2011
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1.19) Gecko/20110420 Firefox/3.5.19
  • Mozmill PASS
  • Status: PASS in Litmus (Manual)
    • Notes:

Mac OS X 10.6 (geo)

  • Date: 2011-04-22
  • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.1.19) Gecko/20110420 Firefox/3.5.19
  • Mozmill PASS
  • Status: RESULTS in Litmus (Manual)
    • Notes:

Linux (ABillings)

  • Date: 4/21/2011
  • Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1.19) Gecko/20110420 Firefox/3.5.19
  • Mozmill PASS (known failures)
  • Status: PASS in Litmus (Manual)
    • Notes:

Smoketests for Build 1

Build IDs

  • Windows: 20110414083440
  • OS X: 20110414083440
  • Linux: 20110414083440

Windows XP (Alex)

  • Date: 2011-04-15
  • Build ID: 20110414083440
  • Mozmill PASS
  • Status: PASS in Litmus (Manual)
    • Notes:

Windows 7 (Andrei)

  • Date: 2011-04-15
  • Build ID: 20110414083440
  • Mozmill PASS
  • Status: Results in Litmus (Mozmill and Manual)
    • Manual: PASS in Litmus
    • Notes:

Windows Vista (Simona)

  • Date: 2011-04-15
  • Build ID: 20110414083440
  • Mozmill PASS
  • Status: RESULTS in Litmus (Mozmill and Manual)
    • Manual: PASS in Litmus
    • Notes:

Mac OS X 10.6 (Vlad G)

  • Date: 2011-04-15
  • Build ID: 20110414083440
  • Mozmill PASS
  • Status: RESULTS in Litmus (Mozmill and Manual)
    • Manual: PASS in Litmus
    • Notes:

Linux (George)

  • Date: 2011-04-15
  • Build ID: 20110414083440
  • Mozmill PASS
  • Status: RESULTS in Litmus (Mozmill and Manual)
    • Manual: PASS in Litmus with known issues
    • Notes:
      • New issue:
        • bug 650290 - Larry security doorhangers do not display any text
      • Known issues:
        • bug 625063 - Error while drag and drop bookmarks or history entry on desktop
        • bug 434851 - importing data from opera fails

BFTs

Build 2

Build 1

Manual Windows XP (tester)

  • Date: 2011-04-15
  • Build ID: 20110414083440

The Manual section of the BFT will be divided up in four sections.

  • Sections (from Litmus in order)
    • Installation - Tabbed Browsing (Simona)
      • Results: PASS in Litmus
    • Search - Addons (Simona)
      • Results: PASS in Litmus
    • Downloading - Cookies (Vlad G)
      • Results: PASS in Litmus
    • Security - Uninstall (Vlad G)
      • Results: PASS in Litmus

Other OS Spot Checks

Windows 2000 (tester)

  • Date:
  • Build ID:
  • Mozmill PASS
  • Status: RESULTS in Litmus (Mozmill and Manual)
    • Notes:
Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_3.5.19/Test_Plan:Smoketests&oldid=301652"