Releases/Firefox 3.6.23/Test Plan:Smoketests: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(14 intermediate revisions by 4 users not shown)
Line 23: Line 23:


== Windows 7 (ashughes) ==
== Windows 7 (ashughes) ==
*Date:
*Date: 2011-09-20
*Build ID:  
*Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.23) Gecko/20110920 Firefox/3.6.23
*Mozmill '''PASS''' (2 failures)
*Mozmill '''PASS''' (2 failures)
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/df4c8750af577eceac3393a5eb1cea4f RESULTS]  
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/df4c8750af577eceac3393a5eb1cea4f RESULTS]  
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/df4c8750af577eceac3393a5eb1d0f43 RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/df4c8750af577eceac3393a5eb1d0f43 RESULTS]
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)
*Status: '''PASS''' in Litmus (Mozmill and Manual)


== Windows Vista (tester) ==
== Windows Vista (ashughes) ==
*Date:
*Date: 2011-09-20
*Build ID:  
*Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.23) Gecko/20110920 Firefox/3.6.23 (.NET CLR 3.5.30729)
*Mozmill '''PASS''' (1 failure)
*Mozmill '''PASS''' (1 failure)
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/df4c8750af577eceac3393a5eb1cf420 RESULTS]  
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/df4c8750af577eceac3393a5eb1cf420 RESULTS]  
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/df4c8750af577eceac3393a5eb1d11dd RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/df4c8750af577eceac3393a5eb1d11dd RESULTS]
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)
*Status: '''PASS''' in Litmus (Mozmill and Manual)


== Mac OS X 10.7 (tester) ==
== Mac OS X 10.7 (tester) ==
Line 46: Line 46:
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)


== Mac OS X 10.6 (tester) ==
== Mac OS X 10.6 (ashughes) ==
*Date:
*Date: 2011-09-20
*Build ID:  
*Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.23) Gecko/20110920 Firefox/3.6.23
*Mozmill '''PASS''' (4 failures)
*Mozmill '''PASS''' (4 failures)
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/df4c8750af577eceac3393a5eb1c8a90 RESULTS]  
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/df4c8750af577eceac3393a5eb1c8a90 RESULTS]  
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/df4c8750af577eceac3393a5eb1cbcaf RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/df4c8750af577eceac3393a5eb1cbcaf RESULTS]
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)
*Status: '''PASS''' in Litmus (Mozmill and Manual)


== Linux (tester) ==
== Linux (ashughes) ==
*Date:
*Date: 2011-09-20
*Build ID:  
*Build ID: Mozilla/5.0 (X11; U; Linux i686 (x86_64); en-US; rv:1.9.2.23) Gecko/20110920 Firefox/3.6.23
*Mozmill '''PASS''' (4 failures)
*Mozmill '''PASS''' (4 failures)
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/df4c8750af577eceac3393a5eb1ae82a RESULTS]  
**Normal: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/df4c8750af577eceac3393a5eb1ae82a RESULTS]  
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/df4c8750af577eceac3393a5eb1af720 RESULTS]
**Restart: [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/df4c8750af577eceac3393a5eb1af720 RESULTS]
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)
*Status: '''PASS''' in Litmus (Mozmill and Manual)


== Windows 2000 (tester) ==
== Windows 2000 (tester) ==
Line 79: Line 79:
=== Build 1 Manual Windows XP (Waverly)  ===
=== Build 1 Manual Windows XP (Waverly)  ===


*Date:  
*Date: 09/21/2011
*Build ID: (from about:)  
*Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.23) Gecko/20110920 Firefox/3.6.23 (.NET CLR 3.5.30729)


The Manual section of the BFT will be divided up in four sections.  
The Manual section of the BFT will be divided up in five sections.  


*Sections (from Litmus in order)  
*Sections (from Litmus in order)  
**Installation - Tabbed Browsing ('''tester''')  
**Installation - Search ('''Simona''')  
***Results: '''RESULTS''' in Litmus
***Results: '''PASS''' in Litmus
**Search - Addons ('''tester''')  
**Popup and annoyance blocking - RSS ('''Mihaela''')
***Results: '''RESULTS''' in Litmus
***Results: '''PASS''' in Litmus
**Downloading - Cookies ('''tester''')  
**Microsummaries - Layout ('''Ioana''')  
***Results: '''RESULTS''' in Litmus
***Results: '''PASS''' in Litmus
**Security - Uninstall ('''tester''')  
**Content Handling - Form Manager ('''Virgil''')
***Results: '''RESULTS''' in Litmus
***Results: '''PASS''' in Litmus
**Cookies - Uninstall ('''VladG''')
***Results: '''PASS''' in Litmus
*Issues found
** NEW - [https://bugzilla.mozilla.org/show_bug.cgi?id=688134 Bug 688134] - History entry changes focus when tag is added/removed using tags checkbox list.
** NEW - [https://bugzilla.mozilla.org/show_bug.cgi?id=688109 Bug 688109] - The notification bar does not remain on the screen more than a few seconds.
** REOPENED - [https://bugzilla.mozilla.org/show_bug.cgi?id=590443 Bug 590433] - [FF 3.6.9] Dragging the same item from Recently Bookmarked to Unsorted Bookmarks creates duplicates of it in both menu sections.

Latest revision as of 13:00, 21 September 2011

« Firefox:3.6.23:Test_Plan

Smoketests and BFTs are run partially though Mozmill automation and partially through manual testing (where automation does not currently exist). This means that the Mozmill automation is first run and results logged on this page. Then testers will run the leftover manual tests that the Mozmill testing did not cover. Because of this, please speak with QA (usually Hskupin and Abillings) before beginning manual testing if Mozmill results are not logged to the page below.

Firefox 3.6.23 Smoketest and BFT Results

Smoketests for Build 1

Build IDs

  • Windows: 20110920075126
  • OS X: 20110920075126
  • Linux: 20110920075126

Windows XP (ashughes)

  • Date: 2011-09-20
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.23) Gecko/20110920 Firefox/3.6.23 (.NET CLR 3.5.30729)
  • Mozmill PASS (1 failure)
  • Status: PASS in Litmus (Mozmill and Manual)

Windows 7 (ashughes)

  • Date: 2011-09-20
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.23) Gecko/20110920 Firefox/3.6.23
  • Mozmill PASS (2 failures)
  • Status: PASS in Litmus (Mozmill and Manual)

Windows Vista (ashughes)

  • Date: 2011-09-20
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.23) Gecko/20110920 Firefox/3.6.23 (.NET CLR 3.5.30729)
  • Mozmill PASS (1 failure)
  • Status: PASS in Litmus (Mozmill and Manual)

Mac OS X 10.7 (tester)

  • Date:
  • Build ID:
  • Mozmill PASS (some failures)
  • Status: RESULTS in Litmus (Mozmill and Manual)

Mac OS X 10.6 (ashughes)

  • Date: 2011-09-20
  • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.23) Gecko/20110920 Firefox/3.6.23
  • Mozmill PASS (4 failures)
  • Status: PASS in Litmus (Mozmill and Manual)

Linux (ashughes)

  • Date: 2011-09-20
  • Build ID: Mozilla/5.0 (X11; U; Linux i686 (x86_64); en-US; rv:1.9.2.23) Gecko/20110920 Firefox/3.6.23
  • Mozmill PASS (4 failures)
  • Status: PASS in Litmus (Mozmill and Manual)

Windows 2000 (tester)

  • Date:
  • Build ID:
  • Mozmill PASS (1 failure)
  • Status: RESULTS in Litmus (Mozmill and Manual)

BFTs

Build 1

Build 1 Manual Windows XP (Waverly)

  • Date: 09/21/2011
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.23) Gecko/20110920 Firefox/3.6.23 (.NET CLR 3.5.30729)

The Manual section of the BFT will be divided up in five sections.

  • Sections (from Litmus in order)
    • Installation - Search (Simona)
      • Results: PASS in Litmus
    • Popup and annoyance blocking - RSS (Mihaela)
      • Results: PASS in Litmus
    • Microsummaries - Layout (Ioana)
      • Results: PASS in Litmus
    • Content Handling - Form Manager (Virgil)
      • Results: PASS in Litmus
    • Cookies - Uninstall (VladG)
      • Results: PASS in Litmus
  • Issues found
    • NEW - Bug 688134 - History entry changes focus when tag is added/removed using tags checkbox list.
    • NEW - Bug 688109 - The notification bar does not remain on the screen more than a few seconds.
    • REOPENED - Bug 590433 - [FF 3.6.9] Dragging the same item from Recently Bookmarked to Unsorted Bookmarks creates duplicates of it in both menu sections.