Thunderbird:2.0.0.4:Test Plan: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(31 intermediate revisions by 4 users not shown)
Line 4: Line 4:
*Spot check of Mac and Linux Platforms
*Spot check of Mac and Linux Platforms
*Some Windows Vista testing
*Some Windows Vista testing
*Test Tags going from a Tbird 1.5 profile to Tbird 2 Beta1
*Bug verifications (security and critical)


== Testing Results ==
== Testing Results ==


= [http://wiki.mozilla.org/index.php?title=Thunderbird:2:Test_Plan:BFT BFT/Smoketests] =
= [http://wiki.mozilla.org/Thunderbird:2004:Test_Plan:BFT BFT/Smoketests] =


RC1 Smoketests
== RC1 Smoketests ==


*Windows Vista [tomcat]
*Windows Vista [tomcat] '''PASS'''
*Mac [marcia]
*Mac [marcia]'''PASS''' (results in Litmus)
*Linux [tomcat]
*Linux [tomcat] '''PASS'''


= [http://wiki.mozilla.org/Thunderbird:2:Test_Plan:l10n l10n related testing] =
Bugs Found during smoketesting:
= [http://wiki.mozilla.org/Thunderbird:2:Test_Plan:Software_Update Update testing] =
*https://bugzilla.mozilla.org/show_bug.cgi?id=383633 - Unable to drag and drop feeds (from GP ->Thunderbird)


=== Tomcats results ===
* {{Bug|383846}} Bug 383846 – Tags could be lost when Sent folder index is rebuild
* {{Bug|383873}} Bug 383873 – Run Junk Mail control on Folder result in all Mail marked as junk


=== marcia's results ====
= [http://wiki.mozilla.org/Thunderbird:2.0.0.4:Test_Plan:L10n l10n related testing] =




== Testing Results for RC1 ==
 
= Testing Results for RC1 =


=== *[http://wiki.mozilla.org/Thunderbird:2.0.0.4:Test_Plan:BFT Smoketests and BFTs]===
=== *[http://wiki.mozilla.org/Thunderbird:2.0.0.4:Test_Plan:BFT Smoketests and BFTs]===
=== *[http://wiki.mozilla.org/Thunderbird:2.0.0.4:Test_Plan:l10n l10n Testing] ===
=== *[http://wiki.mozilla.org/Thunderbird:2.0.0.4:Test_Plan:L10n l10n Testing] ===
=== *[http://wiki.mozilla.org/Thunderbird:2.0.0.4:Test_Plan:Update Testing Update Testing] ===  
=== *[http://wiki.mozilla.org/Thunderbird:2.0.0.4:Test_Plan:Update Updates Testing] ===
 
=== *[http://wiki.mozilla.org/Thunderbird:2.0.0.4:Test_Plan:Verifications Bug Verifications] ===
=== *[http://wiki.mozilla.org/Thunderbird:2.0.0.4:Test_Plan:Verifications Bug Verifications] ===
Changes in 2.0.0.4 (so far): (21)
Other
* Fixed: 371672 - assert in morkConfig, invalid mork db '''(Not easily verifiable according to dbienvenu)'''
* Verified: 378147 – Installing thunderbird 2.0 breaks HTML message BODY
filtering
10n Specific:
* Verified 373555 – TB 2.0: a string under "order by" has to be changed
* Verified: 375466 – Some Thunderbird 2.0 dialogs still need resizing in Mac OS X
* verified: 373630 – A few Thunderbird (ca) string corrections
* Fixed: 326915 – Dutch (nl) translation of Thunderbird and Firefox mozilla_1_8_branch
* Verified: 374633 – Spellcheck doesn't work in pt-PT Thunderbird
Security issue: (1)
* Verified: 332771 - delayed S/Mime verification broken when message opened in separate window
Crash: (1)
* verified: 377125 - crash in PrepareAndDispatch when calling nsIMsgQuote::QuoteMessage from javascript
Build configuration: (4)
* verified: 376418 - Add ko to the 1.8 branch for future thunderbird 2 point releases.
* verified: 378533 - Remove xmlextras.xpt
* verified: 378762 - Add echo-variable-% for client.mk vars
* verified: 378958 - Move NSPR pull-tag for 1.8.1.4 and 1.8.0.12
Filter-related: (1)
* Verified: 355537 - If Action includes adding a TAG, the filter does not work on incoming mail - must be run manually
* Verified 355537 - FILTERS: If Action includes adding a TAG, the filter does not work on incoming mail - must be run manually
Functionality: (3)
* Fixed: 183722 - missing hotsync log entry on both PC and Palm to indicate Mozilla Address Book Sync
* Verified: 378147 - Installing thunderbird 2.0 breaks HTML message BODY filtering have it load in the start page
Installer: (1)
* Verified: 376675 - Don't package regxpcom.exe
UI improvements: (6)
* Verified: 367533 - Dictionary Options tab has issues when there is no dictionary
read
* Verified: 368112 - Messages lost when multiple messages moved between folders
* Verified: 377178 - "Go > Mail Start Page" just hide mail headers
* Verified: 377778 - Reply All doesn't fill in the cc fields anymore
* Fixed: 377900 - RFC 4314 IMAP ACL delete rights are not honored
XULRunner: (2)
* Verified: 329394 - XUL textbox in XHTML page: focusing gives document.commandDispatcher has no properties
* Verified: 379722 - Starting Firefox or Thunderbird 2.0.0.4 prints "Handling command line!"
Mac-specific: (2)
* Verified: 341307 - Thunderbird EULA refers to the "Thunderbird Browser"
* Verified: 365755 - when only a compose window is open, I can't get back to the 3 pane
=== *[http://wiki.mozilla.org/Thunderbird:2.0.0.4:Test_Plan:Extensions Extension Testing] ===
=== *[http://wiki.mozilla.org/Thunderbird:2.0.0.4:Test_Plan:Extensions Extension Testing] ===
==== Tomcat's Testing ====
Tomcat tested the following extensions:
*adblock, mnehny, ntt and testing enigmail
==== marcia's Testing ====
*DownThemAll 0.9.9.10
*Enigmail 0.95.1
*Flashgot 0.5.99
*FoxyTunes 2.9
*Image Zoom 0.3
*Lightning 0.3.1
*MinimizeToTray
*Mouse Gestures 1.5.2
*Stationery 0.4.4
*US English Dictionary 2.0.0.6
*AdBlock Plus 0.7.5.1
*Copy Sent to Current 0.7.4
=== *[http://wiki.mozilla.org/Thunderbird:2.0.0.4:Test_Plan:Bugs Bugs Seen during Testing] ===
=== *[http://wiki.mozilla.org/Thunderbird:2.0.0.4:Test_Plan:Bugs Bugs Seen during Testing] ===
=== *[http://wiki.mozilla.org/Thunderbird:2.0.0.4:Test_Plan:Inproduct In Product Site Testing] ===
=== *[http://wiki.mozilla.org/Thunderbird:2.0.0.4:Test_Plan:Inproduct In Product Site Testing] ===
=== *[http://wiki.mozilla.org/Thunderbird:2.0.0.4:Test_Plan:Live Live Testing] ===
=== *[http://wiki.mozilla.org/Thunderbird:2.0.0.4:Test_Plan:Live Live Testing] ===
= Notes from Post Mortem =
*General Feeling that the release went smoothly
*mscott noted that we should file a bug day before the update push
*Item to Add to the Release checklist -> The IT request to push changes live needs an a=. [juanb: will add it to the wiki]
*marcia noted a few mentions of update issues in #thunderbird, will investigate further. early hendrix feedback has not shown any issues.

Latest revision as of 19:35, 15 June 2007

Test Plan for RC1 release

  • BFT on Windows
  • Spot check of Mac and Linux Platforms
  • Some Windows Vista testing
  • Bug verifications (security and critical)

Testing Results

BFT/Smoketests

RC1 Smoketests

  • Windows Vista [tomcat] PASS
  • Mac [marcia]PASS (results in Litmus)
  • Linux [tomcat] PASS

Bugs Found during smoketesting:

  • bug 383846 Bug 383846 – Tags could be lost when Sent folder index is rebuild
  • bug 383873 Bug 383873 – Run Junk Mail control on Folder result in all Mail marked as junk

l10n related testing

Testing Results for RC1

*Smoketests and BFTs

*l10n Testing

*Updates Testing

*Bug Verifications

Changes in 2.0.0.4 (so far): (21)

Other

  • Fixed: 371672 - assert in morkConfig, invalid mork db (Not easily verifiable according to dbienvenu)
  • Verified: 378147 – Installing thunderbird 2.0 breaks HTML message BODY

filtering

10n Specific:

  • Verified 373555 – TB 2.0: a string under "order by" has to be changed
  • Verified: 375466 – Some Thunderbird 2.0 dialogs still need resizing in Mac OS X
  • verified: 373630 – A few Thunderbird (ca) string corrections
  • Fixed: 326915 – Dutch (nl) translation of Thunderbird and Firefox mozilla_1_8_branch
  • Verified: 374633 – Spellcheck doesn't work in pt-PT Thunderbird

Security issue: (1)

  • Verified: 332771 - delayed S/Mime verification broken when message opened in separate window

Crash: (1)

  • verified: 377125 - crash in PrepareAndDispatch when calling nsIMsgQuote::QuoteMessage from javascript

Build configuration: (4)

  • verified: 376418 - Add ko to the 1.8 branch for future thunderbird 2 point releases.
  • verified: 378533 - Remove xmlextras.xpt
  • verified: 378762 - Add echo-variable-% for client.mk vars
  • verified: 378958 - Move NSPR pull-tag for 1.8.1.4 and 1.8.0.12

Filter-related: (1)

  • Verified: 355537 - If Action includes adding a TAG, the filter does not work on incoming mail - must be run manually
  • Verified 355537 - FILTERS: If Action includes adding a TAG, the filter does not work on incoming mail - must be run manually

Functionality: (3)

  • Fixed: 183722 - missing hotsync log entry on both PC and Palm to indicate Mozilla Address Book Sync
  • Verified: 378147 - Installing thunderbird 2.0 breaks HTML message BODY filtering have it load in the start page

Installer: (1)

  • Verified: 376675 - Don't package regxpcom.exe

UI improvements: (6)

  • Verified: 367533 - Dictionary Options tab has issues when there is no dictionary

read

  • Verified: 368112 - Messages lost when multiple messages moved between folders
  • Verified: 377178 - "Go > Mail Start Page" just hide mail headers
  • Verified: 377778 - Reply All doesn't fill in the cc fields anymore
  • Fixed: 377900 - RFC 4314 IMAP ACL delete rights are not honored

XULRunner: (2)

  • Verified: 329394 - XUL textbox in XHTML page: focusing gives document.commandDispatcher has no properties
  • Verified: 379722 - Starting Firefox or Thunderbird 2.0.0.4 prints "Handling command line!"

Mac-specific: (2)

  • Verified: 341307 - Thunderbird EULA refers to the "Thunderbird Browser"
  • Verified: 365755 - when only a compose window is open, I can't get back to the 3 pane

*Extension Testing

Tomcat's Testing

Tomcat tested the following extensions:

  • adblock, mnehny, ntt and testing enigmail

marcia's Testing

  • DownThemAll 0.9.9.10
  • Enigmail 0.95.1
  • Flashgot 0.5.99
  • FoxyTunes 2.9
  • Image Zoom 0.3
  • Lightning 0.3.1
  • MinimizeToTray
  • Mouse Gestures 1.5.2
  • Stationery 0.4.4
  • US English Dictionary 2.0.0.6
  • AdBlock Plus 0.7.5.1
  • Copy Sent to Current 0.7.4

*Bugs Seen during Testing

*In Product Site Testing

*Live Testing

Notes from Post Mortem

  • General Feeling that the release went smoothly
  • mscott noted that we should file a bug day before the update push
  • Item to Add to the Release checklist -> The IT request to push changes live needs an a=. [juanb: will add it to the wiki]
  • marcia noted a few mentions of update issues in #thunderbird, will investigate further. early hendrix feedback has not shown any issues.