Thunderbird:2.0.0.4:Test Plan: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(14 intermediate revisions by 3 users not shown)
Line 18: Line 18:
Bugs Found during smoketesting:
Bugs Found during smoketesting:
*https://bugzilla.mozilla.org/show_bug.cgi?id=383633 - Unable to drag and drop feeds (from GP ->Thunderbird)
*https://bugzilla.mozilla.org/show_bug.cgi?id=383633 - Unable to drag and drop feeds (from GP ->Thunderbird)
* {{Bug|383846}} Bug 383846 – Tags could be lost when Sent folder index is rebuild
* {{Bug|383873}} Bug 383873 – Run Junk Mail control on Folder result in all Mail marked as junk


= [http://wiki.mozilla.org/Thunderbird:2.0.0.4:Test_Plan:L10n l10n related testing] =
= [http://wiki.mozilla.org/Thunderbird:2.0.0.4:Test_Plan:L10n l10n related testing] =


= [http://wiki.mozilla.org/Thunderbird:2:Test_Plan:Software_Update Update testing] =
=== Tomcats results ===
=== marcia's results ===




Line 32: Line 30:
=== *[http://wiki.mozilla.org/Thunderbird:2.0.0.4:Test_Plan:BFT Smoketests and BFTs]===
=== *[http://wiki.mozilla.org/Thunderbird:2.0.0.4:Test_Plan:BFT Smoketests and BFTs]===
=== *[http://wiki.mozilla.org/Thunderbird:2.0.0.4:Test_Plan:L10n l10n Testing] ===
=== *[http://wiki.mozilla.org/Thunderbird:2.0.0.4:Test_Plan:L10n l10n Testing] ===
=== *[http://wiki.mozilla.org/Thunderbird:2.0.0.4:Test_Plan:Update Testing Update Testing] ===  
=== *[http://wiki.mozilla.org/Thunderbird:2.0.0.4:Test_Plan:Update Updates Testing] ===
 
=== *[http://wiki.mozilla.org/Thunderbird:2.0.0.4:Test_Plan:Verifications Bug Verifications] ===
=== *[http://wiki.mozilla.org/Thunderbird:2.0.0.4:Test_Plan:Verifications Bug Verifications] ===


Line 39: Line 38:
Other
Other


* Fixed: 371672 - assert in morkConfig, invalid mork db (Not easily verifiable according to dbienvenu)
* Fixed: 371672 - assert in morkConfig, invalid mork db '''(Not easily verifiable according to dbienvenu)'''
* Fixed 377900 – RFC 4314 IMAP ACL delete rights are not honored
* Verified: 378147 – Installing thunderbird 2.0 breaks HTML message BODY  
* Verified: 378147 – Installing thunderbird 2.0 breaks HTML message BODY  
filtering  
filtering  
Line 46: Line 44:
10n Specific:
10n Specific:


* Fixed: 373555 – TB 2.0: a string under "order by" has to be changed
* Verified 373555 – TB 2.0: a string under "order by" has to be changed
* Fixed: 375466 – Some Thunderbird 2.0 dialogs still need resizing in Mac OS X
* Verified: 375466 – Some Thunderbird 2.0 dialogs still need resizing in Mac OS X
* Fixed: 373630 – A few Thunderbird (ca) string corrections
* verified: 373630 – A few Thunderbird (ca) string corrections
* Fixed: 326915 – Dutch (nl) translation of Thunderbird and Firefox mozilla_1_8_branch
* Fixed: 326915 – Dutch (nl) translation of Thunderbird and Firefox mozilla_1_8_branch
* Fixed: 374633 – Spellcheck doesn't work in pt-PT Thunderbird  
* Verified: 374633 – Spellcheck doesn't work in pt-PT Thunderbird  


Security issue: (1)
Security issue: (1)


* verified: 332771 - delayed S/Mime verification broken when message opened in separate window
* Verified: 332771 - delayed S/Mime verification broken when message opened in separate window


Crash: (1)
Crash: (1)
Line 79: Line 77:
Installer: (1)
Installer: (1)


* Fixed: 376675 - Don't package regxpcom.exe
* Verified: 376675 - Don't package regxpcom.exe


UI improvements: (6)
UI improvements: (6)


* Fixed: 367533 - Dictionary Options tab has issues when there is no dictionary
* Verified: 367533 - Dictionary Options tab has issues when there is no dictionary
read
read
* Fixed: 368112 - Messages lost when multiple messages moved between folders
* Verified: 368112 - Messages lost when multiple messages moved between folders
* Fixed: 377178 - "Go > Mail Start Page" just hide mail headers
* Verified: 377178 - "Go > Mail Start Page" just hide mail headers
* Fixed: 377778 - Reply All doesn't fill in the cc fields anymore
* Verified: 377778 - Reply All doesn't fill in the cc fields anymore
* Fixed: 377900 - RFC 4314 IMAP ACL delete rights are not honored
* Fixed: 377900 - RFC 4314 IMAP ACL delete rights are not honored


XULRunner: (2)
XULRunner: (2)


* Fixed: 329394 - XUL textbox in XHTML page: focusing gives document.commandDispatcher has no properties
* Verified: 329394 - XUL textbox in XHTML page: focusing gives document.commandDispatcher has no properties
* Fixed: 379722 - Starting Firefox or Thunderbird 2.0.0.4 prints "Handling command line!"
* Verified: 379722 - Starting Firefox or Thunderbird 2.0.0.4 prints "Handling command line!"


Mac-specific: (2)
Mac-specific: (2)


* Fixed: 341307 - Thunderbird EULA refers to the "Thunderbird Browser"
* Verified: 341307 - Thunderbird EULA refers to the "Thunderbird Browser"
* Fixed: 365755 - when only a compose window is open, I can't get back to the 3 pane
* Verified: 365755 - when only a compose window is open, I can't get back to the 3 pane


=== *[http://wiki.mozilla.org/Thunderbird:2.0.0.4:Test_Plan:Extensions Extension Testing] ===
=== *[http://wiki.mozilla.org/Thunderbird:2.0.0.4:Test_Plan:Extensions Extension Testing] ===
==== Tomcat's Testing ====
Tomcat tested the following extensions:
*adblock, mnehny, ntt and testing enigmail
==== marcia's Testing ====
*DownThemAll 0.9.9.10
*Enigmail 0.95.1
*Flashgot 0.5.99
*FoxyTunes 2.9
*Image Zoom 0.3
*Lightning 0.3.1
*MinimizeToTray
*Mouse Gestures 1.5.2
*Stationery 0.4.4
*US English Dictionary 2.0.0.6
*AdBlock Plus 0.7.5.1
*Copy Sent to Current 0.7.4
=== *[http://wiki.mozilla.org/Thunderbird:2.0.0.4:Test_Plan:Bugs Bugs Seen during Testing] ===
=== *[http://wiki.mozilla.org/Thunderbird:2.0.0.4:Test_Plan:Bugs Bugs Seen during Testing] ===
=== *[http://wiki.mozilla.org/Thunderbird:2.0.0.4:Test_Plan:Inproduct In Product Site Testing] ===
=== *[http://wiki.mozilla.org/Thunderbird:2.0.0.4:Test_Plan:Inproduct In Product Site Testing] ===
=== *[http://wiki.mozilla.org/Thunderbird:2.0.0.4:Test_Plan:Live Live Testing] ===
=== *[http://wiki.mozilla.org/Thunderbird:2.0.0.4:Test_Plan:Live Live Testing] ===
= Notes from Post Mortem =
*General Feeling that the release went smoothly
*mscott noted that we should file a bug day before the update push
*Item to Add to the Release checklist -> The IT request to push changes live needs an a=. [juanb: will add it to the wiki]
*marcia noted a few mentions of update issues in #thunderbird, will investigate further. early hendrix feedback has not shown any issues.

Latest revision as of 19:35, 15 June 2007

Test Plan for RC1 release

  • BFT on Windows
  • Spot check of Mac and Linux Platforms
  • Some Windows Vista testing
  • Bug verifications (security and critical)

Testing Results

BFT/Smoketests

RC1 Smoketests

  • Windows Vista [tomcat] PASS
  • Mac [marcia]PASS (results in Litmus)
  • Linux [tomcat] PASS

Bugs Found during smoketesting:

  • bug 383846 Bug 383846 – Tags could be lost when Sent folder index is rebuild
  • bug 383873 Bug 383873 – Run Junk Mail control on Folder result in all Mail marked as junk

l10n related testing

Testing Results for RC1

*Smoketests and BFTs

*l10n Testing

*Updates Testing

*Bug Verifications

Changes in 2.0.0.4 (so far): (21)

Other

  • Fixed: 371672 - assert in morkConfig, invalid mork db (Not easily verifiable according to dbienvenu)
  • Verified: 378147 – Installing thunderbird 2.0 breaks HTML message BODY

filtering

10n Specific:

  • Verified 373555 – TB 2.0: a string under "order by" has to be changed
  • Verified: 375466 – Some Thunderbird 2.0 dialogs still need resizing in Mac OS X
  • verified: 373630 – A few Thunderbird (ca) string corrections
  • Fixed: 326915 – Dutch (nl) translation of Thunderbird and Firefox mozilla_1_8_branch
  • Verified: 374633 – Spellcheck doesn't work in pt-PT Thunderbird

Security issue: (1)

  • Verified: 332771 - delayed S/Mime verification broken when message opened in separate window

Crash: (1)

  • verified: 377125 - crash in PrepareAndDispatch when calling nsIMsgQuote::QuoteMessage from javascript

Build configuration: (4)

  • verified: 376418 - Add ko to the 1.8 branch for future thunderbird 2 point releases.
  • verified: 378533 - Remove xmlextras.xpt
  • verified: 378762 - Add echo-variable-% for client.mk vars
  • verified: 378958 - Move NSPR pull-tag for 1.8.1.4 and 1.8.0.12

Filter-related: (1)

  • Verified: 355537 - If Action includes adding a TAG, the filter does not work on incoming mail - must be run manually
  • Verified 355537 - FILTERS: If Action includes adding a TAG, the filter does not work on incoming mail - must be run manually

Functionality: (3)

  • Fixed: 183722 - missing hotsync log entry on both PC and Palm to indicate Mozilla Address Book Sync
  • Verified: 378147 - Installing thunderbird 2.0 breaks HTML message BODY filtering have it load in the start page

Installer: (1)

  • Verified: 376675 - Don't package regxpcom.exe

UI improvements: (6)

  • Verified: 367533 - Dictionary Options tab has issues when there is no dictionary

read

  • Verified: 368112 - Messages lost when multiple messages moved between folders
  • Verified: 377178 - "Go > Mail Start Page" just hide mail headers
  • Verified: 377778 - Reply All doesn't fill in the cc fields anymore
  • Fixed: 377900 - RFC 4314 IMAP ACL delete rights are not honored

XULRunner: (2)

  • Verified: 329394 - XUL textbox in XHTML page: focusing gives document.commandDispatcher has no properties
  • Verified: 379722 - Starting Firefox or Thunderbird 2.0.0.4 prints "Handling command line!"

Mac-specific: (2)

  • Verified: 341307 - Thunderbird EULA refers to the "Thunderbird Browser"
  • Verified: 365755 - when only a compose window is open, I can't get back to the 3 pane

*Extension Testing

Tomcat's Testing

Tomcat tested the following extensions:

  • adblock, mnehny, ntt and testing enigmail

marcia's Testing

  • DownThemAll 0.9.9.10
  • Enigmail 0.95.1
  • Flashgot 0.5.99
  • FoxyTunes 2.9
  • Image Zoom 0.3
  • Lightning 0.3.1
  • MinimizeToTray
  • Mouse Gestures 1.5.2
  • Stationery 0.4.4
  • US English Dictionary 2.0.0.6
  • AdBlock Plus 0.7.5.1
  • Copy Sent to Current 0.7.4

*Bugs Seen during Testing

*In Product Site Testing

*Live Testing

Notes from Post Mortem

  • General Feeling that the release went smoothly
  • mscott noted that we should file a bug day before the update push
  • Item to Add to the Release checklist -> The IT request to push changes live needs an a=. [juanb: will add it to the wiki]
  • marcia noted a few mentions of update issues in #thunderbird, will investigate further. early hendrix feedback has not shown any issues.