Thunderbird:2:Test Plan: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
No edit summary
 
(31 intermediate revisions by 3 users not shown)
Line 8: Line 8:


== Testing Results ==
== Testing Results ==
= [http://wiki.mozilla.org/index.php?title=Thunderbird:2:Test_Plan:BFT BFT/Smoketests] =
= [http://wiki.mozilla.org/Thunderbird:2:Test_Plan:l10n l10n related testing] =
= [http://wiki.mozilla.org/Thunderbird:2:Test_Plan:Software_Update Update testing] =


=== Tomcats results ===
=== Tomcats results ===
Line 33: Line 37:




= Test Plan for Beta 1 release =
= Test Plan for Beta 2 release =


== Testing Results ==
== Testing Results ==
Line 40: Line 44:


Tester: Marcia
Tester: Marcia
*Tests run on 1/18/07 and 1/19/07
*Smoketest on Intel Mac - '''PASS''' (results in Litmus)
*Smoketest on Intel Mac - '''PASS''' (results in Litmus)
**version 2 beta 2 (20070116)
**version 2 beta 2 (20070116)
**BuildID = "2007011615"
**BuildID = "2007011615"
=== Tomcats Results ===
Tester: tomcat
*Smoketest on Linux Fedora FC 6 - '''PASS''' (results in Litmus)
**version 2 beta 2 (20070116)
**BuildID = "2007011615"
** Bug : Bug 361702
Tester: Tomcat
*Smoketest on Windows XP x64 - '''PASS''' (results in Litmus)
**version 2 beta 2 (20070116)
**BuildID = "2007011615"
Tester: Tomcat
*BFT on Windows XP x64 and Windows 2003 Enterprise- '''PASS''' (results in Litmus)
**version 2 beta 2 (20070116)
**BuildID = Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.1.2pre)
Gecko/20070116 Thunderbird/2.0b2 ID:2007011615
=== Aleksej's results ===
Enviroment: Debian GNU/Linux 4.0, Xorg, Beryl window manager (with Emerald), GNOME Panel.
version 2 beta 2 (20070116)
BuildID: 2007011615
Testing: BFT/FFT
==== Thunderbird problems ====
*http://litmus.mozilla.org/single_result.cgi?id=46717 - https://bugzilla.mozilla.org/show_bug.cgi?id=367511 (move/copy to Unsent) -- RESOLVED INVALID (intentional behaviour)
*https://bugzilla.mozilla.org/show_bug.cgi?id=367660 (Choose button in a Saved search creation)
*https://bugzilla.mozilla.org/show_bug.cgi?id=257885 (Flag/Star set from menu persistence)
==== Testcase problems ====
===== major =====
*http://litmus.mozilla.org/single_result.cgi?id=46713
*http://litmus.mozilla.org/single_result.cgi?id=46727
===== normal =====
*http://litmus.mozilla.org/single_result.cgi?id=46714
*http://litmus.mozilla.org/single_result.cgi?id=46715
*http://litmus.mozilla.org/single_result.cgi?id=46729 (Folder Summary tooltips)
===== minor =====
*http://litmus.mozilla.org/single_result.cgi?id=46716 (wrong word?)
*http://litmus.mozilla.org/single_result.cgi?id=46728 (a typo)
==== Unclassified problems ====
*http://litmus.mozilla.org/single_result.cgi?id=46731 (Recent Folders)
= Beta 2 Live Testing =
Tester: Tomcat
* Live-Test on Windows XP x64 SP1 '''PASS'''
**version 2 beta 2 (20070116)
** Build id: Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.1.2pre) Gecko/20070116 Thunderbird/2.0b2 Mnenhy/0.7.4.10002 ID:2007011615
Tester: marcia
* en-US Live-Test on Intel Mac '''PASS'''
**version 2 beta 2 (20070116)
** BuildID = "2007011615"
**First update I crashed in nsMacEventHandler::HandleMouseMoveEvent(EventRecord&) + 280 but I was not able to reproduce.
**Second update was a PASS
Tester: marcia
* en-US Live-Test on Windows Vista RTM '''PASS'''
**version 2 beta 2 (20070116)
** BuildID = "2007011615"
= Test Plan for RC1 release =
*BFT on Windows->1/2 on XP and 1/2 on Vista
*Spot check of Mac and Linux Platforms
*Windows Vista testing
**Run full set of Vista testcases in Litmus suite
*Test Profiles->going from a Tbird 1.5 profile to Tbird 2 RC1
*Spot check of l10n locales
*Spot check of updates
== Testing Results for RC1 ==
=== *[http://wiki.mozilla.org/Thunderbird:2:Test_Plan:BFT Smoketests and BFTs]===
=== *[http://wiki.mozilla.org/Thunderbird:2:Test_Plan:l10n l10n Testing] ===
=== *[http://wiki.mozilla.org/Thunderbird:2:Test_Plan:Update Testing Update Testing] ===
=== *[http://wiki.mozilla.org/Thunderbird:2:Test_Plan:Verifications Bug Verifications] ===
=== *[http://wiki.mozilla.org/Thunderbird:2:Test_Plan:Extensions Extension Testing] ===
=== *[http://wiki.mozilla.org/Thunderbird:2:Test_Plan:Bugs Bugs Seen during Testing] ===
=== *[http://wiki.mozilla.org/Thunderbird:2:Test_Plan:Inproduct In Product Site Testing] ===
=== *[http://wiki.mozilla.org/Thunderbird:2:Test_Plan:Live Live Testing] ===
= Notes from Post Mortem held on April 23, 2007 =

Latest revision as of 20:03, 24 April 2007

Test Plan for Beta 1 release

  • BFT on Windows
  • Spot check of Mac and Linux Platforms
  • Some Windows Vista testing
  • Test Tags going from a Tbird 1.5 profile to Tbird 2 Beta1
  • No updates and no l10n for this release

Testing Results

BFT/Smoketests

l10n related testing

Update testing

Tomcats results

    • Tester: Tomcat
    • Date: 6/7. December 2006:
    • OS: Windows 2000 SP 4 / Windows XP x64
    • OS String: version 2 beta 1 (20061204)
    • Test: BFT
    • Result: PASS Results in Litmus
    • Tester: Tomcat
    • Date: 11 December 2006:
    • OS: Fedora FC 6
    • OS String: Thunderbird 2.0b1 ID:2006120615
    • Test: Smoketest
    • Result: PASS Results in Litmus

marcia's results =

Tester: Marcia


Test Plan for Beta 2 release

Testing Results

marcia's results

Tester: Marcia

  • Tests run on 1/18/07 and 1/19/07
  • Smoketest on Intel Mac - PASS (results in Litmus)
    • version 2 beta 2 (20070116)
    • BuildID = "2007011615"

Tomcats Results

Tester: tomcat

  • Smoketest on Linux Fedora FC 6 - PASS (results in Litmus)
    • version 2 beta 2 (20070116)
    • BuildID = "2007011615"
    • Bug : Bug 361702


Tester: Tomcat

  • Smoketest on Windows XP x64 - PASS (results in Litmus)
    • version 2 beta 2 (20070116)
    • BuildID = "2007011615"

Tester: Tomcat

  • BFT on Windows XP x64 and Windows 2003 Enterprise- PASS (results in Litmus)
    • version 2 beta 2 (20070116)
    • BuildID = Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.1.2pre)

Gecko/20070116 Thunderbird/2.0b2 ID:2007011615

Aleksej's results

Enviroment: Debian GNU/Linux 4.0, Xorg, Beryl window manager (with Emerald), GNOME Panel.

version 2 beta 2 (20070116) BuildID: 2007011615

Testing: BFT/FFT

Thunderbird problems

Testcase problems

major
normal
minor

Unclassified problems

Beta 2 Live Testing

Tester: Tomcat

  • Live-Test on Windows XP x64 SP1 PASS
    • version 2 beta 2 (20070116)
    • Build id: Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.1.2pre) Gecko/20070116 Thunderbird/2.0b2 Mnenhy/0.7.4.10002 ID:2007011615

Tester: marcia

  • en-US Live-Test on Intel Mac PASS
    • version 2 beta 2 (20070116)
    • BuildID = "2007011615"
    • First update I crashed in nsMacEventHandler::HandleMouseMoveEvent(EventRecord&) + 280 but I was not able to reproduce.
    • Second update was a PASS

Tester: marcia

  • en-US Live-Test on Windows Vista RTM PASS
    • version 2 beta 2 (20070116)
    • BuildID = "2007011615"

Test Plan for RC1 release

  • BFT on Windows->1/2 on XP and 1/2 on Vista
  • Spot check of Mac and Linux Platforms
  • Windows Vista testing
    • Run full set of Vista testcases in Litmus suite
  • Test Profiles->going from a Tbird 1.5 profile to Tbird 2 RC1
  • Spot check of l10n locales
  • Spot check of updates

Testing Results for RC1

*Smoketests and BFTs

*l10n Testing

*Testing Update Testing

*Bug Verifications

*Extension Testing

*Bugs Seen during Testing

*In Product Site Testing

*Live Testing

Notes from Post Mortem held on April 23, 2007

Retrieved from "https://wiki.mozilla.org/index.php?title=Thunderbird:2:Test_Plan&oldid=55053"