QA/Thunderbird3/TestResults/Beta1

From MozillaWiki
< QA
Jump to: navigation, search

« Back to Thunderbird 3 Beta 1 Release Page | How you can help in Thunderbird QA

Thunderbird 3 Beta 1 Test Results

Testing will focus on smoketests and BFTs of en-US, and spotchecks all shipping locales.

Related Pages

Contact Info

Get announcements about the progress of this and future test events by subscribing to thunderbird-testers mailing list

Release Notes

Please read draft release notes before testing.

Additional information for testers:

Schedule

Builds handed to QA
2008-12-02
QA signoff
  • Smoketests - 2008-12-08
  • Spotchecks - 2008-12-08
  • BFTs - 2008-12-08

Build Location and IDs

Build 2

Build 2 incorporates bug fixes documented in Beta 1 respin bug 467813.

Please do not test using old builds (prior alphas, betas, nightlies). Download candidates builds from http://ftp.mozilla.org/pub/mozilla.org/thunderbird/nightly/3.0b1-candidates/build2

en-US build ids:

  • Windows - version 3.0b1 (20081204115318)
  • Linux - version 3.0b1 (20081204114258)
  • OS X [PPC Mac]: version 3.0b1 (20081204113938)
  • OS X [Intel Mac] - version 3.0b1 (20081204113938)

Build 1

(build1 is obsolete)

Please do not test using prior alphas, prior betas or a nightly. Download candidate builds at http://ftp.mozilla.org/pub/mozilla.org/thunderbird/nightly/3.0b1-candidates/build1

en-US build ids:

  • Windows - version 3.0b1 (20081201164237)
  • Linux - version 3.0b1 (20081201162550)
  • OS X [PPC Mac]: version 3.0b1 (20081201162550)
  • OS X [Intel Mac] - version 3.0b1 (20081201162550)

Test Coverage

Objectives:

  • smoketest - all 3 major platforms, and as many locales as possible
  • BFT - at least one platform (in "pieces", i.e. all not done by one person).
  • Areas Covered (en-US):
    • Spotchecks
    • Smoketests
    • BFTs - excluding themes, updates, addons
    • L10n, spotcheck all shipping locales
  • Areas Not Covered:
    • FFTs

Previous release (for reference purposes): Alpha 3 smoketested all 3 major platforms, full coverage of windows BFT, all shipping locales spot checked

QA Summary

  • Smoketests: 2008-12-02 - 2008-12-07
  • Windows XP/Vista BFTs: 2008-12-02 - 2008-12-07
  • Linux BFTs: 2008-12-02 - 2008-12-07
  • Mac BFTs: -
  • Release to World: 2008-12-??

Testing Results Summary

Smoketests

  • Windows XP SP1 (-who-) - 2008-12-?? [1]
  • Windows Vista SP1 (-who-) - 2008-12-?? [2]
  • Mac OS X [PPC Mac] 10.4 (-who-) - 2008-12-?? [3]
  • Mac OS X [Intel Mac] 10.5 (-who-) - 2008-12-?? [4]
  • Linux x86_64 (henryne) - 2008-12-02 .de [5]

BFTs

  • Windows XP SP2 (-who-) - 2008-12-?? [6]
  • Windows XP Vista (-who-) - 2008-12-?? [7]
  • Mac OS X [PPC Mac] 10.4 (-who-) - 2008-12-?? [8]
  • Mac OS X [Intel Mac] 10.5 (-who-) - 2008-12-?? [9]
  • Linux i686,x86_64 (hhenkel,henryne) - 2008-12-02 [10]

Spot checks

  • Windows Vista SP1 - 2008-12-??
  • Mac OS X [PPC Mac] 10.4 - 2008-12-??
  • Mac OS X [Intel Mac] 10.5 - 2008-12-??
  • Linux (multiple) - 2008-12-??

locales:

  • all PASS - except af which failed, and ja-JP which no one tested

crashes:

  • newly found - bug 467840
  • no topcrash/major worth fixing based on monitoring crash-stats the past week
  • nothing major that wasn't fixed in build2

bugs found:

bugs fixed:

postings:

  • 7 Hendrix in mozilla.feedback.thunderbird.prerelease - no show stoppers

litmus tests completed

Testday

A post release Thunderbird 3 Beta 1 testday has not yet been scheduled. A pre release Thunderbird 3 Beta 1 testday was held.

Detailed Results

Smoketests

Windows XP SP2 (-who-)

  • Date: 2008-12-??
  • Build ID: version 3.0b1 (200812????)
  • Test Type: Litmus Smoketests
  • Results: ????
  • Locale:
  • Bugs reported: ()

Mac OS X [PPC Mac] 10.4 (-who-)

  • Date: 2008-12-??
  • Build ID: version 3.0b1 (200812????)
  • Test Type: Litmus Smoketests
  • Results: ????
  • Bugs reported: bug nn

Mac OS X [Intel Mac] 10.5 (-who-)

  • Date: 2008-12-??
  • Build ID: version 3.0b1 (200812????)
  • Test Type: Litmus Smoketests
  • Results: ????
  • Bugs reported:

Windows XP Vista (-who-)

  • Date: 2008-12-??
  • Build ID: version 3.0b1 (200812????)
  • Test Type: Litmus Smoketests
  • Results: ????
  • Bugs reported: ()

Windows Vista SP2 (-who-)

  • Date: 2008-12-??
  • Build ID: version 3.0b1 (200812????)
  • Test Type: Litmus Smoketests
  • Results: ????
  • Bugs reported: ()

Linux x86_64 (HenryNe)

  • Date: 2008-12-03
  • Build ID: version 3.0b1 (20081201162550)
  • Test Type: Litmus Smoketests
  • Results: PASS
  • Locale: de
  • Bugs reported: (467841 467847 467860)

BFT

Windows XP SP2/Vista (wsmwk and others)

  • Date: 2008-08-08 2008-12-??
  • Build ID: version 3.0b1 (200812????)
  • Test Type: Litmus BFT
  • Results: ????
  • Bugs reported:

Mac (maczilla)

Linux (-who-)

  • Date: 2008-12-?? - 2008-12-??
  • Build ID: version 3.0b1 (200812????)
  • Test Type: Litmus BFT
  • Results: ????
  • Bugs reported:
  • Issues Noted - Bugs filed:
    • _

(

Spot Check

Visually check accounts manager and addons, login to an account, send a message to ensure nothing is obviously broken, tinker around other parts of Thunderbird. To record your test results below: login to the wiki, click edit above at Thunderbird Spot Check, copy one of the blocks below and paste a new one for yourself, and :

  • change PASS/FAILED to PASS or FAILED
  • change -who- to your name
  • change 200812???? to your buildid from help|about

Spot Check Vista SP1 (-who-)

  • Build ID: version 3.0b1 (200812????)
  • Status: PASS/FAILED

Spot Check Linux x86_64 (HenryNe)

  • Build ID: version 3.0b1 (20081204114258, build2)
  • Status: PASS all languages,
    unless locale 'af' FAIL (total broken, no pane, no menu)

Spot Check OS X [PPC Mac] 10.4 (who)

  • Build ID: version 3.0b1 (200812????)
  • Status: PASS/FAILED

Spot Check OS X [Intel Mac] 10.5 (who)

  • Build ID: version 3.0b1 (200812????)
  • Status: PASS/FAILED
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Thunderbird3/TestResults/Beta1&oldid=120455"