Calendar:QA Test Plan 0.9: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(23 intermediate revisions by 4 users not shown)
Line 9: Line 9:
== Schedule ==
== Schedule ==
* [[Calendar:QA_Test_Plan_0.9#Bug_Verifications|Bug Verifications]]: '''NOW'''
* [[Calendar:QA_Test_Plan_0.9#Bug_Verifications|Bug Verifications]]: '''NOW'''
* RC1: ''TBD''
* RC1: September 11, 2008
* QA
* QA
** Smoketests (including results from L10N Testing) : ''TBD''
** Smoketests (including results from L10N Testing) : '''NOW'''
** [[Calendar:QA_Test_Plan_0.9#L10N_Test_Results|L10N Testing]] (Spottests): '''NOW'''
** [[Calendar:QA_Test_Plan_0.9#L10N_Test_Results|L10N Testing]] (Spottests): '''NOW'''
*** [http://ftp.mozilla.org/pub/mozilla.org/calendar/sunbird/nightly/latest-mozilla1.8-l10n/ Latest Sunbird L10N Builds]
*** [https://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=5&branch_id=13&testgroup_id=35&subgroup_id=650 Run Localization Litmus testcases for Sunbird]
*** [https://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=5&branch_id=13&testgroup_id=35&subgroup_id=650 Run Localization Litmus testcases for Sunbird]
*** [https://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=5&branch_id=13&testgroup_id=36&subgroup_id=651 Run Localization Litmus testcases for Lightning]
*** [https://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=5&branch_id=13&testgroup_id=36&subgroup_id=651 Run Localization Litmus testcases for Lightning]
** BFTs (using Litmus where possible): ''TBD''
** BFTs (using Litmus where possible): '''NOW'''
*** Events/Recurring events
*** Events/Recurring events
*** Events/Tasks in timezones
*** Events/Tasks in timezones
Line 36: Line 35:
*** Timezone guessing
*** Timezone guessing
*** Interoperability: Import/Export
*** Interoperability: Import/Export
** Migration Testing: ''TBD''
** Migration Testing: '''NOW'''
*** 0.8 > 0.9
*** 0.8 > 0.9
*** 0.7 > 0.9
*** 0.7 > 0.9
Line 138: Line 137:
! style="background:#ffdead;" | Solaris Sparc
! style="background:#ffdead;" | Solaris Sparc
! style="background:#ffdead;" | Solaris x86
! style="background:#ffdead;" | Solaris x86
!
!  
|-
|-
| style="background:#ffdead;" | '''ca'''
| style="background:#ffdead;" | '''ca'''
|
|  
| http://www.reinit.net/rc1-ok.png
|  
|  
|  
|  
|
|  
|  
|  
|  
| http://www.reinit.net/rc1-ok.png
|  
|  
|  
|  
| http://www.reinit.net/rc1-ok.png
|  
|  
|http://www.reinit.net/rc1-ok.png
|
|-
|-
| style="background:#ffdead;" | '''cs'''
| style="background:#ffdead;" | '''cs'''
Line 157: Line 156:
|  
|  
|  
|  
|
|  
|  
|
| http://www.reinit.net/rc1-ok.png
|
| http://www.reinit.net/rc1-ok.png
|  
|  
|  
|  
|  
|http://www.reinit.net/rc1-failed.png
|  
|  
| {{bug|450588}}
|-
|-
| style="background:#ffdead;" | '''da'''
| style="background:#ffdead;" | '''da'''
|  
|  
|  
|  
|  
| http://www.reinit.net/rc1-ok.png
|
|
|  
|  
|  
|  
|  
|  
| http://www.reinit.net/rc1-ok.png
| http://www.reinit.net/rc1-ok.png
|  
|  
|  
|  
Line 183: Line 182:
|  
|  
|  
|  
| http://www.reinit.net/rc1-ok.png
|  
|  
|  
|  
|
| http://www.reinit.net/rc1-ok.png
| http://www.reinit.net/rc1-failed.png
|
|  
|  
|  
|  
|  
|  
| {{bug|450600}}
|-
|-
| style="background:#ffdead;" | '''es-AR'''
| style="background:#ffdead;" | '''es-AR'''
Line 198: Line 197:
|  
|  
|
|
|http://www.reinit.net/rc1-failed.png
|  
|  
|  
|  
|  
|  
|  
|  
|  
|{{bug|450725}} {{bug|449646}}
|  
|-
|-
| style="background:#ffdead;" | '''es-ES'''
| style="background:#ffdead;" | '''es-ES'''
Line 211: Line 210:
|  
|  
|  
|  
|http://www.reinit.net/rc1-failed.png
|
|http://www.reinit.net/rc1-failed.png
|http://www.reinit.net/rc1-ok.png
|  
|  
|http://www.reinit.net/rc1-failed.png
|
|http://www.reinit.net/rc1-failed.png
|
|{{bug|450580}}
|
|-
|-
| style="background:#ffdead;" | '''eu'''
| style="background:#ffdead;" | '''eu'''
Line 227: Line 226:
|  
|  
|
|
|  
|http://www.reinit.net/rc1-ok.png
|  
|  
|  
|  
Line 239: Line 238:
|  
|  
|
|
|  
|http://www.reinit.net/rc1-ok.png
|  
|  
|  
|  
Line 251: Line 250:
|  
|  
|
|
| http://www.reinit.net/rc1-failed.png
|http://www.reinit.net/rc1-ok.png
|  
|  
|  
|  
|  
|  
|{{bug|450600}}
|
|-
|-
| style="background:#ffdead;" | '''hu'''
| style="background:#ffdead;" | '''hu'''
Line 263: Line 262:
|  
|  
|  
|  
|  
| http://www.reinit.net/rc1-ok.png
|
|
|  
|  
Line 289: Line 288:
|  
|  
|  
|  
| http://www.reinit.net/rc1-failed.png
| http://www.reinit.net/rc1-ok.png
| http://www.reinit.net/rc1-failed.png
| http://www.reinit.net/rc1-ok.png
|  
|  
| http://www.reinit.net/rc1-failed.png
| http://www.reinit.net/rc1-ok.png
|
|
|
| {{bug|450713}}
|-
|-
| style="background:#ffdead;" | '''ja(-JP)'''
| style="background:#ffdead;" | '''ja(-JP)'''
Line 304: Line 303:
|  
|  
|  
|  
|
|http://www.reinit.net/rc1-ok.png
|  
|  
|  
|  
Line 316: Line 315:
|  
|  
|  
|  
| http://www.reinit.net/rc1-failed.png
|http://www.reinit.net/rc1-ok.png
|
|  
|  
|  
|  
|  
|  
|{{bug|450600}}
|-
|-
| style="background:#ffdead;" | '''ko'''
| style="background:#ffdead;" | '''ko'''
Line 328: Line 327:
|  
|  
|  
|  
|  
| http://www.reinit.net/rc1-ok.png
|
|
|  
|  
Line 347: Line 346:
| http://www.reinit.net/rc1-ok.png
| http://www.reinit.net/rc1-ok.png
|  
|  
|-
| style="background:#ffdead;" | '''mk'''
|
|
|
|
|
|
|
|
|
|
| no build
|-
|-
| style="background:#ffdead;" | '''nb-NO'''
| style="background:#ffdead;" | '''nb-NO'''
Line 369: Line 355:
|
|
|  
|  
|  
|http://www.reinit.net/rc1-ok.png
|  
|  
|  
|  
Line 376: Line 362:
| style="background:#ffdead;" | '''nl'''
| style="background:#ffdead;" | '''nl'''
|  
|  
|  
|http://www.reinit.net/rc1-ok.png
|  
|  
|  
|  
|  
|  
|
|
| http://www.reinit.net/rc1-failed.png
|http://www.reinit.net/rc1-ok.png
|  
|  
|  
|  
|  
|  
|{{bug|450600}}
|
|-
|-
| style="background:#ffdead;" | '''nn-NO'''
| style="background:#ffdead;" | '''nn-NO'''
Line 393: Line 379:
|  
|  
|  
|  
|  
|http://www.reinit.net/rc1-ok.png
|  
|  
|
|
Line 411: Line 397:
|  
|  
| http://www.reinit.net/rc1-ok.png
| http://www.reinit.net/rc1-ok.png
|  
| [http://bonsai-l10n.mozilla.org/cvsview2.cgi?diff_mode=context&whitespace_mode=show&subdir=l10n/pl/calendar/chrome/calendar&command=DIFF_FRAMESET&file=calendar.dtd&rev1=1.2.2.62&rev2=1.2.2.62.4.1&root=/l10n one fix]
|-
|-
| style="background:#ffdead;" | '''pt-BR'''
| style="background:#ffdead;" | '''pt-BR'''
Line 434: Line 420:
|  
|  
|
|
|  
|http://www.reinit.net/rc1-ok.png
|  
|  
|  
|  
Line 458: Line 444:
|  
|  
|  
|  
|
|http://www.reinit.net/rc1-ok.png
|  
|  
|  
|  
Line 485: Line 471:
|  
|  
|  
|  
|
|  
|  
|  
|  
|  
|  
| no build
|  
|
|-
|-
| style="background:#ffdead;" | '''sv-SE'''
| style="background:#ffdead;" | '''sv-SE'''
Line 503: Line 489:
|  
|  
|  
|  
|-
| style="background:#ffdead;" | '''tr'''
|
|
|
|
|
|
|
|
|
|
| no build
|-
|-
| style="background:#ffdead;" | '''uk'''
| style="background:#ffdead;" | '''uk'''
Line 524: Line 497:
|  
|  
|  
|  
|  
|http://www.reinit.net/rc1-ok.png
|  
|  
|
|
Line 551: Line 524:
|
|
|  
|  
|  
|http://www.reinit.net/rc1-ok.png
|  
|  
|  
|  

Latest revision as of 21:03, 16 September 2008

Sunbird & Lightning 0.9 Test Plan

This is a checklist of tasks we should perform before release. Please add your achievements, and refine the schedule (e.g. add a specific feature you tested) if needed.

Current Tasks

  • Ongoing: Bug Verifications and l10n Testing
  • Next: Smoketests and Basic Functionality Tests (BFTs)

Schedule

  • Bug Verifications: NOW
  • RC1: September 11, 2008
  • QA
    • Smoketests (including results from L10N Testing) : NOW
    • L10N Testing (Spottests): NOW
    • BFTs (using Litmus where possible): NOW
      • Events/Recurring events
      • Events/Tasks in timezones
      • Unifinder (aka event list)
      • Calendar views
        • Day View
        • Week View
        • Multiweek View
        • Month View
      • Tasks & Task views
      • Lightning: Event/Email/Task conversion
      • Lightning: Today Pane
      • Lightning: iTIP/iMIP (calendar invitations)
      • Calendar providers
        • Local storage
        • ICS/WebDAV
        • CalDAV
        • WCAP
      • Timezone guessing
      • Interoperability: Import/Export
    • Migration Testing: NOW
      • 0.8 > 0.9
      • 0.7 > 0.9
      • 0.3.1/0.5 > 0.9
      • 0.3 > 0.9
    • Sunbird Update Testing (if possible)
    • Sunbird Installer Testing
  • Final release: TBD

Builds

Test Results

Test Result Matrix
Smoketests BFTs Migration from
0.3 0.3.1/0.5 0.7 0.8
Lightning 0.9 RC1 TODO (Win) TODO (Lin) TODO (Mac) TODO (SolSpa) TODO (Solx86) TODO (Win) TODO (Lin) TODO (Mac) TODO (SolSpa) TODO (Solx86) TODO (Win) TODO (Lin) TODO (Mac) TODO (SolSpa) TODO (Solx86) TODO (Win) TODO (Lin) TODO (Mac) TODO (SolSpa) TODO (Solx86) TODO (Win) TODO (Lin) TODO (Mac) TODO (SolSpa) TODO (Solx86) TODO (Win) TODO (Lin) TODO (Mac) TODO (SolSpa) TODO (Solx86)


Test Result Matrix
Smoketests BFTs Migration from Update Installer (Windows)
0.3 0.3.1/0.5 0.7 0.8
Sunbird 0.9 RC1 TODO (Win) TODO (Lin) TODO (Mac) TODO (SolSpa) TODO (Solx86) TODO (Win) TODO (Lin) TODO (Mac) TODO (SolSpa) TODO (Solx86) TODO (Win) TODO (Lin) TODO (Mac) TODO (SolSpa) TODO (Solx86) TODO (Win) TODO (Lin) TODO (Mac) TODO (SolSpa) TODO (Solx86) TODO (Win) TODO (Lin) TODO (Mac) TODO (SolSpa) TODO (Solx86) TODO (Win) TODO (Lin) TODO (Mac) TODO (SolSpa) TODO (Solx86) TODO (Win) TODO (Lin) TODO (Mac) TODO (SolSpa) TODO (Solx86) TODO

L10N Test Results

Instructions for L10N Testing

Legend: rc1-ok.png (PASSED) | rc1-failed.png (FAILED) | rc1-broken.png (BROKEN) | rc1-retest.png (RETEST)

l10n Test Result Matrix
Lightning 0.9 Sunbird 0.9 Bugs
Windows Linux Mac OS X Solaris Sparc Solaris x86 Windows Linux Mac OS X Solaris Sparc Solaris x86
ca rc1-ok.png rc1-ok.png rc1-ok.png
cs rc1-ok.png rc1-ok.png
da rc1-ok.png rc1-ok.png rc1-ok.png
de rc1-ok.png rc1-ok.png
es-AR rc1-failed.png bug 450725 bug 449646
es-ES rc1-ok.png
eu rc1-ok.png
fr rc1-ok.png
ga-IE rc1-ok.png
hu rc1-ok.png
it rc1-ok.png
is rc1-ok.png rc1-ok.png rc1-ok.png
ja(-JP) rc1-ok.png
ka rc1-ok.png
ko rc1-ok.png
lt rc1-ok.png
nb-NO rc1-ok.png
nl rc1-ok.png rc1-ok.png
nn-NO rc1-ok.png
pl rc1-ok.png one fix
pt-BR rc1-ok.png
pt-PT rc1-ok.png
ro rc1-failed.png bug 450618
ru rc1-ok.png
sk rc1-ok.png
sl
sv-SE rc1-ok.png
uk rc1-ok.png
zh-CN rc1-ok.png
zh-TW rc1-ok.png

Bug Verifications

When you verify the bug is fixed:

Tips:

  • If you don't see an easy way to verify or need further clarification add a comment to the bug or request the in-testsuite flag.
Retrieved from "https://wiki.mozilla.org/index.php?title=Calendar:QA_Test_Plan_0.9&oldid=109051"