Calendar:QA Test Plan 0.8

Sunbird & Lightning 0.8 Test Plan

This is a checklist of tasks we should perform before release. Please add your achievements, and refine the schedule (e.g. add a specific feature you tested) if needed.

Current Tasks

  • Ongoing: Bug Verifications and l10n Testing
  • Next: Smoketests and Basic Functionality Tests (BFTs)

Schedule

  • Code freeze for RC1: ASAP
  • Build for RC1 starts: ASAP
  • RC1: March 6th
  • Bug Verifications: NOW
  • QA
    • Smoketests: TBD
    • l10n Testing (Spottests): March 6th
    • BFTs (using Litmus where possible): March 6th
      • Events/Recurring events
      • Events/Tasks in timezones
      • Unifinder (aka event list)
      • Calendar views
        • Day View
        • Week View
        • Multiweek View
        • Month View
      • Tasks & Task views
      • Lightning: Event/Email/Task conversion
      • Lightning: Today Pane
      • Lightning: iTIP/iMIP (calendar invitations)
      • Calendar providers
      • Timezone guessing
      • Interoperability: Import/Export
    • Migration Testing
      • 0.7 > 0.8
      • 0.5 > 0.8
      • 0.3/0.3.1 > 0.8
    • Sunbird Update Testing (if possible)
    • Sunbird Installer Testing
  • Final release: TBD

Builds

Test Results

Test Result Matrix
Smoketests BFTs Migration from (Ltn) Migration from (Sb) Update (Sb) Installer (Sb/Win)
0.3 0.3.1/0.5 0.7 0.3 0.3.1/0.5 0.7
0.8 RC1 TODO TODO (Win) TODO (Linux) TODO (Mac) TODO (Win) TODO (Linux) TODO (Mac) TODO (Win) TODO (Linux) TODO (Mac) TODO (Win) TODO (Linux) TODO (Mac) TODO (Win) TODO (Linux) TODO (Mac) TODO (Win) TODO (Linux) TODO (Mac) TODO (Win) TODO (Linux) TODO (Mac) TODO (Win) TODO (Linux) TODO (Mac) TODO

L10N Test Results

PASSED: rc1-ok.png FAILED: rc1-failed.png BROKEN: rc1-broken.png

l10n Test Result Matrix
Lightning 0.8 RC1 Sunbird 0.8 RC1
ca Win: rc1-ok.png Linux: rc1-ok.png TODO (Mac) TODO (Win) Linux: rc1-ok.png TODO (Mac)
cs Win: rc1-ok.png Linux: rc1-ok.png TODO (Mac) TODO (Win) Linux: rc1-ok.png TODO (Mac)
da Win: rc1-ok.png Linux: rc1-ok.png TODO (Mac) TODO (Win) Linux: rc1-ok.png TODO (Mac)
de Win: rc1-ok.png Linux: rc1-ok.png Mac: rc1-ok.png TODO (Win) Linux: rc1-ok.png Mac: rc1-ok.png
es-AR Win: rc1-broken.png Linux: rc1-broken.png Mac: rc1-broken.png Win: rc1-broken.png Linux: rc1-broken.png Mac: rc1-broken.png
es-ES Win: rc1-ok.png Linux: rc1-ok.png TODO (Mac) TODO (Win) Linux: rc1-ok.png TODO (Mac)
eu Win: rc1-ok.png Linux: rc1-ok.png TODO (Mac) TODO (Win) Linux: rc1-ok.png TODO (Mac)
fr Win: rc1-ok.png Linux: rc1-ok.png TODO (Mac) TODO (Win) Linux: rc1-ok.png TODO (Mac)
ga-IE Win: rc1-ok.png Linux: rc1-ok.png Mac: rc1-ok.png TODO (Win) Linux: rc1-ok.png TODO (Mac)
hu Win: rc1-ok.png Linux: rc1-ok.png Mac: rc1-ok.png TODO (Win) Linux: rc1-ok.png TODO (Mac)
it Win: rc1-failed.png Linux: rc1-failed.png TODO (Mac) TODO (Win) Linux: rc1-failed.png TODO (Mac)
ja(-JP) TODO (Win) TODO (Linux) Mac: rc1-ok.png TODO (Win) Linux: rc1-ok.png Mac: rc1-ok.png
ka Win: rc1-failed.png Linux: rc1-failed.png TODO (Mac) TODO (Win) Linux: rc1-failed.png TODO (Mac)
ko Win: rc1-ok.png Linux: rc1-ok.png TODO (Mac) TODO (Win) Linux: rc1-ok.png TODO (Mac)
lt Win: rc1-ok.png Linux: rc1-ok.png TODO (Mac) TODO (Win) Linux: rc1-ok.png TODO (Mac)
mk Win: rc1-failed.png Linux: rc1-failed.png TODO (Mac) TODO (Win) Linux: rc1-failed.png TODO (Mac)
nb-NO Win: rc1-ok.png Linux: rc1-ok.png TODO (Mac) TODO (Win) Linux: rc1-ok.png TODO (Mac)
nl Win: rc1-ok.png Linux: rc1-ok.png TODO (Mac) TODO (Win) Linux: rc1-ok.png TODO (Mac)
pl Win: rc1-ok.png Linux: rc1-ok.png TODO (Mac) TODO (Win) Linux: rc1-ok.png TODO (Mac)
pt-BR Win: rc1-ok.png Linux: rc1-ok.png TODO (Mac) TODO (Win) Linux: rc1-ok.png TODO (Mac)
pt-PT Win: rc1-ok.png Linux: rc1-ok.png TODO (Mac) TODO (Win) Linux: rc1-ok.png TODO (Mac)
ru Win: rc1-ok.png Linux: rc1-ok.png TODO (Mac) TODO (Win) Linux: rc1-ok.png TODO (Mac)
sk Win: rc1-ok.png Linux: rc1-ok.png TODO (Mac) TODO (Win) Linux: rc1-ok.png TODO (Mac)
sl Win: rc1-ok.png Linux: rc1-ok.png TODO (Mac) TODO (Win) Linux: rc1-ok.png TODO (Mac)
sv-SE Win: rc1-ok.png Linux: rc1-ok.png TODO (Mac) TODO (Win) Linux: rc1-ok.png TODO (Mac)
tr Win: rc1-ok.png Linux: rc1-ok.png TODO (Mac) TODO (Win) Linux: rc1-ok.png TODO (Mac)
uk Win: rc1-ok.png Linux: rc1-ok.png TODO (Mac) TODO (Win) Linux: rc1-ok.png TODO (Mac)
zh-CN Win: rc1-ok.png Linux: rc1-ok.png TODO (Mac) TODO (Win) Linux: rc1-ok.png TODO (Mac)

Bug Verifications

When you verify the bug is fixed:

Tips:

  • If you don't see an easy way to verify or need further clarification add a comment to the bug or request the in-testsuite flag.