Add-ons/QA/Testplan/Webextensions Dictionaries

From MozillaWiki
Jump to: navigation, search

Revision History

Date Version Author Description
11/21/2017 1.0 Alexandra Gal-Moga Created first draft

Overview

  • A dictionary is an add-on which automatically checks the spelling of words that the user enters in text boxes containing more than one line. Installing a dictionary will add a new language option to the user’s spell-checker.
  • In order to move away from legacy packaging and legacy manifests, dictionaries will also be moved to WebExtensions packaging. They will be handled through Add-ons Manager.

Purpose

  • The purpose of this implementation is to automatically convert all legacy dictionaries to the new packaging format.

Entry Criteria

  • QA has access to PRDs and mocks (from bugs)

Current Status

  • The feature is still under implementation

Exit Criteria

  • All related bugs triaged
  • All blockers fixed
  • All resolved bugs verified by QA
  • Found-fixed bugs rate going down in time

Scope

This section describes what parts of the feature will be tested and what parts won't be.

what's in scope?

  • Dictionary validation
    • detect if the XPI is a dictionary and give it the correct type
    • show an error if a dictionary uses strict_max_version, since they shouldn't have compatibility restrictions
    • In the linter, validate that the add-on only includes the dictionary manifest flags. (dictionaries shouldn't run any code)
  • Dictionary submission
  • Dictionary auto-approval
  • Dictionary installation

what's out of scope?

  • Extensions functionality

Ownership

Product Manager: Jorge Villalobos; irc nick :jorgev
QA Manager: Krupa Raj; irc nick :krupa
QA Lead: Victor Carciu; irc nick :victorc
Add-ons QA: Valentina Virlics; irc nick :ValentinaV
Add-ons QA: Alexandra Moga; irc nick :LexaSV
Webextensions QA: Cosmin Badescu; irc nick :CosminB
Webextensions QA: Marius Santa; irc nick :Santa

Requirements for testing

Environments

  • Windows
  • Mac OS
  • Linux

Servers

Channel dependent settings (configs) and environment setups

  • Nightly
  • Beta
  • Release

Test Strategy

Builds

This section should contain links for builds with the feature -


Test Execution Schedule

The following table identifies the anticipated testing period available for test execution.

Project phase Start Date End Date
Start project
Study PRD/mocks received
QA - Test plan creation 11.21.2017
QA - Test cases preparation
QA - Test cases execution
Release Date

Testing Tools

Process Tool
Test plan creation Mozilla wiki
Test case creation TestRail
Test case execution TestRail
Bugs management Github

References

Testcases

Test Areas

  • Submission/Approvals/Installation of Webextensions Dictionaries

Test Areas

Test Areas Covered Details
Installation from AMO
Installation from Add-ons Manager
Installation from Third-party
Dictionary updates
Sideloading
Other

Bug Work

  • Feature bugs
- 6739 (traker)  
  
* bug 1410214 - Implement support for WebExtensions Dictionaries
   

Sign off

Criteria

Check list

  • All test cases should be executed
  • All blockers must be fixed and verified or have an agreed-upon timeline for being fixed

Checklist

Exit Criteria Status Notes/Details
Testing Prerequisites (specs, use cases)
Testing Infrastructure setup
Test Plan Creation
Test Cases Creation
Full Functional Tests Execution
Automation Coverage
Performance Testing
All Defects Logged
Critical/Blockers Fixed and Verified
Metrics/Telemetry
QA Signoff - Nightly Release
QA Beta - Full Testing
QA Signoff - Beta Release