Add-ons/QA/Testplan/Webextensions Dictionaries
From MozillaWiki
< Add-ons
Revision History
Date | Version | Author | Description |
---|---|---|---|
11/21/2017 | 1.0 | Alexandra Gal-Moga | Created first draft |
Contents
Overview
- A dictionary is an add-on which automatically checks the spelling of words that the user enters in text boxes containing more than one line. Installing a dictionary will add a new language option to the user’s spell-checker.
- In order to move away from legacy packaging and legacy manifests, dictionaries will also be moved to WebExtensions packaging. They will be handled through Add-ons Manager.
Purpose
- The purpose of this implementation is to automatically convert all legacy dictionaries to the new packaging format.
Entry Criteria
- QA has access to PRDs and mocks (from bugs)
Current Status
- The feature is still under implementation
Exit Criteria
- All related bugs triaged
- All blockers fixed
- All resolved bugs verified by QA
- Found-fixed bugs rate going down in time
Scope
This section describes what parts of the feature will be tested and what parts won't be.
what's in scope?
- Dictionary validation
- detect if the XPI is a dictionary and give it the correct type
- show an error if a dictionary uses strict_max_version, since they shouldn't have compatibility restrictions
- In the linter, validate that the add-on only includes the dictionary manifest flags. (dictionaries shouldn't run any code)
- Dictionary submission
- Dictionary auto-approval
- Dictionary installation
what's out of scope?
- Extensions functionality
Ownership
Product Manager: Jorge Villalobos; irc nick :jorgev
QA Manager: Krupa Raj; irc nick :krupa
QA Lead: Victor Carciu; irc nick :victorc
Add-ons QA: Valentina Virlics; irc nick :ValentinaV
Add-ons QA: Alexandra Moga; irc nick :LexaSV
Webextensions QA: Cosmin Badescu; irc nick :CosminB
Webextensions QA: Marius Santa; irc nick :Santa
Requirements for testing
Environments
- Windows
- Mac OS
- Linux
Servers
- Dev: https://addons-dev.allizom.org/en-US/
- Stage: https://addons.allizom.org/en-US/
- Production: https://addons.mozilla.org/en-US/
Channel dependent settings (configs) and environment setups
- Nightly
- Beta
- Release
Test Strategy
Builds
This section should contain links for builds with the feature -
Test Execution Schedule
The following table identifies the anticipated testing period available for test execution.
Project phase | Start Date | End Date |
---|---|---|
Start project | ||
Study PRD/mocks received | ||
QA - Test plan creation | 11.21.2017 | |
QA - Test cases preparation | ||
QA - Test cases execution | ||
Release Date |
Testing Tools
Process | Tool |
---|---|
Test plan creation | Mozilla wiki |
Test case creation | TestRail |
Test case execution | TestRail |
Bugs management | Github |
References
- Tracking bugs:
- Examples: Dictionary List available on AMO
Testcases
Test Areas
- Submission/Approvals/Installation of Webextensions Dictionaries
Test Areas
Test Areas | Covered | Details |
---|---|---|
Installation from AMO | ||
Installation from Add-ons Manager | ||
Installation from Third-party | ||
Dictionary updates | ||
Sideloading | ||
Other |
Bug Work
- Feature bugs
- 6739 (traker)
* bug 1410214 - Implement support for WebExtensions Dictionaries
Sign off
Criteria
Check list
- All test cases should be executed
- All blockers must be fixed and verified or have an agreed-upon timeline for being fixed
Checklist
Exit Criteria | Status | Notes/Details |
---|---|---|
Testing Prerequisites (specs, use cases) | ||
Testing Infrastructure setup | ||
Test Plan Creation | ||
Test Cases Creation | ||
Full Functional Tests Execution | ||
Automation Coverage | ||
Performance Testing | ||
All Defects Logged | ||
Critical/Blockers Fixed and Verified | ||
Metrics/Telemetry | ||
QA Signoff - Nightly Release | ||
QA Beta - Full Testing | ||
QA Signoff - Beta Release |