Add-ons/QA/Testplan/Webextensions Language Packs
From MozillaWiki
< Add-ons
Revision History
Date | Version | Author | Description |
---|---|---|---|
09/14/2017 | 1.0 | Valentina Virlics | Created first draft |
10/02/2017 | 1.1 | Marius Santa | Updateds: Overview, Purpose, Scope, Bug Work, Builds, Checklist, Channel |
Contents
Overview
- A language pack is an add-on that changes the language of the user interface in a Mozilla application (Firefox, Thunderbird, SeaMonkey, etc.).
- Switching to the new language pack formats will allow us to remove language packs from requiring the old add-ons ecosystem, they will be safer(no direct access to chrome registry) and will enable L10nRegistry (bug 1333980) which is required for transitioning to the new l10n API (bug 1365426).
Purpose
- This document's purpose is to detail the test approach to the Language Packs Webextensions packaging, including Entry/Exit criteria, Scope for testing, links to testcases etc
Entry Criteria
- QA has access to PRDs and mocks (from bugs)
- The feature has landed in -dev
Current Status
- The feature is in -dev
Exit Criteria
- All related bugs triaged
- All blockers fixed
- All resolved bugs verified by QA
- Found-fixed bugs rate going down in time
Scope
This section describes what parts of the feature will be tested and what parts won't be.
what's in scope?
- Lang Packs validation - recognize the special kind of extension based on some entry in manifest.json
- Lang Packs submission
- Lang Packs auto-approval
- Lang Packs structure and validation
- Lang Packs installation
what's out of scope?
- Extensions functionality
Ownership
Product Manager: Jorge Villalobos; irc nick :jorgev
QA Manager: Krupa Raj; irc nick :krupa
QA Lead: Victor Carciu; irc nick :victorc
Add-ons QA: Valentina Virlics; irc nick :ValentinaV
Webextensions QA: Cosmin Badescu; irc nick :CosminB
Webextensions QA: Marius Santa; irc nick :Santa
Requirements for testing
Environments
- Windows
- Mac OS
- Linux
Servers
- Stage: https://addons.allizom.org/en-US/
- Dev: https://addons-dev.allizom.org/en-US/
- Production: https://addons.mozilla.org/en-US/
Channel dependent settings (configs) and environment setups
- Nightly
- Beta
- Release
Test Strategy
Builds
This section should contain links for builds with the feature -
- Nightly builds
- Beta builds
- Beta Unbranded builds:
- Release builds
- Release Unbranded builds:
Test Execution Schedule
The following table identifies the anticipated testing period available for test execution.
Project phase | Start Date | End Date |
---|---|---|
Start project | 17.05.2017 | |
Study PRD/mocks received | ||
QA - Test plan creation | 14.09.2017 | |
QA - Test cases preparation | ||
QA - Test cases execution | ||
Release Date |
Testing Tools
Process | Tool |
---|---|
Test plan creation | Mozilla wiki |
Test case creation | TestRail / Google docs |
Test case execution | TestRail |
Bugs management | Github |
References
* Webextenstions Language Packs accepted structure * Tracker: 6297
Testcases
Test Areas
- Submission/Approvals/Installation of Webextensions Lang Packs
Test Areas
Test Areas | Covered | Details |
---|---|---|
Installation from AMO | ||
Installation from Add-ons Manager | ||
Installation from Third-party | ||
Language Packs updates | ||
Sideloading | ||
Other |
Bug Work
- Feature bugs
- 6297 (traker) - 1526 - 6350 - 6360
* bug 1395363 - Switch to webextension-langpacks
ID | Priority | Component | Assigned to | Summary | Status | Target milestone |
---|---|---|---|---|---|---|
1365709 | -- | Add-ons Manager | Zibi Braniecki [:zbraniecki][:gandalf] | Consume new webextension-based langpacks | RESOLVED | mozilla57 |
1395456 | P3 | Internationalization | Zibi Braniecki [:zbraniecki][:gandalf] | Ensure we generate correct min/max versions for the new langpacks | RESOLVED | mozilla57 |
1395457 | P3 | Internationalization | Zibi Braniecki [:zbraniecki][:gandalf] | De-hardcode product name when producing webext-langpack | RESOLVED | mozilla57 |
1395459 | P3 | Internationalization | Zibi Braniecki [:zbraniecki][:gandalf] | When building webext-langpack pick up language version from the VCS if possible | RESOLVED | mozilla58 |
1396467 | P3 | Add-ons Manager | Zibi Braniecki [:zbraniecki][:gandalf] | Add tests for the new langpacks consumption code | RESOLVED | mozilla58 |
1405264 | P2 | General | Andrew Swan [:aswan] | webext-langpacks register chrome entries later than old-style langpacks | VERIFIED | mozilla58 |
1407395 | -- | Internationalization | Zibi Braniecki [:zbraniecki][:gandalf] | Guard against empty defines entry when generating langpack manifest | RESOLVED | mozilla58 |
1408380 | -- | Internationalization | Axel Hecht [:Pike] | localized nightlies broken after switch to webextensions if locale is missing toolkit/defines.inc | RESOLVED | mozilla58 |
1411951 | P1 | Internationalization | Zibi Braniecki [:zbraniecki][:gandalf] | Windows langpacks are generated with invalid paths | VERIFIED | mozilla58 |
1415117 | P5 | Internationalization | SessionRestore does not update tab title if language changes on restart | NEW | --- |
10 Total; 1 Open (10%); 7 Resolved (70%); 2 Verified (20%);
* bug 1365031 - Turn langpacks into webextension-like packages
ID | Priority | Component | Assigned to | Summary | Status | Target milestone |
---|---|---|---|---|---|---|
1333980 | -- | Internationalization | Zibi Braniecki [:zbraniecki][:gandalf] | Land L10nRegistry | RESOLVED | mozilla57 |
1365440 | -- | General | Zibi Braniecki [:zbraniecki][:gandalf] | Generate webextension language packs | VERIFIED | mozilla57 |
1365709 | -- | Add-ons Manager | Zibi Braniecki [:zbraniecki][:gandalf] | Consume new webextension-based langpacks | RESOLVED | mozilla57 |
1377911 | -- | General | Zibi Braniecki [:zbraniecki][:gandalf] | Remove the override chrome entries from language manifests | RESOLVED | mozilla57 |
1385544 | P3 | Internationalization | Zibi Braniecki [:zbraniecki][:gandalf] | Add mozl10n: protocol | RESOLVED | --- |
1389397 | -- | Android Studio and Gradle Integration | Zibi Braniecki [:zbraniecki][:gandalf] | Remove the override chrome entries from language manifests (Fennec) | RESOLVED | mozilla57 |
1393848 | -- | General | Zibi Braniecki [:zbraniecki][:gandalf] | Move search-plugin resource entry to browser's content jar.mn | RESOLVED | mozilla57 |
1411951 | P1 | Internationalization | Zibi Braniecki [:zbraniecki][:gandalf] | Windows langpacks are generated with invalid paths | VERIFIED | mozilla58 |
1413322 | P3 | Add-ons Manager | Andrew Swan [:aswan] | Stop loading old-style langpacks | VERIFIED | mozilla58 |
1425689 | -- | Android Studio and Gradle Integration | Zibi Braniecki [:zbraniecki][:gandalf] | Move search-plugin resource entry to fennec's chrome jar.mn | RESOLVED | mozilla59 |
10 Total; 0 Open (0%); 7 Resolved (70%); 3 Verified (30%);
Sign off
Criteria
Check list
- All test cases should be executed
- All blockers must be fixed and verified or have an agreed-upon timeline for being fixed
Checklist
Exit Criteria | Status | Notes/Details |
---|---|---|
Testing Prerequisites (specs, use cases) | ||
Testing Infrastructure setup | ||
Test Plan Creation | ||
Test Cases Creation | ||
Full Functional Tests Execution | ||
Automation Coverage | ||
Performance Testing | ||
All Defects Logged | ||
Critical/Blockers Fixed and Verified | ||
Metrics/Telemetry | ||
QA Signoff - Nightly Release | ||
QA Beta - Full Testing | ||
QA Signoff - Beta Release |