Add-ons/QA/Testplan/Homepage URL change doorhanger
From MozillaWiki
< Add-ons
Revision History
Date | Version | Author | Description |
---|---|---|---|
03/08/2018 | 1.0 | Santa Marius | Created first draft |
Contents
Overview
- When the homepage url is changed, the user is notified in a doorhanger with two buttons: "Keep Changes" and "Restore Settings".
Purpose
- This document's purpose is to detail the test approach to the Homepage URL change doorhanger, including Entry/Exit criteria, Scope for testing, links to testcases etc
Entry Criteria
- QA has access to PRDs and mocks (from bugs)
- The feature has landed in -dev
Current Status
- The feature is in -dev
Exit Criteria
- All related bugs triaged
- All blockers fixed
- All resolved bugs verified by QA
- Found-fixed bugs rate going down in time
Scope
This section describes what parts of the feature will be tested and what parts won't be.
what's in scope?
- Display of Homepage URL change doorhanger
- Doorhanger buttons functionality
what's out of scope?
- Extensions functionality
Ownership
Product Manager: Jorge Villalobos; irc nick :jorgev
QA Manager: Krupa Raj; irc nick :krupa
QA Lead: Victor Carciu; irc nick :victorc
Webextensions QA: Victor Carciu; irc nick :victorc
Requirements for testing
Environments
- Windows
- Mac OS
- Linux
Servers
- Stage: https://addons.allizom.org/en-US/
- Dev: https://addons-dev.allizom.org/en-US/
- Production: https://addons.mozilla.org/en-US/
Channel dependent settings (configs) and environment setups
- Nightly
- Beta
- Release
Test Strategy
Builds
This section should contain links for builds with the feature -
- Nightly builds
- Beta builds
- Beta Unbranded builds:
- Release builds
- Release Unbranded builds:
Test Execution Schedule
The following table identifies the anticipated testing period available for test execution.
Project phase | Start Date | End Date |
---|---|---|
Start project | 09.07.2017 | |
Study PRD/mocks received | ||
QA - Test plan creation | 08.03.2018 | |
QA - Test cases preparation | ||
QA - Test cases execution | ||
Release Date |
Testing Tools
Process | Tool |
---|---|
Test plan creation | Mozilla wiki |
Test case creation | [TestRail] / [docs] |
Test case execution | [TestRail] |
Bugs management | Bugzilla |
References
* Mockup gif * Tracker: 1397809 * Related Bug: 1390158
Testcases
Test Areas
- Homepage
- Options
Test Areas
Test Areas | Covered | Details |
---|---|---|
Change Homepage URL from Options | ||
Change Homepage URL from webextensions | ||
Other |
Bug Work
- Feature bugs
* bug 1397809 - Notify user on home page when an extension has updated it
ID | Priority | Component | Assigned to | Summary | Status | Target milestone |
---|---|---|---|---|---|---|
1431320 | P1 | Site Identity | Mark Striemer [:mstriemer] | Extra top padding on some add-ons notification doorhangers | RESOLVED | Firefox 59 |
1431374 | P1 | Site Identity | Johann Hofmann [:johannh] | Remove extra white space in permission prompt labels introduced in bug 1369482 | RESOLVED | Firefox 59 |
1440301 | -- | Frontend | Multiple addresses can be displayed in the “Home page” address box | RESOLVED | --- |
3 Total; 0 Open (0%); 3 Resolved (100%); 0 Verified (0%);
Sign off
Criteria
Check list
- All test cases should be executed
- All blockers must be fixed and verified or have an agreed-upon timeline for being fixed
Checklist
Exit Criteria | Status | Notes/Details |
---|---|---|
Testing Prerequisites (specs, use cases) | ||
Testing Infrastructure setup | ||
Test Plan Creation | ||
Test Cases Creation | ||
Full Functional Tests Execution | ||
Automation Coverage | ||
Performance Testing | ||
All Defects Logged | ||
Critical/Blockers Fixed and Verified | ||
Metrics/Telemetry | ||
QA Signoff - Nightly Release | ||
QA Beta - Full Testing | ||
QA Signoff - Beta Release |