Add-ons/QA/Testplan/Homepage URL change doorhanger
< Add-ons
Jump to navigation
Jump to search
Revision History
| Date | Version | Author | Description |
|---|---|---|---|
| 03/08/2018 | 1.0 | Santa Marius | Created first draft |
Overview
- When the homepage url is changed, the user is notified in a doorhanger with two buttons: "Keep Changes" and "Restore Settings".
Purpose
- This document's purpose is to detail the test approach to the Homepage URL change doorhanger, including Entry/Exit criteria, Scope for testing, links to testcases etc
Entry Criteria
- QA has access to PRDs and mocks (from bugs)
- The feature has landed in -dev
Current Status
- The feature is in -dev
Exit Criteria
- All related bugs triaged
- All blockers fixed
- All resolved bugs verified by QA
- Found-fixed bugs rate going down in time
Scope
This section describes what parts of the feature will be tested and what parts won't be.
what's in scope?
- Display of Homepage URL change doorhanger
- Doorhanger buttons functionality
what's out of scope?
- Extensions functionality
Ownership
Product Manager: Jorge Villalobos; irc nick :jorgev
QA Manager: Krupa Raj; irc nick :krupa
QA Lead: Victor Carciu; irc nick :victorc
Webextensions QA: Victor Carciu; irc nick :victorc
Requirements for testing
Environments
- Windows
- Mac OS
- Linux
Servers
- Stage: https://addons.allizom.org/en-US/
- Dev: https://addons-dev.allizom.org/en-US/
- Production: https://addons.mozilla.org/en-US/
Channel dependent settings (configs) and environment setups
- Nightly
- Beta
- Release
Test Strategy
Builds
This section should contain links for builds with the feature -
- Nightly builds
- Beta builds
- Beta Unbranded builds:
- Release builds
- Release Unbranded builds:
Test Execution Schedule
The following table identifies the anticipated testing period available for test execution.
| Project phase | Start Date | End Date |
|---|---|---|
| Start project | 09.07.2017 | |
| Study PRD/mocks received | ||
| QA - Test plan creation | 08.03.2018 | |
| QA - Test cases preparation | ||
| QA - Test cases execution | ||
| Release Date |
Testing Tools
| Process | Tool |
|---|---|
| Test plan creation | Mozilla wiki |
| Test case creation | [TestRail] / [docs] |
| Test case execution | [TestRail] |
| Bugs management | Bugzilla |
References
* Mockup gif * Tracker: 1397809 * Related Bug: 1390158
Testcases
Test Areas
- Homepage
- Options
Test Areas
| Test Areas | Covered | Details |
|---|---|---|
| Change Homepage URL from Options | ||
| Change Homepage URL from webextensions | ||
| Other |
Bug Work
- Feature bugs
* bug 1397809 - Notify user on home page when an extension has updated it
| ID | Priority | Component | Assigned to | Summary | Status | Target milestone |
|---|---|---|---|---|---|---|
| 1431320 | P1 | Site Identity | Mark Striemer [:mstriemer] | Extra top padding on some add-ons notification doorhangers | RESOLVED | Firefox 59 |
| 1431374 | P1 | Site Identity | Johann Hofmann [:johannh] | Remove extra white space in permission prompt labels introduced in bug 1369482 | RESOLVED | Firefox 59 |
| 1440301 | -- | Frontend | Multiple addresses can be displayed in the “Home page” address box | RESOLVED | --- |
3 Total; 0 Open (0%); 3 Resolved (100%); 0 Verified (0%);
Sign off
Criteria
Check list
- All test cases should be executed
- All blockers must be fixed and verified or have an agreed-upon timeline for being fixed
Checklist
| Exit Criteria | Status | Notes/Details |
|---|---|---|
| Testing Prerequisites (specs, use cases) | ||
| Testing Infrastructure setup | ||
| Test Plan Creation | ||
| Test Cases Creation | ||
| Full Functional Tests Execution | ||
| Automation Coverage | ||
| Performance Testing | ||
| All Defects Logged | ||
| Critical/Blockers Fixed and Verified | ||
| Metrics/Telemetry | ||
| QA Signoff - Nightly Release | ||
| QA Beta - Full Testing | ||
| QA Signoff - Beta Release |