Add-ons/QA/Testplan/Homepage URL change doorhanger

From MozillaWiki
Jump to: navigation, search

Revision History

Date Version Author Description
03/08/2018 1.0 Santa Marius Created first draft

Overview

  • When the homepage url is changed, the user is notified in a doorhanger with two buttons: "Keep Changes" and "Restore Settings".

Purpose

  • This document's purpose is to detail the test approach to the Homepage URL change doorhanger, including Entry/Exit criteria, Scope for testing, links to testcases etc

Entry Criteria

  • QA has access to PRDs and mocks (from bugs)
  • The feature has landed in -dev

Current Status

  • The feature is in -dev

Exit Criteria

  • All related bugs triaged
  • All blockers fixed
  • All resolved bugs verified by QA
  • Found-fixed bugs rate going down in time

Scope

This section describes what parts of the feature will be tested and what parts won't be.

what's in scope?

  • Display of Homepage URL change doorhanger
  • Doorhanger buttons functionality

what's out of scope?

  • Extensions functionality

Ownership

Product Manager: Jorge Villalobos; irc nick :jorgev
QA Manager: Krupa Raj; irc nick :krupa
QA Lead: Victor Carciu; irc nick :victorc
Webextensions QA: Victor Carciu; irc nick :victorc

Requirements for testing

Environments

  • Windows
  • Mac OS
  • Linux

Servers

Channel dependent settings (configs) and environment setups

  • Nightly
  • Beta
  • Release

Test Strategy

Builds

This section should contain links for builds with the feature -

Test Execution Schedule

The following table identifies the anticipated testing period available for test execution.

Project phase Start Date End Date
Start project 09.07.2017
Study PRD/mocks received
QA - Test plan creation 08.03.2018
QA - Test cases preparation
QA - Test cases execution
Release Date

Testing Tools

Process Tool
Test plan creation Mozilla wiki
Test case creation [TestRail] / [docs]
Test case execution [TestRail]
Bugs management Bugzilla

References

* Mockup gif  
* Tracker: 1397809
* Related Bug: 1390158 

Testcases

Test Areas

  • Homepage
  • Options

Test Areas

Test Areas Covered Details
Change Homepage URL from Options
Change Homepage URL from webextensions
Other

Bug Work

  • Feature bugs
* bug 1397809 - Notify user on home page when an extension has updated it
Full Query
ID Priority Component Assigned to Summary Status Target milestone
1431320 P1 Site Identity Mark Striemer [:mstriemer] Extra top padding on some add-ons notification doorhangers RESOLVED Firefox 59
1431374 P1 Site Identity Johann Hofmann [:johannh] Remove extra white space in permission prompt labels introduced in bug 1369482 RESOLVED Firefox 59
1440301 -- Frontend Multiple addresses can be displayed in the “Home page” address box RESOLVED ---

3 Total; 0 Open (0%); 3 Resolved (100%); 0 Verified (0%);


Sign off

Criteria

Check list

  • All test cases should be executed
  • All blockers must be fixed and verified or have an agreed-upon timeline for being fixed

Checklist

Exit Criteria Status Notes/Details
Testing Prerequisites (specs, use cases)
Testing Infrastructure setup
Test Plan Creation
Test Cases Creation
Full Functional Tests Execution
Automation Coverage
Performance Testing
All Defects Logged
Critical/Blockers Fixed and Verified
Metrics/Telemetry
QA Signoff - Nightly Release
QA Beta - Full Testing
QA Signoff - Beta Release