QA/Zoom Indicator

From MozillaWiki
< QA
Jump to: navigation, search

Revision History


Date Version Author Description
08/19/2016 1.0 Michelle Funches Created first draft
08/26/2016 1.1 Michelle Funches Updates

Overview

Purpose

Detail the purpose of this document.

  • The test scope, focus areas and objectives for Zoom Indicator
  • The test responsibilities
  • The test strategy for the levels and types of test for this release
  • The entry and exit criteria
  • The basis of the test estimates
  • Any risks, issues, assumptions and test dependencies
  • The test schedule and major milestones
  • The test deliverable

Scope

This wiki details the testing that will be performed by the project team for the Zoom Indicator feature. It defines the overall testing requirements and provides an integrated view of the project test activities. Its purpose is to document:

  • What will be tested: Zoom indicator is appropriately displayed or hidden in the location bar
  • How testing will be performed: testing will ensure regardless of the route taken (keyboard, mouse or menues) to apply zoom features, the zoom is accurately displayed. The zoom % when not at the default of 100% is accurately displayed (100% is hidden). Testing will also ensure there is no distortion to the webpage being displayed.

Ownership

What resources are needed, and when (developers, QA, PMs working on the feature)

Development: Jared Wein
Development: Katie Broida
QA Softvision - Las Vegas: Michelle Funches
QA Desktop Team - Iulia Cristescu (irc: IuliaC); Cornel Ionce (irc: cornel_ionce)

Testing summary

Scope of Testing

In Scope

Functionality: To ensure Menu options as well as keyboard options can be used to change zoom level.
Zooming to a value other than 100% will display the Zoom Indicator in the Location Bar. Usability: Zooming must produce a smooth animation and grab the end-users attention.

Out of Scope

Mobile - Not Applicable - testing will not cover Android and iOS devices.

Requirements for testing

Environments

• Windows 7
• Windows 8.1
• Windows 10
• Ubuntu 16.04
• Mac OS X 10.11

Test Strategy

Test Objectives

The objective the test is ensure the zoom level is displayed in the Location Bar when the zoom level is a value other than 100%, regardless of the method applied to change the zoom level.

History

Test Objective Test Type Owners
Keyboard Controls: apply [Control] & [+] or [-] keys to adjust the zoom level Manual QA Eng Team & Desktop Team
Keyboard & Mouse Controls: apply [Control] & upward or downward mouse wheel spin to adjust the zoom level Manual QA Eng Team & Desktop Team
Firefox Menu [≡]: apply the [+] [%] [-] buttons to adjust the zoom level Manual QA Eng Team & Desktop Team
Firefox Menu Bar: apply Menu>View to adjust the zoom level Manual QA Eng Team & Desktop Team
Zoom Indicator & Private Window: Zoom Indicator is properly displayed in private window Manual QA Eng Team & Desktop Team
Zoom Indicator and RTL Manual QA Eng Team & Desktop Team

Builds

The Nightly Channel will be applied to test the feature.

Test Execution Schedule

The following table identifies the anticipated testing period available for test execution.

Project phase Start Date End Date
Start project 08-17-2016
Study documentation/specs received from developers 08-17-2016 08-17-2016
QA - Test plan creation 08-17-2016 08-19-2016
QA - Test cases/Env preparation 08-17-2016 08-19-2016
QA - Nightly Testing 08-19-2016 08-23-2016
QA - Aurora Testing 09-28-2016 10-17-2016

Test Areas

Test Areas Covered Details
Private Window Yes
Multi-Process Enabled Yes
Multi-process Disabled No
Theme (high contrast) Yes
UI
Mouse-only operation Yes
Keyboard-only operation Yes
Display (HiDPI) Yes
Interaction (scroll, zoom) Yes
Usable with a screen reader No
Usability and/or discover-ability testing Yes Is this feature user friendly
Web Compatibility depends on the feature
Testing against target sites Yes
Survey of many sites for compatibility Yes


Test Plan/Test Cases/Results

Project Channel Test Plan Test Results Meta Bug Date
Zoom Indicator Nightly Test Plan Link Test Cases/Results Test rail 565718 08-18-2016
Zoom Indicator Aurora Test Plan Link Test Results 565718 10-17-2016
--- --- --- --- --- ---

Bug Work

Tracking bug – Bug 565718


Logged bugs

Bug 1296765 - Show zoom indicator in UI if not at default zoom level

Sign off

Criteria

  • All test cases should be executed
  • All blockers & critical must be fixed and verified or have an agreed-upon timeline for being fixed (as determined by engineering/RelMan/QA)

Results

Nightly testing 51.0a1

  • [Complete Push 1.0] Full Test Suite results Test rail
    • Manual testing covered Windows 7 x64, Windows 8.1 x64 Windows 10 x64, Ubuntu 16.04 x32, Mac OS x 10.11


Aurora testing 51.0a2

  • Testrail Testplan
    • Manual testing covered Windows 7 x86, Windows 10 x64, Ubuntu 16.04 x64 and Mac OS X 10.11.6


Pre-Beta testing 51.0a2

  • Testrail Testplan
    • Manual testing covered Mac OS X 10.11.6, Ubuntu 16.04 x64, Windows 7 x86 and Windows 10 x64


Pre-Release testing 51.0b

  • Testrail Testplan
    • Manual testing covered Mac OS X 10.11.6, Ubuntu 16.04 x64, Windows 7 x64 and Windows 10 x64

Checklist

Exit Criteria Status Notes/Details
Testing Prerequisites (specs, use cases) [DONE]
Testing Infrastructure setup [DONE]
Test Plan Creation [DONE]
Test Cases Creation [DONE]
Full Functional Tests Execution [DONE]
Performance Testing [DONE]
All Defects Logged [DONE]
Critical/Blockers Fixed and Verified N/A
QA Signoff - Nightly Release [DONE] Email sent 08-23-2016
QA Signoff - Mid-Aurora Sign off (Fx51) [DONE] Email sent 10-17-2016 (AT RISK)
QA Signoff - Pre-Beta Sign off (Fx51) [DONE] Email sent 11-14-2016 (YELLOW)
QA Signoff - Pre-Release Sign off (Fx51) [DONE] Email sent 01-13-2017 (YELLOW)
  • Note:

Zoom Indicator and RTL Exploratory testing on Nightly conducted on 08-25-2016 Results: Pass