QA/Zoom Indicator: Difference between revisions

From MozillaWiki
< QA
Jump to navigation Jump to search
No edit summary
Line 8: Line 8:
| 08/19/2016 || 1.0 || Michelle Funches || Created first draft
| 08/19/2016 || 1.0 || Michelle Funches || Created first draft
|-
|-
| || || ||  
| 08/26/2016 || 1.1 || Michelle Funches || Updates
|}
|}


Line 25: Line 25:
== Scope ==
== Scope ==
This wiki details the testing that will be performed by the project team for the Zoom Indicator feature. It defines the overall testing requirements and provides an integrated view of the project test activities. Its purpose is to document:
This wiki details the testing that will be performed by the project team for the Zoom Indicator feature. It defines the overall testing requirements and provides an integrated view of the project test activities. Its purpose is to document:
* What will be tested: Zoom indicator is appropritely displayed or hidden in the location bar
* What will be tested: Zoom indicator is appropriately displayed or hidden in the location bar
* How testing will be performed: testing will ensure regardless of the route taken (keyboard or menu) to apply zoom features, the zoom is accurately displayed. The zoom %  when not at the default of 100% is accurately displayed (100% is hidden). Testing will also ensure there is no distortion to the webpage being displayed.
* How testing will be performed: testing will ensure regardless of the route taken (keyboard or menu) to apply zoom features, the zoom is accurately displayed. The zoom %  when not at the default of 100% is accurately displayed (100% is hidden). Testing will also ensure there is no distortion to the webpage being displayed.


Line 43: Line 43:


=== Out of Scope ===
=== Out of Scope ===
---
Mobile - Not Applicable - testing will not cover Android and iOS devices.


= Requirements for testing =
= Requirements for testing =
Line 53: Line 53:
• Mac OS X 10.11<br />
• Mac OS X 10.11<br />


Mobile - Not Applicable - testing will not cover Android and iOS devices.
 




Line 59: Line 59:
== Test Objectives ==
== Test Objectives ==
The objective the test is ensure the zoom level is displayed in the Location Bar when the zoom level is a value other than 100%, regardless of the method applied to change the zoom level.
The objective the test is ensure the zoom level is displayed in the Location Bar when the zoom level is a value other than 100%, regardless of the method applied to change the zoom level.
[http://www.ghacks.net/2016/08/17/firefox-51-custom-zoom-level-in-address-bar/ History ]


{| class="wikitable"
{| class="wikitable"
Line 69: Line 71:
|-
|-
| Firefox Menu Bar: apply Menu>View to adjust the zoom level  || Manual || QA Eng Team
| Firefox Menu Bar: apply Menu>View to adjust the zoom level  || Manual || QA Eng Team
|-
| Zoom Indicator & Private Window: Zoom Indicator displays in private window  || Manual || QA Eng Team
|-
| Zoom Indicator and RTL  || Manual || QA Eng Team
|}
|}


== Builds ==
== Builds ==
The Nightly Channel will be applied to test the feature.
The Nightly Channel will be applied to test the feature.
== Test Execution Schedule ==
The following table identifies the anticipated testing period available for test execution.
{| class="wikitable" style="width:60%"
|-
! Project phase !! Start Date !! End Date
|-
| Start project
|style="text-align:center;" | 08-17-2016  ||
|-
| Study documentation/specs received from developers
|style="text-align:center;" | 08-17-2016
|style="text-align:center;" | 08-17-2016
|-
| QA - Test plan creation
|style="text-align:center;" | 08-17-2016
|style="text-align:center;" | 08-19-2016
|-
| QA - Test cases/Env preparation
|style="text-align:center;" | 08-17-2016
|style="text-align:center;" | 08-19-2016 
|-
| QA - Nightly Testing
|style="text-align:center;" | 08-19-2016
|style="text-align:center;" | 08-23-2016 
|-
|}




== UI Test Plans ==
== Test Areas ==
{| class="wikitable" style="width:80%"
|-
! Test Areas !! Covered !! Details
|-
| Private Window
|style="text-align:center;" | Yes ||
|-
| Multi-Process Enabled
|style="text-align:center;" | Yes ||
|-
| Multi-process Disabled
|style="text-align:center;" | No ||
|-
| Theme (high contrast)
|style="text-align:center;" | Yes ||
|-
| '''UI'''
||  ||
|-
| Mouse-only operation 
|style="text-align:center;" | Yes ||
|-
| Keyboard-only operation 
|style="text-align:center;" | Yes ||
|-
| Display (HiDPI)
|style="text-align:center;" | Yes ||
|-
| Interaction (scroll, zoom)
|style="text-align:center;" | Yes ||
|-
| Usable with a screen reader 
|style="text-align:center;" | No ||
|-
| Usability and/or discover-ability testing 
|style="text-align:center;" | Yes || Is this feature user friendly
|-
| ''' Web Compatibility '''
||  || depends on the feature
|-
| Testing against target sites 
|style="text-align:center;" | Yes ||
|-
| Survey of many sites for compatibility 
|style="text-align:center;" | Yes ||


|}
==Test Plan/Test Cases/Results==
{| class="wikitable"
{| class="wikitable"
|-
|-
! Project !! Channel !! Test Plan !! Test Results !! Meta Bug !! Date
! Project !! Channel !! Test Plan !! Test Results !! Meta Bug !! Date
Line 88: Line 172:
|}
|}


= Bug Work =
Tracking bug – [https://bugzilla.mozilla.org/show_bug.cgi?id=565718 Bug 565718]
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto">
====== Logged bugs ======
<div class="mw-collapsible-content">
Bug [https://bugzilla.mozilla.org/show_bug.cgi?id=1296765 1296765 ] - Show zoom indicator in UI if not at default zoom level<br/>
</div>
</div>
= Sign off  =
== Criteria ==
* All test cases should be executed
* All blockers & critical must be fixed and verified or have an agreed-upon timeline for being fixed (as determined by engineering/RelMan/QA)
== Results ==
'''Nightly testing 51.0a1'''
* [Complete Push 1.0] Full Test  Suite results [https://testrail.stage.mozaws.net/index.php?/suites/view/135&group_by=cases:section_id&group_order=asc&group_id=298 Test rail]<br />
** Manual testing covered Windows 7 x64,  Windows 8.1 x64  Windows 10 x64,  Ubuntu 16.04 x32, Mac OS x 10.11
<br />
== Checklist ==
{| class="wikitable" style="width:60%"
|-
! Exit Criteria !! Status !! Notes/Details
|-
|  Testing Prerequisites (specs, use cases)
| style="text-align:center;" | {{mdone|}} 
| style="text-align:center;" |
|-
|  Testing Infrastructure setup
|style="text-align:center;" |  {{mdone|}} ||
|-
|  Test Plan Creation
| style="text-align:center;" |  {{mdone|}} ||
|-
|  Test Cases Creation
|style="text-align:center;" |  {{mdone|}} ||
|-
|  Full Functional Tests Execution
|style="text-align:center;" |  {{mdone|}}
|style="text-align:center;" | 
|-
|  Performance Testing
|style="text-align:center;" | {{mdone|}} ||
|-
|  All Defects Logged
|style="text-align:center;"| {{mdone|}} ||
|-
|  Critical/Blockers Fixed and Verified
|style="text-align:center;"| N/A ||
|-
|-
|  QA Signoff  - Nightly Release
|style="text-align:center;" | {{mdone|}}
|style="text-align:center;" | Email sent 08-23-2016
|-
|}


* '''Note:'''
* '''Note:'''
Zoom Indicator and RTL Exploratory testing on Nightly conducted on 08-25-2016
Results: Pass

Revision as of 15:56, 26 August 2016

Revision History


Date Version Author Description
08/19/2016 1.0 Michelle Funches Created first draft
08/26/2016 1.1 Michelle Funches Updates

Overview

Purpose

Detail the purpose of this document.

  • The test scope, focus areas and objectives for Zoom Indicator
  • The test responsibilities
  • The test strategy for the levels and types of test for this release
  • The entry and exit criteria
  • The basis of the test estimates
  • Any risks, issues, assumptions and test dependencies
  • The test schedule and major milestones
  • The test deliverable

Scope

This wiki details the testing that will be performed by the project team for the Zoom Indicator feature. It defines the overall testing requirements and provides an integrated view of the project test activities. Its purpose is to document:

  • What will be tested: Zoom indicator is appropriately displayed or hidden in the location bar
  • How testing will be performed: testing will ensure regardless of the route taken (keyboard or menu) to apply zoom features, the zoom is accurately displayed. The zoom % when not at the default of 100% is accurately displayed (100% is hidden). Testing will also ensure there is no distortion to the webpage being displayed.

Ownership

What resources are needed, and when (developers, QA, PMs working on the feature)

Development: Jared Wein
Development: Katie Broida
QA Softvision - Las Vegas: Michelle Funches


Testing summary

Scope of Testing

In Scope

Functionality: To ensure Menu options as well as keyboard options can be used to change zoom level.
Zooming to a value other than 100% will display the Zoom Indicator in the Location Bar. Usability: Zooming must produce a smooth animation and grab the end-users attention.

Out of Scope

Mobile - Not Applicable - testing will not cover Android and iOS devices.

Requirements for testing

Environments

• Windows 7 x32
• Windows 8.1 x64
• Windows 10 x63
• Ubuntu 16.04 x32
• Mac OS X 10.11



Test Strategy

Test Objectives

The objective the test is ensure the zoom level is displayed in the Location Bar when the zoom level is a value other than 100%, regardless of the method applied to change the zoom level.

History

Test Objective Test Type Owners
Keyboard Controls: apply Control + or - keys to adjust zoom level Manual QA Eng Team
Firefox Menu [≡]: apply the [+] [%] [-] buttons to adjust the zoom level Manual QA Eng Team
Firefox Menu Bar: apply Menu>View to adjust the zoom level Manual QA Eng Team
Zoom Indicator & Private Window: Zoom Indicator displays in private window Manual QA Eng Team
Zoom Indicator and RTL Manual QA Eng Team

Builds

The Nightly Channel will be applied to test the feature.

Test Execution Schedule

The following table identifies the anticipated testing period available for test execution.

Project phase Start Date End Date
Start project 08-17-2016
Study documentation/specs received from developers 08-17-2016 08-17-2016
QA - Test plan creation 08-17-2016 08-19-2016
QA - Test cases/Env preparation 08-17-2016 08-19-2016
QA - Nightly Testing 08-19-2016 08-23-2016


Test Areas

Test Areas Covered Details
Private Window Yes
Multi-Process Enabled Yes
Multi-process Disabled No
Theme (high contrast) Yes
UI
Mouse-only operation Yes
Keyboard-only operation Yes
Display (HiDPI) Yes
Interaction (scroll, zoom) Yes
Usable with a screen reader No
Usability and/or discover-ability testing Yes Is this feature user friendly
Web Compatibility depends on the feature
Testing against target sites Yes
Survey of many sites for compatibility Yes


Test Plan/Test Cases/Results

Project Channel Test Plan Test Results Meta Bug Date
Zoom Indicator Nightly Test Plan Link Test Cases/Results Test rail 565718 08-18-2016
--- --- --- --- --- ---
--- --- --- --- --- ---


Bug Work

Tracking bug – Bug 565718


Logged bugs

Bug 1296765 - Show zoom indicator in UI if not at default zoom level

Sign off

Criteria

  • All test cases should be executed
  • All blockers & critical must be fixed and verified or have an agreed-upon timeline for being fixed (as determined by engineering/RelMan/QA)

Results

Nightly testing 51.0a1

  • [Complete Push 1.0] Full Test Suite results Test rail
    • Manual testing covered Windows 7 x64, Windows 8.1 x64 Windows 10 x64, Ubuntu 16.04 x32, Mac OS x 10.11


Checklist

Exit Criteria Status Notes/Details
Testing Prerequisites (specs, use cases) [DONE]
Testing Infrastructure setup [DONE]
Test Plan Creation [DONE]
Test Cases Creation [DONE]
Full Functional Tests Execution [DONE]
Performance Testing [DONE]
All Defects Logged [DONE]
Critical/Blockers Fixed and Verified N/A
QA Signoff - Nightly Release [DONE] Email sent 08-23-2016
  • Note:

Zoom Indicator and RTL Exploratory testing on Nightly conducted on 08-25-2016 Results: Pass

Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Zoom_Indicator&oldid=1145507"