|
|
| Line 1: |
Line 1: |
| '''Revision History'''
| |
|
| |
|
| This section describes the modifications that have been made to this wiki page. A new row has been completed each time the content of this document is updated (small corrections for typographical errors do not need to be recorded). The description of the modification contains the differences from the prior version, in terms of what sections were updated and to what extent.
| |
|
| |
| {| class="wikitable" style="width:60%"
| |
| |-
| |
| ! Date !! Version !! Author !! Description
| |
| |-
| |
| | 08/11/2017|| 1.0 || Adrian Florinescu || Initial Draft
| |
| |}
| |
|
| |
| == Purpose ==
| |
|
| |
| == Overview ==
| |
| Photon is the codename for the Firefox UI refresh on the Firefox front end to be the user facing component of Quantum. Photon Performance is front-end specific performance improvements that complement Quantum work. Summing up, Photon Performance consists of performance improvements and user perceived performance improvements.
| |
|
| |
| == Ownership ==
| |
|
| |
| Engineering lead
| |
| [mailto:jdolske@mozilla.com Justin Dolske]
| |
|
| |
| Engineering Team
| |
| [mailto:fqueze@mozilla.com Florian Quèze]
| |
| [mailto:mconley@mozilla.com Mike Conley]
| |
|
| |
| QA
| |
| [mailto:aflorinescu@softvision.com Adrian Florinescu]
| |
|
| |
| = References =
| |
| * [https://bugzilla.mozilla.org/show_bug.cgi?id=1348289 Bugzilla]
| |
| * [https://docs.google.com/spreadsheets/d/171zU6dTHonlem-bTjyT-oDFXM6dBBHn2_pG2YdNpUGU/edit#gid=747605611 Tracking Document]
| |
| * [https://docs.google.com/spreadsheets/d/1ERWXWhTDgPi15py-rCLuYGO5kgp6MtrocxvSATjMIEE/edit#gid=1426404086 bug verification]
| |
|
| |
|
| |
|
| |
| = Testing summary =
| |
|
| |
| == Scope of Testing ==
| |
|
| |
| === In Scope ===
| |
| * what's expected from the manual QA point of view is to ensure the Photon Performance changes do not introduce regressions and the areas impacted are covered by exploratory/smoke/regression testing;
| |
| * the depth of varies based on the FF area that shall be checked;
| |
| * validating user perceived improvements;
| |
|
| |
| === Out of Scope ===
| |
| * validating the actual performance improvements - excepting the visual ones (user perceived improvements)
| |
|
| |
| == Environments ==
| |
| Windows 7, 8.1, 10
| |
| Ubuntu 16.04
| |
| Mac 10.12, 10.10
| |
|
| |
|
| |
| = Test Strategy =
| |
| == Risk Assessment and Coverage ==
| |
|
| |
| {| class="wikitable"
| |
| |-
| |
| ! ID !! Description / Threat Description !! Covered by Test Objective !! Magnitude !! Probability !! Priority !! Impact Score
| |
| |-
| |
| | RAC-1 || || TO-1 || 2-Moderate || 1-Unlikely || 1-Low || 4
| |
| |}
| |
|
| |
| '''Values:'''
| |
|
| |
| * '''Magnitude:''' 1- Low , ''2-Moderate'', '''3-High'''
| |
|
| |
| * '''Probability:''' 1-Unlikely, ''2-Possible'', '''3-Almost Certain'''
| |
|
| |
| * '''Priority:''' 1 - Low, ''2-Medium'', '''3-High'''
| |
|
| |
| '''Impact Score Breakdown:'''
| |
| * An impact value of 1, 2, 3, 4 would describe an area which although should be covered there aren't expected any discoveries of critical issues.
| |
| * An impact value of 6, 8, 9, 12 would describe an area in which we expect to find issues but those issues are not expected to be critical.
| |
| * An impact value of 18 or 27 would describe an area on which it is likely to find issues and those issues to be critical or blockers.
| |
|
| |
| == Test Objectives ==
| |
| This section details the progression test objectives that will be covered. Please note that this is at a high level. For large projects, a suite of test cases would be created which would reference directly back to this master.
| |
| This could be documented in bullet form or in a table similar to the one below.
| |
|
| |
| {| class="wikitable"
| |
| |-
| |
| ! Ref !! Function !! Test Objective !! Evaluation Criteria !! Test Type !! RAC !! Owners
| |
| |-
| |
| | 1 || || || || Manual || RAC-1 || Eng Team
| |
| |}
| |
|
| |
|
| |
| == Test Execution Schedule ==
| |
| The following table identifies the anticipated testing period available for test execution.
| |
| {| class="wikitable" style="width:60%"
| |
| |-
| |
| ! Project phase !! Start Date !! End Date
| |
| |-
| |
| | Start project
| |
| |style="text-align:center;" | ||
| |
| |-
| |
| | Study documentation/specs received from developers
| |
| |style="text-align:center;" | ||
| |
| |-
| |
| | QA - Test plan creation
| |
| |style="text-align:center;" | ||
| |
| |-
| |
| | QA - Test cases/Env preparation
| |
| |style="text-align:center;" | ||
| |
| |-
| |
| | QA - Nightly Testing
| |
| |style="text-align:center;" | ||
| |
| |-
| |
| | QA - Beta Testing
| |
| |style="text-align:center;" | ||
| |
| |-
| |
| | Release Date
| |
| |style="text-align:center;" | ||
| |
| |}
| |
|
| |
| == Testing Tools ==
| |
| Detail the tools to be used for testing, for example see the following table:
| |
| {| class="wikitable" style="width:50%"
| |
| |-
| |
| ! Process !! Tool
| |
| |-
| |
| | Test plan creation || Mozilla wiki
| |
| |-
| |
| | Test case creation || [https://testrail.stage.mozaws.net/index.php TestRail]
| |
| |-
| |
| | Test case execution || [https://testrail.stage.mozaws.net/index.php TestRail]
| |
| |-
| |
| | Bugs management || [ Bugzilla]
| |
| |}
| |
|
| |
| = Sign off Criteria=
| |
| TBD
| |