QA/Asynchronous Plugin Rendering: Difference between revisions
< QA
Jump to navigation
Jump to search
No edit summary |
|||
| (11 intermediate revisions by the same user not shown) | |||
| Line 8: | Line 8: | ||
|- | |- | ||
| 10/11/2016 || 1.0 || Michelle Funches || Created first draft | | 10/11/2016 || 1.0 || Michelle Funches || Created first draft | ||
|- | |||
| 10/14/2016 || 1.1 || Michelle Funches || Edit - Combined System AddOn Testing Results | |||
|- | |- | ||
|} | |} | ||
| Line 13: | Line 15: | ||
= Overview = | = Overview = | ||
== Purpose == | == Purpose == | ||
The purpose of this document is to | The purpose of this document is to detail the testing for the Asynchronous Plugin Rendering System AddOn. The testing of this add-on is a part of Go Faster and enables Mozilla to implement System AddOn where the preference can easily be flipped. | ||
== Scope == | == Scope == | ||
This wiki details the testing that will be performed by SV Las Vegas for the Asynchronous Plugin Rendering System Addon. It defines the overall testing requirements and provides an integrated view of the project test activities. Its purpose is to document: | This wiki details the testing that will be performed by SV Las Vegas for the Asynchronous Plugin Rendering System Addon. It defines the overall testing requirements and provides an integrated view of the project test activities. Its purpose is to document: | ||
* What will be tested | * What will be tested: Asynchronus Plugin Rendering v1.0 System AddOn - Release 49.0.1 - Adobe Flash 23 | ||
* How testing will be performed | * How testing will be performed: Manual testing ensuring Multiprocess is Enabled | ||
== Ownership == | == Ownership == | ||
| Line 25: | Line 26: | ||
[mailto:blassey@mozilla.com Brad Lassey]<br /> | [mailto:blassey@mozilla.com Brad Lassey]<br /> | ||
[mailto:ksteuber@mozilla.com Kirk Steuber]<br /> | [mailto:ksteuber@mozilla.com Kirk Steuber]<br /> | ||
[mailto:fgomes@mozilla.com Felipe Gomes] <br /> | |||
[mailto:kats@mozilla.com Kartikaya Gupta] <br /> | |||
QA Engineering<br /> | QA Engineering Softvision Las Vegas<br /> | ||
[mailto:mfunches@softvison.com Michelle Funches]<br /> | [mailto:mfunches@softvison.com Michelle Funches]<br /> | ||
[mailto:amasresha@softvision.com Abe Masresha]<br /> | |||
[mailto:gwimberly@softvision.com Grover Wimberly IV]<br /> | |||
[mailto:jwilliams@softvision.com Justin Williams]<br /> | |||
[mailto:kkumari@softvision.com Kanchan Kumari]<br /> | |||
= Testing summary = | = Testing summary = | ||
== Scope of Testing == | == Scope of Testing == | ||
=== In Scope === | === In Scope === | ||
What will be tested: Asynchronus Plugin Rendering System AddOn, Adobe Beta 23. | What will be tested: Asynchronus Plugin Rendering System AddOn, Adobe Beta 23.<br /> | ||
Testing for issues with plugin rendering/painting or event input issues. | Testing for issues with plugin rendering/painting or event input issues. | ||
=== Out of Scope === | === Out of Scope === | ||
Testing will not include iOS or Android devices. | Testing will not include iOS or Android devices.<br /> | ||
Testing will not include Macintosh or Linux as Windows is the only OS that has the async drawing API. | |||
= Requirements for testing = | = Requirements for testing = | ||
== Environments == | == Environments == | ||
Testing will be performed on the current Release Firefox 49.0.1 with the AddOn installed. | Testing will be performed on the current Release Firefox 49.0.1 with the AddOn installed.<br /> | ||
Testing will focus on Windows OS where the Async Drawing API is effected. Platforms include:<br /> | Testing will focus on Windows OS where the Async Drawing API is effected. Platforms include:<br /> | ||
Windows 7<br /> | Windows 7<br /> | ||
| Line 67: | Line 77: | ||
|- | |- | ||
| Start project | | Start project | ||
|style="text-align:center;" | 10/10/2016 || | |style="text-align:center;" | 10/10/2016 ||| 10/14/2016 | ||
|- | |- | ||
| Study documentation/specs received from developers | | Study documentation/specs received from developers | ||
|style="text-align:center;" | 10/10/2016 || | |style="text-align:center;" | 10/10/2016 ||| 10/14/2016 | ||
|- | |- | ||
| QA - Test plan creation | | QA - Test plan creation | ||
|style="text-align:center;" | 10/11/2016 || | |style="text-align:center;" | 10/11/2016 ||| 10/14/2016 | ||
|- | |- | ||
| QA - Test cases/Env preparation | | QA - Test cases/Env preparation | ||
|style="text-align:center;" | 10/ | |style="text-align:center;" | 10/11/2016 ||| 10/14/2016 | ||
|- | |- | ||
| Release firefox 49.0.1 with the AddOn installed | | Release firefox 49.0.1 with the AddOn installed | ||
|style="text-align:center;" | 10/10/2016|| | |style="text-align:center;" | 10/10/2016 ||| 10/14/2016 | ||
|} | |} | ||
| Line 105: | Line 115: | ||
= | = Test Cases = | ||
== Overview == | == Overview == | ||
Testing is to focus on Multiprocess enabled. The System AddOn will change the pref. Testing will ensure the AddOn does what it is designed to do and basic Web Compatibility does not produce issues with the plugin or rendering. | Testing is to focus on Multiprocess enabled. The System AddOn will change the pref. Testing will ensure the AddOn does what it is designed to do and basic Web Compatibility does not produce issues with the plugin or rendering. | ||
| Line 144: | Line 154: | ||
== Test suite == | == Test suite == | ||
{| class="wikitable" | |||
|- | |||
! System AddOn !! Link to Test Results | |||
|- | |||
| Asynchronous Plugin Rendering v1.0 || [https://docs.google.com/spreadsheets/d/1VNljSnOkciM471nWVI4dQBVF1RUf3ULh-jUU1CT-J-k/edit#gid=1241777270 Full Test suite link] | |||
|- | |||
| Asynchronous Plugin Rendering v1.0 || [https://docs.google.com/spreadsheets/d/1VNljSnOkciM471nWVI4dQBVF1RUf3ULh-jUU1CT-J-k/edit#gid=1413172280 Smoke Test suite link] | |||
|- | |||
| Asynchronous Plugin Rendering v1.0 & D3D9 Default Fallback v1.0 || [https://docs.google.com/spreadsheets/d/1h9ojuSd64pPO9FSe_mazb1qbWo6wqO09u2N_6svHzrY/edit#gid=0 Combined Test suite link] | |||
|} | |||
= Bug Work = | = Bug Work = | ||
| Line 157: | Line 174: | ||
{| class="wikitable" style="width:50%" | {| class="wikitable" style="width:50%" | ||
|- | |- | ||
! Bug No !! Summary !! Status !! Firefox | ! Bug No !! Summary !! Status !! Firefox Version | ||
|- | |- | ||
| 1309037 || Async Rendering Plugin 1.0 AddOn-Firefox 49.0.1-Adobe | | 1309037 || Async Rendering Plugin 1.0 AddOn-Firefox 49.0.1-Adobe Flash 23.0 - Unresponsive Script & Slowness || NEW || Release 49.0.1 | ||
|- | |- | ||
| || || || | | || || || | ||
| Line 180: | Line 197: | ||
* All test cases should be executed | * All test cases should be executed | ||
* All Blocks and Critical bugs must be fixed and verified or have an agreed-upon timeline for being fixed (as determined by engineering/RelMan/QA) | * All Blocks and Critical bugs must be fixed and verified or have an agreed-upon timeline for being fixed (as determined by engineering/RelMan/QA) | ||
Latest revision as of 22:33, 14 October 2016
Revision History
This section describes the modifications that have been made to this wiki page.
| Date | Version | Author | Description |
|---|---|---|---|
| 10/11/2016 | 1.0 | Michelle Funches | Created first draft |
| 10/14/2016 | 1.1 | Michelle Funches | Edit - Combined System AddOn Testing Results |
Overview
Purpose
The purpose of this document is to detail the testing for the Asynchronous Plugin Rendering System AddOn. The testing of this add-on is a part of Go Faster and enables Mozilla to implement System AddOn where the preference can easily be flipped.
Scope
This wiki details the testing that will be performed by SV Las Vegas for the Asynchronous Plugin Rendering System Addon. It defines the overall testing requirements and provides an integrated view of the project test activities. Its purpose is to document:
- What will be tested: Asynchronus Plugin Rendering v1.0 System AddOn - Release 49.0.1 - Adobe Flash 23
- How testing will be performed: Manual testing ensuring Multiprocess is Enabled
Ownership
Mozilla Development
Brad Lassey
Kirk Steuber
Felipe Gomes
Kartikaya Gupta
QA Engineering Softvision Las Vegas
Michelle Funches
Abe Masresha
Grover Wimberly IV
Justin Williams
Kanchan Kumari
Testing summary
Scope of Testing
In Scope
What will be tested: Asynchronus Plugin Rendering System AddOn, Adobe Beta 23.
Testing for issues with plugin rendering/painting or event input issues.
Out of Scope
Testing will not include iOS or Android devices.
Testing will not include Macintosh or Linux as Windows is the only OS that has the async drawing API.
Requirements for testing
Environments
Testing will be performed on the current Release Firefox 49.0.1 with the AddOn installed.
Testing will focus on Windows OS where the Async Drawing API is effected. Platforms include:
Windows 7
Windows 8.1
Windows 10
Testing will include Firefox 32-bit and Firefox 64-bit.
Test Strategy
Test Objectives
| Ref | Function | Test Objective | Evaluation Criteria | Test Type | Owners |
|---|---|---|---|---|---|
| 1 | Asynchronous Plugin Rendering 1.0 | The objective the test is trying to demonstrate the addon functions as desired | The criteria that will be evaluated to demonstrate the test is successful | Manual | SV-Vegas Eng Team |
Test Execution Schedule
The following table identifies the anticipated testing period available for test execution.
| Project phase | Start Date | End Date |
|---|---|---|
| Start project | 10/10/2016 | 10/14/2016 |
| Study documentation/specs received from developers | 10/10/2016 | 10/14/2016 |
| QA - Test plan creation | 10/11/2016 | 10/14/2016 |
| QA - Test cases/Env preparation | 10/11/2016 | 10/14/2016 |
| Release firefox 49.0.1 with the AddOn installed | 10/10/2016 | 10/14/2016 |
Testing Tools
Detail the tools to be used for testing, for example see the following table:
| Process | Tool |
|---|---|
| Test plan creation | Mozilla wiki |
| Test case creation | Google Doc |
| Test case execution | Google Doc |
| Bugs management | Bugzilla |
Risk analysis
References
Test Cases
Overview
Testing is to focus on Multiprocess enabled. The System AddOn will change the pref. Testing will ensure the AddOn does what it is designed to do and basic Web Compatibility does not produce issues with the plugin or rendering.
Test Areas
| Test Areas | Covered | Details |
|---|---|---|
| Private Window | Done | |
| Multi-Process Enabled | Done | |
| Multi-process Disabled | N/A | |
| UI | ||
| Interaction (scroll, zoom) | Done | |
| Usability and/or discover-ability testing | Done | |
| Web Compatibility | ||
| Testing against target sites | Done | |
| Survey of many sites for compatibility | Done |
Test suite
| System AddOn | Link to Test Results |
|---|---|
| Asynchronous Plugin Rendering v1.0 | Full Test suite link |
| Asynchronous Plugin Rendering v1.0 | Smoke Test suite link |
| Asynchronous Plugin Rendering v1.0 & D3D9 Default Fallback v1.0 | Combined Test suite link |
Bug Work
Bug fix verification
| Bug No | Summary | Status | Firefox Version |
|---|---|---|---|
| 1309037 | Async Rendering Plugin 1.0 AddOn-Firefox 49.0.1-Adobe Flash 23.0 - Unresponsive Script & Slowness | NEW | Release 49.0.1 |
Logged bugs
Bug 1309037
Bug
Sign off
Criteria
Check list
- All test cases should be executed
- All Blocks and Critical bugs must be fixed and verified or have an agreed-upon timeline for being fixed (as determined by engineering/RelMan/QA)