Add-ons/QA/Testplan/AMO Process Isolation: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(Created blank page)
 
(Testing the install, uninstall, enable from AMO add-on detail pages)
 
Line 1: Line 1:
'''Revision History'''


{| class="wikitable" style="width:65%"
|-
! Date !! Version !! Author !! Description
|-
| 30/08/2019 || 1.0 || Ioana Rusiczki || Created first draft
|-
|}
= Overview =
addons.mozilla.com and accounts.firefox.com were moved into a new process type to close out sandbox escape vectors.
== Purpose ==
Because these APIs can allow sandbox escapes.
=== Entry Criteria ===
* QA has access to [https://docs.google.com/document/d/1bfSlCl5gI7-2H9IeoVQ1KW5v3gADZ7cuWofdL7GC7-E/edit PRD]
* Firefox Release Train: Fx70, manual testing required in Beta
=== Current Status ===
* The test cases are created and waiting for Beta 70
=== Exit Criteria ===
* All blockers fixed
* All resolved bugs verified by QA
== Scope ==
===what's in scope?===
* Install and Uninstall of add-ons from AMO pages
* Disabling add-ons from Addon Manager and Enable them from AMO detail pages
 
===what's out of scope?===
* Add-ons/Webextensions functionality
== Ownership ==
Product Manager: [mailto:jorge@mozilla.com Jorge Villalobos]; irc nick :jorgev<br />
Engineering Manager: [mailto:scolville@mozilla.com Stuart Colville]; irc nick :muffinresearch<br />
QA Manager: [mailto:kraj@mozilla.com Krupa Raj]; irc nick :krupa<br />
QA Lead: [mailto:vcarciu@softvision.ro Victor Carciu]; irc nick :victorc<br />
Add-ons QA: [mailto:ioana.rusiczki@softvision.ro Ioana Rusiczki]; irc nick :ioanaR<br />
= Requirements for testing =
== Environments ==
* Windows
* Mac OS
* Linux
== Testing Environments ==
* Production: https://addons.mozilla.org/en-US/
* Addon Manager: about:addons
== Channels ==
* Beta
= Test Strategy =
== Test Execution Schedule ==
The following table identifies the anticipated testing period available for test execution.
{| class="wikitable" style="width:60%"
|-
! Project phase !! Start Date !! End Date
|-
| Start project
|style="text-align:center;" | 15.06.2019 ||
|-
| Study PRD/mocks received
|style="text-align:center;" | 15.06.2019 ||
|-
| QA - Test plan creation
|style="text-align:center;" | 30.08.2019 ||
|-
| QA - Test cases preparation
|style="text-align:center;" | 30.08.2019 ||
|-
| QA - Test cases execution 
|style="text-align:center;" |  ||
|-
| Release Date
|style="text-align:center;" | 22.10.2019 (Firefox Release 70)
|} 
 
Created a doc with more detailed scenarios - [https://docs.google.com/spreadsheets/d/1g-eVqSUiqGx0nzltgkbg4XtiUppwDfKUjpWbYOtkBy8/edit#gid=0 Restrict Legacy Add-ons Submission]
== Testing Tools ==
{| class="wikitable" style="width:50%"
|-
! Process !! Tool
|-
| Test plan creation || Mozilla wiki
|-
| Test case creation || [https://testrail.stage.mozaws.net/index.php?/suites/view/5067&group_by=cases:section_id&group_order=asc TestRail]
|-
| Bugs management || Bugzilla
|}
= References =
* PRD - https://docs.google.com/document/d/1bfSlCl5gI7-2H9IeoVQ1KW5v3gADZ7cuWofdL7GC7-E/edit
* Tracker: not available yet
= Bug Work =
* Meta bug - [https://bugzilla.mozilla.org/show_bug.cgi?id=1539595 1539595]   
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto">
====== Bug fix verification ======
<div class="mw-collapsible-content">
*
</div></div>
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto">
====== Logged bugs ======
<div class="mw-collapsible-content">
*
</div></div>
= Sign off =
== Criteria ==
Check list
* All test cases should be executed
* All blockers must be fixed and verified or have an agreed-upon timeline for being fixed

Latest revision as of 14:24, 30 August 2019

Revision History

Date Version Author Description
30/08/2019 1.0 Ioana Rusiczki Created first draft

Overview

addons.mozilla.com and accounts.firefox.com were moved into a new process type to close out sandbox escape vectors.

Purpose

Because these APIs can allow sandbox escapes.

Entry Criteria

  • QA has access to PRD
  • Firefox Release Train: Fx70, manual testing required in Beta

Current Status

  • The test cases are created and waiting for Beta 70

Exit Criteria

  • All blockers fixed
  • All resolved bugs verified by QA

Scope

what's in scope?

  • Install and Uninstall of add-ons from AMO pages
  • Disabling add-ons from Addon Manager and Enable them from AMO detail pages

what's out of scope?

  • Add-ons/Webextensions functionality

Ownership

Product Manager: Jorge Villalobos; irc nick :jorgev
Engineering Manager: Stuart Colville; irc nick :muffinresearch
QA Manager: Krupa Raj; irc nick :krupa
QA Lead: Victor Carciu; irc nick :victorc
Add-ons QA: Ioana Rusiczki; irc nick :ioanaR

Requirements for testing

Environments

  • Windows
  • Mac OS
  • Linux

Testing Environments

Channels

  • Beta

Test Strategy

Test Execution Schedule

The following table identifies the anticipated testing period available for test execution.

Project phase Start Date End Date
Start project 15.06.2019
Study PRD/mocks received 15.06.2019
QA - Test plan creation 30.08.2019
QA - Test cases preparation 30.08.2019
QA - Test cases execution
Release Date 22.10.2019 (Firefox Release 70)

Created a doc with more detailed scenarios - Restrict Legacy Add-ons Submission

Testing Tools

Process Tool
Test plan creation Mozilla wiki
Test case creation TestRail
Bugs management Bugzilla

References

* PRD - https://docs.google.com/document/d/1bfSlCl5gI7-2H9IeoVQ1KW5v3gADZ7cuWofdL7GC7-E/edit
* Tracker: not available yet

Bug Work


Bug fix verification
Logged bugs

Sign off

Criteria

Check list

  • All test cases should be executed
  • All blockers must be fixed and verified or have an agreed-upon timeline for being fixed
Retrieved from "https://wiki.mozilla.org/index.php?title=Add-ons/QA/Testplan/AMO_Process_Isolation&oldid=1217224"