Add-ons/QA/Testplan/Add-ons Post Reviews Process: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
No edit summary
No edit summary
Line 65: Line 65:
|-
|-
| Start project  
| Start project  
|style="text-align:center;" | 15.12.2016 ||  
|style="text-align:center;" | 14.03.2017 ||  
|-
|-
| Study PRD/mocks received  
| Study PRD/mocks received  
|style="text-align:center;" | 06.01.2017 ||  
|style="text-align:center;" | 20.04.2017 ||  
|-
|-
| QA - Test plan creation  
| QA - Test plan creation  
|style="text-align:center;" | 03.02.2017 ||  
|style="text-align:center;" | 20.06.2017 ||  
|-
|-
| QA - Test cases preparation  
| QA - Test cases preparation  
|style="text-align:center;" | 06.03.2017 ||  
|style="text-align:center;" | ||  
|-
|-
| QA - Test cases execution   
| QA - Test cases execution   
Line 80: Line 80:
|-
|-
| Release Date  
| Release Date  
|style="text-align:center;" | 17.04.2017 (Firefox Release 53)
|style="text-align:center;" | Firefox Release 57
|}   
|}   
    
    
Line 100: Line 100:
= References =
= References =
* PRD - https://docs.google.com/document/d/1BdiJSYD4aOMClasGxx5wVShHEk8VbxefE3Gf_6jpgkQ/edit#
* PRD - https://docs.google.com/document/d/1BdiJSYD4aOMClasGxx5wVShHEk8VbxefE3Gf_6jpgkQ/edit#
* Tracker: https://github.com/mozilla/addons-server/issues/5211
* Tracker: https://github.com/mozilla/addons-server/issues/5211  
* Implementation plan with what we care about for Q2: https://docs.google.com/document/d/1rZvM2QGk8WtkNUDRvLEvrbqZ190hvHfOle4zVRllQmw/edit   
* Add-ons Auto Approvals test plan: https://wiki.mozilla.org/Add-ons/QA/Testplan/Auto-Approvals
* Post-review weights for prioritization https://docs.google.com/spreadsheets/d/1CZEECHHqEmK87fNiWNslAsFQBL7zxYF-c63-zZVZuqw/edit#gid=0   
* Implementation plan for Q2: https://docs.google.com/document/d/1rZvM2QGk8WtkNUDRvLEvrbqZ190hvHfOle4zVRllQmw/edit   
* Post-review weights for prioritization: https://docs.google.com/spreadsheets/d/1CZEECHHqEmK87fNiWNslAsFQBL7zxYF-c63-zZVZuqw/edit#gid=0   


= Testcases =  
= Testcases =  
Line 114: Line 115:
* Feature implementation bug - [https://github.com/mozilla/addons-server/issues/5211 5210]     
* Feature implementation bug - [https://github.com/mozilla/addons-server/issues/5211 5210]     
* All Feature bugs:
* All Feature bugs:
** [ Open]   
** [ [https://github.com/mozilla/addons-server/labels/project%3A%20auto%20approval Open]]   
** [ Closed]
** [ [https://github.com/mozilla/addons-server/issues?q=label%3A%22project%3A+auto+approval%22+is%3Aclosed Closed]]


<div class="toccolours mw-collapsible mw-collapsed" style="width:auto">
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto">

Revision as of 11:35, 20 June 2017

Revision History

Date Version Author Description
20/06/2017 1.0 Valentina Virlics Created first draft

Overview

Purpose

Entry Criteria

  • QA has access to PRD and some mocks (found in bugs)
  • The feature has landed in -dev

Current Status

  • The feature is under continuous development

Exit Criteria

  • All related bugs triaged
  • All blockers fixed
  • All resolved bugs verified by QA
  • Found-fixed bugs rate going down in time

Scope

what's in scope?

In discussions:

what's out of scope?

  • Add-ons/Webextensions functionality

Ownership

Product Manager: Jorge Villalobos; irc nick :jorgev
QA Manager: Krupa Raj; irc nick :krupa
QA Lead: Victor Carciu; irc nick :victorc
Add-ons QA: Valentina Virlics; irc nick :ValentinaV

Requirements for testing

Environments

  • Windows
  • Mac OS

Servers

Channels

  • Release

Test Strategy

Test Execution Schedule

The following table identifies the anticipated testing period available for test execution.

Project phase Start Date End Date
Start project 14.03.2017
Study PRD/mocks received 20.04.2017
QA - Test plan creation 20.06.2017
QA - Test cases preparation
QA - Test cases execution
Release Date Firefox Release 57


Testing Tools

Process Tool
Test plan creation Mozilla wiki
Test case creation [TestRail] / [Google docs]
Test case execution [TestRail]
Bugs management Github

References

Testcases

Test Areas

  • Review of add-ons

Test suite

Full Test Suite: [here]

Bug Work

Bug fix verification
Logged bugs

Sign off

Criteria

Check list

  • All test cases should be executed
  • All blockers must be fixed and verified or have an agreed-upon timeline for being fixed