QA/Feature Testing v2: Difference between revisions

Jump to navigation Jump to search

QA/Feature Testing v2 (view source)

Revision as of 15:53, 18 March 2019

12,403 bytes added ,  18 March 2019
m
-
m (-)
m (-)
Line 107: Line 107:
! colspan="6" style="font-weight:bold; background-color:#efefef;" | WEEK NO
! colspan="6" style="font-weight:bold; background-color:#efefef;" | WEEK NO
|-
|-
| style="font-weight:bold; background-color:#efefef; color:#656565;" | 1
| width="20px"  style="text-align: center; font-weight:bold; background-color:#efefef; color:#656565;" | 1
| style="font-weight:bold; background-color:#efefef; color:#656565;" | 2
| width="20px"  style="text-align: center; font-weight:bold; background-color:#efefef; color:#656565;" | 2
| style="font-weight:bold; background-color:#efefef; color:#656565;" | 3
| width="20px"  style="text-align: center; font-weight:bold; background-color:#efefef; color:#656565;" | 3
| style="font-weight:bold; background-color:#efefef; color:#656565;" | 4
| width="20px"  style="text-align: center; font-weight:bold; background-color:#efefef; color:#656565;" | 4
| style="font-weight:bold; background-color:#efefef; color:#656565;" | 5
| width="20px"  style="text-align: center; font-weight:bold; background-color:#efefef; color:#656565;" | 5
| style="font-weight:bold; background-color:#efefef; color:#656565;" | 6
| width="20px"  style="text-align: center; font-weight:bold; background-color:#efefef; color:#656565;" | 6
|-
|-
| rowspan="4" style="font-weight:bold; background-color:#efefef; color:#6200c9;" | NIGHTLY
| rowspan="4" style="font-weight:bold; background-color:#efefef; color:#6200c9;" | NIGHTLY
| PI request deadline
| PI request deadline
|  
| width="20px"  style="text-align: center; color:#6200c9;" |  
|  
| width="20px"  style="text-align: center; color:#6200c9;" |  
|  
| width="20px"  style="text-align: center; color:#6200c9;" |  
|  
| width="20px"  style="text-align: center; color:#6200c9;" |  
|  
| width="20px"  style="text-align: center; color:#6200c9;" |  
|  
| width="20px"  style="text-align: center; color:#6200c9;" |  
|-
|-
| Feature technical documentation
| Feature technical documentation
|  
| width="20px"  style="text-align: center; color:#6200c9;" |  
|  
| width="20px"  style="text-align: center; color:#6200c9;" |  
|  
| width="20px"  style="text-align: center; color:#6200c9;" |  
|  
| width="20px"  style="text-align: center; color:#6200c9;" |  
|  
| width="20px"  style="text-align: center; color:#6200c9;" |  
|  
| width="20px"  style="text-align: center; color:#6200c9;" | 
|-
|-
| Feature kick-offs
| Feature kick-offs
|  
| width="20px"  style="text-align: center; color:#6200c9;" |  
|  
| width="20px"  style="text-align: center; color:#6200c9;" |  
|  
| width="20px"  style="text-align: center; color:#6200c9;" |  
|  
| width="20px"  style="text-align: center; color:#6200c9;" |  
|  
| width="20px"  style="text-align: center; color:#6200c9;" |  
|  
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |  
|-
|-
| Test Plan & Test Case formal approvals
| Test Plan & Test Case formal approvals
|  
| width="20px"  style="text-align: center; color:#6200c9;" |  
|  
| width="20px"  style="text-align: center; color:#6200c9;" |  
|  
| width="20px"  style="text-align: center; color:#6200c9;" |  
|  
| width="20px"  style="text-align: center; color:#6200c9;" |  
|  
| width="20px"  style="text-align: center; color:#6200c9;" |  
|  
| width="20px"  style="text-align: center; color:#6200c9;" |  
|-
|-
| rowspan="2" style="font-weight:bold; background-color:#efefef; color:#ce6301;" | BETA
| rowspan="2" style="font-weight:bold; background-color:#efefef; color:#ce6301;" | BETA
| Pre-Release preliminary status report
| Pre-Release preliminary status report
|  
| width="20px" style="text-align: center; color:#ce6301;" |  
|  
| width="20px"  style="text-align: center; color:#ce6301;" |  
|  
| width="20px"  style="text-align: center; color:#ce6301;" |  
|  
| width="20px"  style="text-align: center; color:#ce6301;" |  
|  
| width="20px"  style="text-align: center; color:#ce6301;" |  
|  
| width="20px"  style="text-align: center; color:#ce6301;" |  
|-
|-
| Pre-Release feature sign off
| Pre-Release feature sign off
|  
| width="20px"  style="text-align: center; color:#ce6301;" |  
|  
| width="20px"  style="text-align: center; color:#ce6301;" |  
|  
| width="20px"  style="text-align: center; color:#ce6301;" |  
|  
| width="20px"  style="text-align: center; color:#ce6301;" |  
|  
| width="20px"  style="text-align: center; color:#ce6301;" |  
|  
| width="20px"  style="text-align: center; color:#ce6301;" | 
|}
|}
==== 7-week release cycle ====
{| class="wikitable"
! rowspan="2" style="font-weight:bold; background-color:#efefef;" | CYCLE
! rowspan="2" style="font-weight:bold; background-color:#efefef;" | MILESTONE
! colspan="7" style="font-weight:bold; background-color:#efefef;" | WEEK NO
|-
| width="20px"  style="text-align: center; font-weight:bold; background-color:#efefef; color:#656565;" | 1
| width="20px"  style="text-align: center; font-weight:bold; background-color:#efefef; color:#656565;" | 2
| width="20px"  style="text-align: center; font-weight:bold; background-color:#efefef; color:#656565;" | 3
| width="20px"  style="text-align: center; font-weight:bold; background-color:#efefef; color:#656565;" | 4
| width="20px"  style="text-align: center; font-weight:bold; background-color:#efefef; color:#656565;" | 5
| width="20px"  style="text-align: center; font-weight:bold; background-color:#efefef; color:#656565;" | 6
| width="20px"  style="text-align: center; font-weight:bold; background-color:#efefef; color:#656565;" | 7
|-
| rowspan="4" style="font-weight:bold; background-color:#efefef; color:#6200c9;" | NIGHTLY
| PI request deadline
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
|-
| Feature technical documentation
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
|-
| Feature kick-offs
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
|-
| Test Plan & Test Case formal approvals
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
|-
| rowspan="2" style="font-weight:bold; background-color:#efefef; color:#ce6301;" | BETA
| Pre-Release preliminary status report
| width="20px" style="text-align: center; color:#ce6301;" |
| width="20px"  style="text-align: center; color:#ce6301;" |
| width="20px"  style="text-align: center; color:#ce6301;" |
| width="20px"  style="text-align: center; color:#ce6301;" |
| width="20px"  style="text-align: center; color:#ce6301;" |
| width="20px"  style="text-align: center; color:#ce6301;" |
| width="20px"  style="text-align: center; color:#ce6301;" |
|-
| Pre-Release feature sign off
| width="20px"  style="text-align: center; color:#ce6301;" |
| width="20px"  style="text-align: center; color:#ce6301;" |
| width="20px"  style="text-align: center; color:#ce6301;" |
| width="20px"  style="text-align: center; color:#ce6301;" |
| width="20px"  style="text-align: center; color:#ce6301;" |
| width="20px"  style="text-align: center; color:#ce6301;" |
| width="20px"  style="text-align: center; color:#ce6301;" |
|}
==== 8-week release cycle ====
{| class="wikitable"
! rowspan="2" style="font-weight:bold; background-color:#efefef;" | CYCLE
! rowspan="2" style="font-weight:bold; background-color:#efefef;" | MILESTONE
! colspan="8" style="font-weight:bold; background-color:#efefef;" | WEEK NO
|-
| width="20px"  style="text-align: center; font-weight:bold; background-color:#efefef; color:#656565;" | 1
| width="20px"  style="text-align: center; font-weight:bold; background-color:#efefef; color:#656565;" | 2
| width="20px"  style="text-align: center; font-weight:bold; background-color:#efefef; color:#656565;" | 3
| width="20px"  style="text-align: center; font-weight:bold; background-color:#efefef; color:#656565;" | 4
| width="20px"  style="text-align: center; font-weight:bold; background-color:#efefef; color:#656565;" | 5
| width="20px"  style="text-align: center; font-weight:bold; background-color:#efefef; color:#656565;" | 6
| width="20px"  style="text-align: center; font-weight:bold; background-color:#efefef; color:#656565;" | 7
| width="20px"  style="text-align: center; font-weight:bold; background-color:#efefef; color:#656565;" | 8
|-
| rowspan="4" style="font-weight:bold; background-color:#efefef; color:#6200c9;" | NIGHTLY
| PI request deadline
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" | ⬤
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
|-
| Feature technical documentation
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" | ⬤
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
|-
| Feature kick-offs
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" | ⬤
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
|-
| Test Plan & Test Case formal approvals
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" | ⬤
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
| width="20px"  style="text-align: center; color:#6200c9;" |
|-
| rowspan="2" style="font-weight:bold; background-color:#efefef; color:#ce6301;" | BETA
| Pre-Release preliminary status report
| width="20px" style="text-align: center; color:#ce6301;" |
| width="20px"  style="text-align: center; color:#ce6301;" |
| width="20px"  style="text-align: center; color:#ce6301;" |
| width="20px"  style="text-align: center; color:#ce6301;" |
| width="20px"  style="text-align: center; color:#ce6301;" | ⬤
| width="20px"  style="text-align: center; color:#ce6301;" |
| width="20px"  style="text-align: center; color:#ce6301;" |
| width="20px"  style="text-align: center; color:#ce6301;" |
|-
| Pre-Release feature sign off
| width="20px"  style="text-align: center; color:#ce6301;" |
| width="20px"  style="text-align: center; color:#ce6301;" |
| width="20px"  style="text-align: center; color:#ce6301;" |
| width="20px"  style="text-align: center; color:#ce6301;" |
| width="20px"  style="text-align: center; color:#ce6301;" |
| width="20px"  style="text-align: center; color:#ce6301;" |
| width="20px"  style="text-align: center; color:#ce6301;" | ⬤
| width="20px"  style="text-align: center; color:#ce6301;" |
|}
=== Best practices ===
* <u>Getting help</u>
** Each feature’s QA owner should have a peer (helper) assigned to help.
*** Larger, more complex features can justify more than one QA peer.
* <u>Maintaining documentation</u>
** Internal Test Plan reviews and updates should occur periodically.
*** Feature Test Plans should be updated at least once a week to keep them relevant.
** Feature status updates should be provided periodically in the QA status documents associated to each Firefox version.
* <u>Bug tracking</u>
** Weekly checks should be made for the bugs reported in the wild.
*** Since there are so many environment variations (due to various software and hardware pairings), some bugs might only be uncovered by users that have very specific environment setups.
** In the case of highly complex features, a meta bug should be created to track all the issue reported by QA.
*** Having a separate meta bug for the issues reported by QA ensures a more efficient tracking, referencing and reporting.
** Highly severe bugs (critical, blockers) affecting a feature should be flagged using the <code>qablocker</code> keyword.
*** Using this keyword in addition to setting <code>needinfo?</code> flags for the right people is the most efficient way of raising major concerns.
* <u>Bug verification</u>
** A continuous monitoring process should be in place for new bug fixes.
*** This can be easily done by setting up Bugzilla queries, or something similar.
Andrei.vaida
Confirmed users
1,595

edits

Retrieved from "https://wiki.mozilla.org/Special:MobileDiff/1209090"

Navigation menu