User:Mevans/FeatureTemplateB: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(20 intermediate revisions by 2 users not shown)
Line 6: Line 6:
*'''Tracking Bugs''':
*'''Tracking Bugs''':


= Feature Description  =
=== Feature Description  ===


Brief description of the feature
Brief description of the feature listed here.


== [[#Feature_Documentation_Details|Feature Documentation]] ==
 
= [[#Feature Release Readiness Assessment_Details|Feature Release Readiness Assessment]] =
 
The table below provides a top level go/no go assessment of whether the feature is release ready for the given milestone. Each milestone link references a section below that discusses the criteria and evaluation that went into the QA go/no-go decision.
 
{| class="fullwidth-table"
|-
! Milestone
! Assessment
|-
| [[#Beta1]]
| N/A
|-
| [[#Beta2]]
| N/A
|-
| [[#Beta3]]
| N/A
|}
 
[[#Feature_Description|top]]
 
= [[#Feature_Documentation_Details|Feature Documentation]] =


{| class="fullwidth-table"
{| class="fullwidth-table"
Line 17: Line 39:
! Description
! Description
! Status
! Status
! Notes
|-
|-
| [[#Project_Wiki]]
| [[#Project_Wiki]]
| Wiki Links to all feature related entries
| Wiki Links to all feature related entries
|
|
|
|-
|-
| [[#Developer_Links|#Developer_Links (blogs)]]
| [[#Developer_Links|#Developer_Links (blogs)]]
| Developer links to feature related sites
| Developer links to feature related sites
|
|  
|  
|-
|-
Line 32: Line 51:
| Web links to feature related sites  
| Web links to feature related sites  
|
|
|
|-
|-
| [[#Developer_QA_Review]]
| [[#Developer_QA_Review]]
| Details from developer and qa discussions regarding feature test strategies and issues.
| Details from developer and qa discussions regarding feature test strategies and issues.
|
|
|
|}
|}


= [[#Feature Release Readiness Assessment_Details|Feature Release Readiness Assessment]] =
[[#Feature_Description|top]]
 
The table below provides a top level go/no go assessment of whether the feature is release ready for the given milestone.
 
{| class="fullwidth-table"
|-
! Milestone
! Assessment
! Notes
|-
| [[#Beta1]]
| N/A
|
|-
| [[#Beta2]]
| N/A
|
|-
| [[#Beta3]]
| N/A
|
|}


= [[#Feature_Bug_Management_Details|Feature Bug Management]] =
= [[#Feature_Bug_Management_Details|Feature Bug Management]] =
Line 70: Line 66:
! Description
! Description
! Status
! Status
! Notes
|-
|-
| [[#Bug_Tracking]]
| [[#Bug_Tracking]]
| Top level bugs tracking feature   
| Top level bugs tracking feature   
|
|
|
|-
|-
| [[#Bug_Verification]]
| [[#Bug_Verification]]
| Feature bugs that need verification   
| Feature bugs that need verification   
|
|  
|  
|-
|-
Line 86: Line 79:
|
|
|}
|}
[[#Feature_Description|top]]


= [[#Feature_Test_Items_Details|Feature Test Items]] =
= [[#Feature_Test_Items_Details|Feature Test Items]] =


The table below provides a breakdown of all feature items that should be covered and how they will be tested.
The table below provides a breakdown of all feature items that should be covered and how they will be tested. Not all items will be covered by internal QA team members. It is important to list what '''should''' be covered. If it is not covered, list it as not covered.  


'''Note: not all items listed below will apply for a given feature'''
'''Note: not all items listed below will apply for a given feature'''
Line 99: Line 94:
! Covered By
! Covered By
! Status
! Status
! Notes
|-
|-
| Item 1
| Item 1
Line 105: Line 99:
| Developer Tests
| Developer Tests
|  
|  
|
|-
|-
| Item 2
| Item 2
| Item 2 Description
| Item 2 Description
| Beta tester exposure
| Beta tester exposure
|
|
|
|-
|-
| [[#Localization]]
| [[#Localization]]
| Feature localization  
| Feature localization  
|
|
|
|
|
Line 122: Line 113:
| Feature accessibility
| Feature accessibility
|  
|  
|
|
|
|-
|-
| [[#Plugins]]
| [[#Plugins]]
| Plugins compatibility   
| Plugins compatibility   
|
|
|
|
|
Line 133: Line 122:
| [[#Addons]]
| [[#Addons]]
| Addons compatibility   
| Addons compatibility   
|
|
|
|
|
Line 139: Line 127:
| [[#Topsites]]
| [[#Topsites]]
| Top internet sites compatibilities   
| Top internet sites compatibilities   
|
|
|
|
|
|}
|}
[[#Feature_Description|top]]


= [[#Feature_Tests_Details|Feature Tests]] =
= [[#Feature_Tests_Details|Feature Tests]] =
Line 151: Line 140:
! Description
! Description
! Status
! Status
! Notes
|-
|-
| [[#Developer_Tests]]
| [[#Developer_Tests]]
| Links to automated developer tests
| Links to automated developer tests
|
|
|
|-
|-
Line 161: Line 148:
| Links to automated mozmill feature test cases   
| Links to automated mozmill feature test cases   
|  
|  
|
|}
|}


Line 170: Line 156:
! Description
! Description
! Status
! Status
! Notes
|-
|-
| [[#Smoke_Tests]]
| [[#Smoke_Tests]]
| link to smoke tests
| link to smoke tests
|
|
|
|-
|-
| [[#Regression_Tests]]
| [[#Regression_Tests]]
| link to BFT and/or regression tests
| link to BFT and/or regression tests
|
|
|
|-
|-
Line 186: Line 169:
|
|
|}
|}
[[#Feature_Description|top]]


= [[#Community_Test_Events_Details|Community Test Events]] =
= [[#Community_Test_Events_Details|Community Test Events]] =
Line 193: Line 178:
! Description
! Description
! Status
! Status
! Notes
|-
|-
| [[#Testdays]]
| [[#Testdays]]
| Links to test day event results for feature
| Links to test day event results for feature
|
|
|
|-
|-
| [[#Bugdays]]
| [[#Bugdays]]
| Links to bug day event results for feature
| Links to bug day event results for feature
|
|
|
|-
|-
| [[#Meetups]]
| [[#Meetups]]
| Links to Meetup events for feature
| Links to Meetup events for feature
|
|
|
|}
|}
[[#Feature_Description|top]]


= [[#Feature_Documentation|Feature Documentation Details]] =
= [[#Feature_Documentation|Feature Documentation Details]] =
Line 252: Line 235:
= [[#Feature_Bug_Management|Feature Bug Management Details]] =
= [[#Feature_Bug_Management|Feature Bug Management Details]] =
== Bug Tracking ==
== Bug Tracking ==
* Top level bugs tracking feature
* Top level bugs tracking feature. Include any relevant bug queries that are helpful for tracking feature status.
 
{| class="fullwidth-table"
|-
! Query Name
! Description
|-
|bugzilla query url link
|query description
|}
    
    
[[#Feature_Bug_Management|top]]
[[#Feature_Bug_Management|top]]
Line 302: Line 294:


=== Mozmill Tests ===
=== Mozmill Tests ===
If a particular feature needs manual tests which should also be covered by Mozmill tests please add the "''[mozmill-test-needed]''" whiteboard entry to the feature implementation or regression bug.
List of Mozmill Tests:
* Links to automated mozmill feature test cases   
* Links to automated mozmill feature test cases   



Latest revision as of 21:30, 8 June 2010

Feature (example: add-ons preference UI)

  • Development Status: - In progress (date)
  • Feature Testing: - In progress (date)
  • Team: Developer, QA contact 1, QA contact 2, Community Volunteer...
  • Tracking Bugs:

Feature Description

Brief description of the feature listed here.


Feature Release Readiness Assessment

The table below provides a top level go/no go assessment of whether the feature is release ready for the given milestone. Each milestone link references a section below that discusses the criteria and evaluation that went into the QA go/no-go decision.

Milestone Assessment
#Beta1 N/A
#Beta2 N/A
#Beta3 N/A

top

Feature Documentation

Item Description Status
#Project_Wiki Wiki Links to all feature related entries
#Developer_Links (blogs) Developer links to feature related sites
#Other_Docs Web links to feature related sites
#Developer_QA_Review Details from developer and qa discussions regarding feature test strategies and issues.

top

Feature Bug Management

Item Description Status
#Bug_Tracking Top level bugs tracking feature
#Bug_Verification Feature bugs that need verification
#Bug_Triage Links triage bug tasks

top

Feature Test Items

The table below provides a breakdown of all feature items that should be covered and how they will be tested. Not all items will be covered by internal QA team members. It is important to list what should be covered. If it is not covered, list it as not covered.

Note: not all items listed below will apply for a given feature

Test Item Description Covered By Status
Item 1 Item 1 Description Developer Tests
Item 2 Item 2 Description Beta tester exposure
#Localization Feature localization
#Accessibility Feature accessibility
#Plugins Plugins compatibility
#Addons Addons compatibility
#Topsites Top internet sites compatibilities

top


Feature Tests

Automated Tests

Item Description Status
#Developer_Tests Links to automated developer tests
#Mozmill_Tests Links to automated mozmill feature test cases

Manual Tests

Item Description Status
#Smoke_Tests link to smoke tests
#Regression_Tests link to BFT and/or regression tests
#Functional_Tests link to FFT and/or complete functional tests

top

Community Test Events

Item Description Status
#Testdays Links to test day event results for feature
#Bugdays Links to bug day event results for feature
#Meetups Links to Meetup events for feature

top

Feature Documentation Details

Project Wiki

  • Provide link to all project related wikis

top

Developer Links

  • Provide links to all feature related developer links to blogs and other internet sites

top

Other Docs

  • Provide links to all feature related developer links to blogs and other internet sites

top

Developer QA Review

The QA person responsible for the feature should hold a formal interview with the lead developer or feature champion. Below are questions that should be asked in the interview:

  • Do we have automated tests for the feature?
  • What do they cover?
  • What do they not cover?
  • How well do they cover the feature?
  • What are the important areas we should focus on?
  • What are the dependencies?
  • What is our comfort level with this feature in its current state?
  • What feedback would you like from QA?

top

Feature Release Readiness Assessment Details

Beta1

Beta2

Beta3

Feature Bug Management Details

Bug Tracking

  • Top level bugs tracking feature. Include any relevant bug queries that are helpful for tracking feature status.
Query Name Description
bugzilla query url link query description

top

Bug Verification

  • Feature bugs that need verification

top

Bug Triage

  • Bug triage information

top

Feature Test Items Details

Localization

  • Details of feature localization test requirements

top

Accessibility

  • Details of feature accessibility test requirements

top

Plugins

  • Details of plugins compatibility test requirements

top

Addons

  • Details of addons compatibility

top

Topsites

  • Details of top internet sites test requirements

top

Feature Tests Details

Automated Tests Details

Developer Tests

  • Links to automated developer tests

top

Mozmill Tests

If a particular feature needs manual tests which should also be covered by Mozmill tests please add the "[mozmill-test-needed]" whiteboard entry to the feature implementation or regression bug.

List of Mozmill Tests:

  • Links to automated mozmill feature test cases

top

Manual Tests Details

Smoke_Tests

  • links to litmus smoke tests or description

top

Regression_Tests

  • links to litmus BFT and/or regression tests description

top

Functional_Tests

  • links to litmus FFT and/or complete functional tests description

top

Community Test Events Details

Testdays

  • Links to test day event results for feature

Bugdays

  • Links to bug day event results for feature

Meetups

  • Links to Meetup events for feature