Firefox OS/Performance/Automation/Metric Template

Metric Name

Summary

REPLACEME: with a general summary of the metric

Usage

Cases

REMOVEME: Add names and high-level descriptions of available cases

Case 1

Description

Case 2

Description

Precision

REPLACEME: with information about the generally expected precision of the measurements

Published Results

REMOVEME: Add links to the dashboards or areas where the results of tests are published

Branch 1

	Device 1	Device 2
Case 1	Yes	N/A
Case 2

Branch 2

	Device 1	Device 2
Case 1	Yes	N/A
Case 2

How to Run On-Demand

REPLACEME: with information on how to run the cases on-demand from command line or otherwise

References

• Reference 1
• Reference 2

Development

Design

REMOVEME: This section is documentation of the steps a case goes through, at enough detail to review or duplicate them. Delete any unneeded setup/teardown sections.

Common Setup

1. Step 1
2. Step 2

Case 1

• Setup
  1. Step 1
  2. Step 2

• Test
  1. Step 1
  2. Step 2

• Teardown
  1. Step 1
  2. Step 2

Case 2

• Setup
  1. Step 1
  2. Step 2

• Test
  1. Step 1
  2. Step 2

• Teardown
  1. Step 1
  2. Step 2

Common Teardown

1. Step 1
2. Step 2

Project Roadmap

Owner: TBD

REMOVEME: This indexes bugs and progress for each step of the test case creation from design to publication. Modify the tables to factor out common designs, remove the instrumentation columns, or whatever is appropriate. The "Availability" column should either be "ETA <release>", "release" for delivered items, or "TBD"

		Milestone 1: Design		Milestone 2: Test				Milestone 3: Publication
Name	Availability	Test Design	Validity Review	Instrumentation	Workload	On-Demand Test	Results Review	Published Results	Documentation
Case 1	TBD	Bug	Bug	Bug	Bug	Bug	Bug	Bug	Bug
Case 2	TBD	Bug	Bug	Bug	Bug	Bug	Bug	Bug	Bug

template