Firefox OS/Performance/Automation/Metric Template

Template

Summary

Replace this with a general summary of the metric

Precision

Replace this with information about the generally-expected precision of the metric

Scenarios

REMOVEME: Add names and high-level descriptions of scenarios

  • Scenario 1
    • Description
  • Scenario 2
    • Description

Dashboards

REMOVEME: Add links to the dashboards or areas where the results of scenarios are published

Branch 1

Device 1 Device 2
Test 1 Yes N/A
Test 2

Branch 2

Device 1 Device 2
Test 1 Yes N/A
Test 2

Procedure

REMOVEME: This section is documentation of the steps a scenario goes through, at enough detail to review or duplicate them. If scenarios share common setups/teardowns, move them out to a separate section here

Scenario 1

  • Setup
    1. Step 1
    2. Step 2
  • Test
    1. Step 1
    2. Step 2
  • Teardown
    1. Step 1
    2. Step 2

Scenario 2

  • Setup
    1. Step 1
    2. Step 2
  • Test
    1. Step 1
    2. Step 2
  • Teardown
    1. Step 1
    2. Step 2

References

TBD

Development Roadmap

  • Lead: TBD

Scenarios

REMOVEME: This documents bugs for each step of the test creation. Modify the tables to factor out common designs, remove the instrumentation steps, or whatever is appropriate. The "Availability" column should either be "ETA <release>", "release" for delivered items, or "TBD"

Milestone 1: Design Milestone 2: Test Milestone 3: Publication
Name Availability Test Design Validity Review Instrumentation Workload On-Demand Test Results Review Published Results Documentation
Scenario 1 TBD Bug Bug Bug Bug Bug Bug Bug Bug
Scenario 2 TBD Bug Bug Bug Bug Bug Bug Bug Bug

template