Firefox OS/Performance/Automation/Metric Template
Template
Summary
Replace this with a general summary of the metric
Precision
Replace this with information about the generally-expected precision of the metric
Scenarios
REMOVEME: Add names and high-level descriptions of scenarios
- Scenario 1
- Description
- Scenario 2
- Description
Dashboards
REMOVEME: Add links to the dashboards or areas where the results of scenarios are published
Branch 1
Device 1 | Device 2 | |
---|---|---|
Test 1 | Yes | N/A |
Test 2 |
Branch 2
Device 1 | Device 2 | |
---|---|---|
Test 1 | Yes | N/A |
Test 2 |
Procedure
REMOVEME: This section is documentation of the steps a scenario goes through, at enough detail to review or duplicate them. If scenarios share common setups/teardowns, move them out to a separate section here
Scenario 1
- Setup
- Step 1
- Step 2
- Test
- Step 1
- Step 2
- Teardown
- Step 1
- Step 2
Scenario 2
- Setup
- Step 1
- Step 2
- Test
- Step 1
- Step 2
- Teardown
- Step 1
- Step 2
References
TBD
Development Roadmap
- Lead: TBD
Scenarios
REMOVEME: This documents bugs for each step of the test creation. Modify the tables to factor out common designs, remove the instrumentation steps, or whatever is appropriate. The "Availability" column should either be "ETA <release>", "release" for delivered items, or "TBD"
Milestone 1: Design | Milestone 2: Test | Milestone 3: Publication | |||||||
---|---|---|---|---|---|---|---|---|---|
Name | Availability | Test Design | Validity Review | Instrumentation | Workload | On-Demand Test | Results Review | Published Results | Documentation |
Scenario 1 | TBD | Bug | Bug | Bug | Bug | Bug | Bug | Bug | Bug |
Scenario 2 | TBD | Bug | Bug | Bug | Bug | Bug | Bug | Bug | Bug |