3,860
edits
Firefox OS/Performance/Automation/Metric Template: Difference between revisions
Firefox OS/Performance/Automation/Metric Template (view source)
Revision as of 13:59, 1 February 2015
, 1 February 2015Lakrits moved page FirefoxOS/Performance/Automation/Metric Template to Firefox OS/Performance/Automation/Metric Template: The official spelling of "Firefox OS" leaves a space between the two parts of the name. It's easier to find a page if the...
m (Lakrits moved page FirefoxOS/Performance/Automation/Metric Template to Firefox OS/Performance/Automation/Metric Template: The official spelling of "Firefox OS" leaves a space between the two parts of the name. It's easier to find a page if the...) |
|||
| (43 intermediate revisions by one other user not shown) | |||
| Line 1: | Line 1: | ||
= | = Metric Name = | ||
''REMOVEME: This is a fluid format. Anything that doesn't fit the metric at hand should be removed or changed. Try to include some version of all this information, if it would otherwise be appropriate.'' | |||
== Summary == | == Summary == | ||
''REPLACEME: with a general summary of the metric'' | |||
== | == Usage == | ||
=== Test Cases === | |||
''REMOVEME: Add names and high-level descriptions of available cases'' | |||
; Case 1 : Description | |||
; Case 2 : Description | |||
== | === Precision === | ||
=== Branch 1 === | ''REPLACEME: with information about the generally expected precision of the measurements. This determines how much of a change in results should be considered significant.'' | ||
=== How to Run On-Demand === | |||
''REPLACEME: with information on how a developer can run the cases on-demand from command line or otherwise'' | |||
=== Published Results === | |||
''REMOVEME: Add links to the dashboards or areas where the results of tests are published'' | |||
==== Branch 1 ==== | |||
{| class="wikitable" | {| class="wikitable" | ||
! | ! | ||
! Device 1 | ! Device 1 | ||
! Device 2 | ! Device 2 | ||
|- | |- | ||
| ''' | | '''Case 1''' || [http://www.example.com Datazilla] || N/A | ||
|- | |- | ||
| ''' | | '''Case 2''' || [http://www.example.com Eideticker] || N/A | ||
|- | |- | ||
|} | |} | ||
=== Branch 2 === | ==== Branch 2 ==== | ||
{| class="wikitable" | {| class="wikitable" | ||
! | ! | ||
! Device 1 | ! Device 1 | ||
! Device 2 | ! Device 2 | ||
|- | |- | ||
| ''' | | '''Case 1''' || [http://www.example.com Datazilla] || N/A | ||
|- | |- | ||
| ''' | | '''Case 2''' || [http://www.example.com Eideticker] || N/A | ||
|- | |- | ||
|} | |} | ||
== | === References === | ||
* Reference 1 | |||
* Reference 2 | |||
== Development == | |||
=== Design === | |||
''REMOVEME: This section is documentation of the steps a case goes through, at enough detail to review or duplicate them. Delete any unneeded setup/teardown sections. These can also be links into [https://moztrap.mozilla.org/results/runs/ MozTrap], if the tests are documented there. | |||
==== Common Setup ==== | |||
# Step 1 | |||
# Step 2 | |||
== | ==== Case 1 ==== | ||
* Setup | |||
*# Step 1 | |||
*# Step 2 | |||
=== | * Test | ||
*# Step 1 | |||
*# Step 2 | |||
* Teardown | |||
*# Step 1 | |||
*# Step 2 | |||
==== Case 2 ==== | |||
* Setup | |||
*# Step 1 | |||
*# Step 2 | |||
* Test | |||
*# Step 1 | |||
*# Step 2 | |||
* Teardown | |||
*# Step 1 | |||
*# Step 2 | |||
=== Results === | |||
* Repetition, results, etc. | |||
==== Common Teardown ==== | |||
# Step 1 | |||
# Step 2 | |||
=== Project Roadmap === | |||
* '''Lead:''' TBD | * '''Lead:''' TBD | ||
* '''Tracking Bug:''' TBD | * '''Tracking Bug:''' TBD | ||
''REMOVEME: This indexes bugs and progress for each step of the test case creation from design to publication. Modify the tables to factor out common designs, remove the instrumentation columns, or whatever is appropriate. The "Availability" column should either be "ETA <release>", "release" for delivered items, or "TBD"'' | |||
'' | |||
{| class="wikitable" | {| class="wikitable" | ||
! width="120px" | | ! width="120px" | | ||
! | ! | ||
! Test Design | ! colspan="2" | Milestone 1: Design | ||
! colspan="4" | Milestone 2: Test | |||
! colspan="2" | Milestone 3: Publication | |||
|- | |||
! | |||
! Availability | |||
! Test Design | |||
! Validity Review | ! Validity Review | ||
! Instrumentation | ! Instrumentation | ||
! Workload | ! Workload | ||
! | ! On-Demand Test | ||
! Results Review | ! Results Review | ||
! Published Results | ! Published Results | ||
! Documentation | ! Documentation | ||
|- | |- | ||
| ''' | | '''Case 1''' || TBD || Bug || Bug || Bug || Bug || Bug || Bug || Bug || Bug | ||
|- | |||
| '''Case 2''' || TBD || Bug || Bug || Bug || Bug || Bug || Bug || Bug || Bug | |||
|- | |- | ||
|} | |} | ||
<small>[http://wiki.mozilla.org/FirefoxOS/Performance/Automation/Test_Template template]</small> | <small>[http://wiki.mozilla.org/FirefoxOS/Performance/Automation/Test_Template template]</small> | ||