3,860
edits
Firefox OS/Performance/Automation/Metric Template: Difference between revisions
Firefox OS/Performance/Automation/Metric Template (view source)
Revision as of 13:59, 1 February 2015
, 1 February 2015Lakrits moved page FirefoxOS/Performance/Automation/Metric Template to Firefox OS/Performance/Automation/Metric Template: The official spelling of "Firefox OS" leaves a space between the two parts of the name. It's easier to find a page if the...
m (Gmealer moved page FirefoxOS/Performance/Automation/Test Template to FirefoxOS/Performance/Automation/Metric Template) |
m (Lakrits moved page FirefoxOS/Performance/Automation/Metric Template to Firefox OS/Performance/Automation/Metric Template: The official spelling of "Firefox OS" leaves a space between the two parts of the name. It's easier to find a page if the...) |
||
| (12 intermediate revisions by one other user not shown) | |||
| Line 1: | Line 1: | ||
= Metric Name = | = Metric Name = | ||
''REMOVEME: This is a fluid format. Anything that doesn't fit the metric at hand should be removed or changed. Try to include some version of all this information, if it would otherwise be appropriate.'' | |||
== Summary == | == Summary == | ||
| Line 15: | Line 17: | ||
=== Precision === | === Precision === | ||
''REPLACEME: with information about the generally expected precision of the measurements'' | ''REPLACEME: with information about the generally expected precision of the measurements. This determines how much of a change in results should be considered significant.'' | ||
=== How to Run On-Demand === | |||
''REPLACEME: with information on how a developer can run the cases on-demand from command line or otherwise'' | |||
=== Published Results === | === Published Results === | ||
| Line 24: | Line 30: | ||
{| class="wikitable" | {| class="wikitable" | ||
! | ! | ||
! Device 1 | ! Device 1 | ||
! Device 2 | ! Device 2 | ||
|- | |- | ||
| '''Case 1''' || [http://www.example.com | | '''Case 1''' || [http://www.example.com Datazilla] || N/A | ||
|- | |- | ||
| '''Case 2''' || | | '''Case 2''' || [http://www.example.com Eideticker] || N/A | ||
|- | |- | ||
|} | |} | ||
| Line 37: | Line 43: | ||
{| class="wikitable" | {| class="wikitable" | ||
! | ! | ||
! Device 1 | ! Device 1 | ||
! Device 2 | ! Device 2 | ||
|- | |- | ||
| '''Case 1''' || [http://www.example.com | | '''Case 1''' || [http://www.example.com Datazilla] || N/A | ||
|- | |- | ||
| '''Case 2''' || | | '''Case 2''' || [http://www.example.com Eideticker] || N/A | ||
|- | |- | ||
|} | |} | ||
=== References === | === References === | ||
| Line 60: | Line 62: | ||
=== Design === | === Design === | ||
''REMOVEME: This section is documentation of the steps a case goes through, at enough detail to review or duplicate them. Delete any unneeded setup/teardown sections. | ''REMOVEME: This section is documentation of the steps a case goes through, at enough detail to review or duplicate them. Delete any unneeded setup/teardown sections. These can also be links into [https://moztrap.mozilla.org/results/runs/ MozTrap], if the tests are documented there. | ||
==== Common Setup ==== | ==== Common Setup ==== | ||
| Line 91: | Line 93: | ||
*# Step 1 | *# Step 1 | ||
*# Step 2 | *# Step 2 | ||
=== Results === | |||
* Repetition, results, etc. | |||
==== Common Teardown ==== | ==== Common Teardown ==== | ||
| Line 98: | Line 104: | ||
=== Project Roadmap === | === Project Roadmap === | ||
* Lead: TBD | * '''Lead:''' TBD | ||
* '''Tracking Bug:''' TBD | |||
''REMOVEME: This indexes bugs and progress for each step of the test case creation from design to publication. Modify the tables to factor out common designs, remove the instrumentation columns, or whatever is appropriate. The "Availability" column should either be "ETA <release>", "release" for delivered items, or "TBD"'' | ''REMOVEME: This indexes bugs and progress for each step of the test case creation from design to publication. Modify the tables to factor out common designs, remove the instrumentation columns, or whatever is appropriate. The "Availability" column should either be "ETA <release>", "release" for delivered items, or "TBD"'' | ||
{| class="wikitable" | {| class="wikitable" | ||
! | ! width="120px" | | ||
! | ! | ||
! colspan="2" | Milestone 1: Design | ! colspan="2" | Milestone 1: Design | ||
| Line 109: | Line 116: | ||
! colspan="2" | Milestone 3: Publication | ! colspan="2" | Milestone 3: Publication | ||
|- | |- | ||
! | ! | ||
! Availability | ! Availability | ||
! Test Design | ! Test Design | ||