MozillaWiki

Firefox OS/Performance/Automation/Metric Template: Difference between revisions

Page Discussion

Firefox OS/Performance/Automation/Metric Template (view source)

Revision as of 13:59, 1 February 2015

1,010 bytes added ,  1 February 2015
m
Lakrits moved page FirefoxOS/Performance/Automation/Metric Template to Firefox OS/Performance/Automation/Metric Template: The official spelling of "Firefox OS" leaves a space between the two parts of the name. It's easier to find a page if the...
No edit summary
m (Lakrits moved page FirefoxOS/Performance/Automation/Metric Template to Firefox OS/Performance/Automation/Metric Template: The official spelling of "Firefox OS" leaves a space between the two parts of the name. It's easier to find a page if the...)
 
(34 intermediate revisions by one other user not shown)
Line 1: Line 1:
= Template =
= Metric Name =
''REMOVEME: This is a fluid format. Anything that doesn't fit the metric at hand should be removed or changed. Try to include some version of all this information, if it would otherwise be appropriate.''
 
== Summary ==
== Summary ==


''Replace this with a general summary of the metric''
''REPLACEME: with a general summary of the metric''
 
== Usage ==
 
=== Test Cases ===


== Precision ==
''REMOVEME: Add names and high-level descriptions of available cases''


''Replace this with information about the generally-expected precision of the metric''
; Case 1 : Description
; Case 2 : Description


== Scenarios ==
=== Precision ===


''REMOVEME: Add names and high-level descriptions of scenarios''
''REPLACEME: with information about the generally expected precision of the measurements. This determines how much of a change in results should be considered significant.''


* Scenario 1
=== How to Run On-Demand ===
** Description


* Scenario 2
''REPLACEME: with information on how a developer can run the cases on-demand from command line or otherwise''
** Description


== Dashboards ==
=== Published Results ===


''REMOVEME: Add links to the dashboards or areas where the results of scenarios are published''
''REMOVEME: Add links to the dashboards or areas where the results of tests are published''


=== Branch 1 ===
==== Branch 1 ====


{| class="wikitable"
{| class="wikitable"
! width="120px" |
!
! Device 1
! Device 1
! Device 2
! Device 2
|-
|-
| '''Test 1''' || [http://www.example.com Yes] || N/A
| '''Case 1''' || [http://www.example.com Datazilla] || N/A
|-
|-
| '''Test 2''' || ||
| '''Case 2''' || [http://www.example.com Eideticker] || N/A
|-
|-
|}
|}


=== Branch 2 ===
==== Branch 2 ====


{| class="wikitable"
{| class="wikitable"
! width="120px" |
!
! Device 1
! Device 1
! Device 2
! Device 2
|-
|-
| '''Test 1''' || [http://www.example.com Yes] || N/A
| '''Case 1''' || [http://www.example.com Datazilla] || N/A
|-
|-
| '''Test 2''' || ||
| '''Case 2''' || [http://www.example.com Eideticker] || N/A
|-
|-
|}
|}


== Procedure ==
=== References ===
 
* Reference 1
* Reference 2
 
== Development ==
 
=== Design ===
 
''REMOVEME: This section is documentation of the steps a case goes through, at enough detail to review or duplicate them. Delete any unneeded setup/teardown sections. These can also be links into [https://moztrap.mozilla.org/results/runs/ MozTrap], if the tests are documented there.


''REMOVEME: This section is documentation of the steps a scenario goes through, at enough detail to review or duplicate them. If scenarios share common setups/teardowns, move them out to a separate section here''
==== Common Setup ====
# Step 1
# Step 2


=== Scenario 1 ===
==== Case 1 ====
* Setup
* Setup
*# Step 1
*# Step 1
Line 65: Line 81:
*# Step 2
*# Step 2


=== Scenario 2 ===
==== Case 2 ====
* Setup
* Setup
*# Step 1
*# Step 1
Line 78: Line 94:
*# Step 2
*# Step 2


== References ==
=== Results ===
 
* Repetition, results, etc.


TBD
==== Common Teardown ====
# Step 1
# Step 2


== Roadmap ==
=== Project Roadmap ===


* '''Lead:''' TBD
* '''Lead:''' TBD
* '''Tracking Bug:''' TBD


=== Scenarios ===
''REMOVEME: This indexes bugs and progress for each step of the test case creation from design to publication. Modify the tables to factor out common designs, remove the instrumentation columns, or whatever is appropriate. The "Availability" column should either be "ETA <release>", "release" for delivered items, or "TBD"''
 
'''REMOVEME: This documents bugs for each step of the test creation. Modify the tables to factor out common designs, remove the instrumentation steps, or whatever is appropriate''


{| class="wikitable"
{| class="wikitable"
!
! width="120px" |
!
!
! colspan="2" | Milestone 1: Design
! colspan="2" | Milestone 1: Design
Line 97: Line 116:
! colspan="2" | Milestone 3: Publication
! colspan="2" | Milestone 3: Publication
|-
|-
! Name
!  
! Availability
! Availability
! Test Design
! Test Design
Line 108: Line 127:
! Documentation
! Documentation
|-
|-
| '''Scenario''' || TBD || Bug || Bug || Bug || Bug || Bug || Bug || Bug || Bug
| '''Case 1''' || TBD || Bug || Bug || Bug || Bug || Bug || Bug || Bug || Bug
|-
| '''Case 2''' || TBD || Bug || Bug || Bug || Bug || Bug || Bug || Bug || Bug
|-
|-
|}
|}


<small>[http://wiki.mozilla.org/FirefoxOS/Performance/Automation/Test_Template template]</small>
<small>[http://wiki.mozilla.org/FirefoxOS/Performance/Automation/Test_Template template]</small>
Lakrits
3,860

edits

Retrieved from "https://wiki.mozilla.org/Special:MobileDiff/999429...1052499"