TestEngineering/Performance/Talos/Data: Difference between revisions

removed graph server section
(Created page with "= Talos Data = Raw data is generated by Talos. We apply some filters to summarize and reduce the data, then we post it to a server: * Graphserver * Perfherder == Terminology...")
 
(removed graph server section)
Line 119: Line 119:
Each suite has the ability to set custom filters and keeping this logic inside of talos ensures that it is always done in a single place, in source code, where developers can easily look and find it.
Each suite has the ability to set custom filters and keeping this logic inside of talos ensures that it is always done in a single place, in source code, where developers can easily look and find it.


== Graph Server ==
Data is packaged as a file in an HTTP post object.


=== VALUES/AVERAGE ===
== browser_output.txt ==
 
Two different types of data to be sent:
# A single value to be stored as the 'average' in the test_runs table
# A set of (interval, value) pairs to be stored in the test_run_values table, 'average' to be calculated by collector script
 
First type will be called 'AVERAGE' second called 'VALUES'.
All data is formatted using comma separated notation.
 
date_run = seconds since epoch (linux time stamp)
page_name = is unique to pages when combined with the pageset_id from test table
 
* for sending interval, value pairs
START
VALUES
machine_name,test_name,branch_name,ref_changeset,ref_build_id,date_run
interval0,value0,page_name0
interval1,value1,page_name1
...
intervalEND,valueEND,page_id
END
* for sending a single value
  START
  AVERAGE
  machine_name,test_name,branch_name,ref_changeset,ref_build_id,date_run
  value0
  END
 
==== Examples ====
values input:
START
VALUES
machine_1, test_1, branch_1, changeset_1, 13, 1229477017
1,1.0,page_01
2,2.0,page_02
3,3.0,page_03
4,1.0,page_04
5,2.0,page_05
6,3.0,page_06
7,1.0,page_07
8,2.0,page_08
9,3.0,page_09
10,1.0,page_10
11,2.0,page_11
12,3.0,page_12
END
 
response:
Content-type: text/plain
RETURN\ttest_1\tgraph.html#type=series&tests=[{"test":45,"branch":3455,"machine":234,"testrun"=6667}]
RETURN\ttest_1\t2.00\tgraph.html#tests=[{"test":45,"branch":3455,"machine":234}]
 
average input:
START
AVERAGE
machine_1, test_1, branch_1, changeset_1, 13, 1229477017
2.0
END
 
response:
Content-type: text/plain
RETURN\ttest_1\t2.00\tgraph.html#tests=[{"test":45,"branch":3455,"machine":234}]
 
=== browser_output.txt ===


The data is harvested from browser_output.txt:
The data is harvested from browser_output.txt:
Confirmed users
3,376

edits