Confirmed users
3,376
edits
Buildbot/Talos/Data: Difference between revisions
Jump to navigation
Jump to search
no edit summary
No edit summary |
No edit summary |
||
| Line 1: | Line 1: | ||
= Overview = | |||
Historically, Talos has collected data in the Graph Server. With the focus on noise in the Talos results, the Signal From Noise project was created and one of the resulting projects is Datazilla. Datazilla is intended to replace graph server in due time, right now it is in the beta testing stage. | |||
= Graph Server (Current solution) = | |||
== How are the numbers calculated? == | == How are the numbers calculated? == | ||
| Line 27: | Line 33: | ||
We compare these using a [http://en.wikipedia.org/wiki/Student%27s_t-test t-test]. See https://wiki.mozilla.org/images/c/c0/Larres-thesis.pdf#page=74 . | We compare these using a [http://en.wikipedia.org/wiki/Student%27s_t-test t-test]. See https://wiki.mozilla.org/images/c/c0/Larres-thesis.pdf#page=74 . | ||
Regressions are mailed to the [https://lists.mozilla.org/listinfo/dev-tree-management dev-tree-management] mailing list. Regressions are calculated by the [http://hg.mozilla.org/graphs/file/tip/server/analysis/analyze_talos.py analyze_talos.py] script which uses a configuration file based on http://hg.mozilla.org/graphs/file/tip/server/analysis/analysis.cfg.template | Regressions are mailed to the [https://lists.mozilla.org/listinfo/dev-tree-management dev-tree-management] mailing list. Regressions are calculated by the [http://hg.mozilla.org/graphs/file/tip/server/analysis/analyze_talos.py analyze_talos.py] script which uses a configuration file based on http://hg.mozilla.org/graphs/file/tip/server/analysis/analysis.cfg.template | ||
= Datazilla (future solution) = | |||
Datazilla is collecting data from all our talos runs just like graph server. The difference is that it is collecting the raw data instead of pre calculated data about the tests. | |||