Buildbot/Talos: Difference between revisions

Jump to navigation Jump to search
Line 165: Line 165:
== Lifecycle of a Performance Test, from push to graph server ==
== Lifecycle of a Performance Test, from push to graph server ==


* TODO an abbreviated version of this.
* Buildbot schedules Talos jobs
* Buildbot runs a talos job on a slave when one is available
** Buildbot downloads the build and talos.zip (found in [http://hg.mozilla.org/mozilla-central/tip/testing/talos/talos.json talos.json])
** Buildbot configures the test and the runs it
** After the test is completed the data is uploaded to the [http://graphs.mozilla.org/ Graph Server] (and to [https://datazilla.mozilla.org/talos/ Datazilla])
** a link to the Graph Server data is posted in the log file
* TBPL displays a green (all OK) status and has a link to the graph server
* 5 pushes later, [http://hg.mozilla.org/graphs/file/tip/server/analysis/analyze_talos.py analyze_talos.py] is ran which compares your push to the previous 30 pushes and next 5 pushes to look for a [https://wiki.mozilla.org/Buildbot/Talos/Data#Regressions regression]
** if a regression is found, it will be posted on [http://groups.google.com/group/mozilla.dev.tree-management/topics?lnk=srg&pli=1 dev.tree-management]


== Adding a new test ==
== Adding a new test ==
Confirmed users
3,376

edits

Navigation menu