Buildbot/Talos/Running: Difference between revisions

Jump to navigation Jump to search
Bug 1082602
m (→‎Using try server: - update try usage syntax)
(Bug 1082602)
Line 68: Line 68:
== Are my numbers ok ==
== Are my numbers ok ==


The best way to answer this question is to push to try server and compare the reported numbers from the logs (use tbpl as a log parser) and compare that with the [[http://graphs.mozilla.org/ graph server]].  I recommend using tbpl to open the link to the graphs.   
The best way to answer this question is to push to try server and compare the reported numbers from the logs (use Treeherder as a log parser) and compare that with the [[http://graphs.mozilla.org/ graph server]].  I recommend using Treeherder to open the link to the graphs.   


If you are planning on landing on mozilla-central, look at tests from mozilla-central.  Be aware of PGO vs Non PGO and Chrome vs Non Chrome.  TBPL makes this a moderately pain free process (i.e. about 30 minutes).  This is one of the big problems we are solving with datazilla.
If you are planning on landing on mozilla-central, look at tests from mozilla-central.  Be aware of PGO vs Non PGO and Chrome vs Non Chrome.  Treeherder makes this a moderately pain free process (i.e. about 30 minutes).  This is one of the big problems we are solving with datazilla.


== Using try server ==
== Using try server ==
Line 166: Line 166:
* the graphserver performs averaging across the pageset (for Pageloader tests) or across cycles (for Startup tests) and returns a number via HTTP to Talos which is then printed to the log
* the graphserver performs averaging across the pageset (for Pageloader tests) or across cycles (for Startup tests) and returns a number via HTTP to Talos which is then printed to the log


* [https://tbpl.mozilla.org/ TBPL] receives the name of the suite from buildbot.  These are correlated to TBPL letters via http://hg.mozilla.org/webtools/tbpl/file/tip/js/Config.js . The computed results from graphserver are scraped from the log and displayed when a TBPL suite letter is clicked on in the lower right corner
* [https://treeherder.mozilla.org/ Treeherder] receives the name of the suite from buildbot.  These are correlated to Treeherder letters via [https://github.com/mozilla/treeherder-service/blob/master/treeherder/etl/buildbot.py]. The computed results from graphserver are scraped from the log and displayed when a Treeherder suite letter is clicked.


=== The Test Machines ===
=== The Test Machines ===
canmove, Confirmed users
1,126

edits

Navigation menu