Auto-tools/Projects/Signal From Noise/StatusNovember2012: Difference between revisions

Jump to navigation Jump to search
(Created page with "= State of Performance Testing: November 2012 = While the Signal from Noise project is not yet complete, there have been considerable improvements to Talos and the supporting in...")
 
Line 24: Line 24:
* Pageloader no longer calculates statistics: https://bugzilla.mozilla.org/show_bug.cgi?id=723571
* Pageloader no longer calculates statistics: https://bugzilla.mozilla.org/show_bug.cgi?id=723571
* Test definitions are no longer duplicated throughout the Talos codebase: They are now python files, see http://hg.mozilla.org/talos/file/tip/talos/ttest.py. This allows the test definitions to take advantage of inheritance and to stop duplicating repeating code and have made Talos far easier to configure, change, maintain, and expand. There is more we want to do here, this is merely a start. For more details see https://bugzilla.mozilla.org/show_bug.cgi?id=814228. ''jmaher - we should expand on the usage of this, the audience is developers''
* Test definitions are no longer duplicated throughout the Talos codebase: They are now python files, see http://hg.mozilla.org/talos/file/tip/talos/ttest.py. This allows the test definitions to take advantage of inheritance and to stop duplicating repeating code and have made Talos far easier to configure, change, maintain, and expand. There is more we want to do here, this is merely a start. For more details see https://bugzilla.mozilla.org/show_bug.cgi?id=814228. ''jmaher - we should expand on the usage of this, the audience is developers''
*  improved talos testing with talos.json: Release engineering put forth  considerable effort to allow talos changes to be tested with try  server.  The results of this effort include having the URL of a  talos.zip file listed in https://mxr.mozilla.org/mozilla-central/source/testing/talos/talos.json . This change alone probably saved hundreds of man-hours.
*  improved talos testing with talos.json: Release engineering put forth  considerable effort to allow talos changes to be tested with try  server.  The results of this effort include having the URL of a  talos.zip file listed in https://mxr.mozilla.org/mozilla-central/source/testing/talos/talos.json . This change alone probably saved hundreds of man-hours. ''ctalbert - expand this so that we can detail a bit about how to actually go about making use of the functionality.''
xxxhelp expand this so that we can detail a bit about how to actually go about making use of the functionality.
*  software has been written which includes a web app component that  details the up-to-date names of talos tests and suites in buildbot,  TBPL, talos, and graphserver: http://k0s.org/mozilla/hg/talosnames/ . A deployed instance as at http://k0s.org:8080/
*  software has been written which includes a web app component that  details the up-to-date names of talos tests and suites in buildbot,  TBPL, talos, and graphserver: http://k0s.org/mozilla/hg/talosnames/ . A deployed instance as at http://k0s.org:8080/


947

edits

Navigation menu