Confirmed users
513
edits
EngineeringProductivity/Projects/ActiveData: Difference between revisions
Jump to navigation
Jump to search
EngineeringProductivity/Projects/ActiveData (view source)
Revision as of 18:27, 9 June 2016
, 9 June 2016add charts
Klahnakoski (talk | contribs) (→Let's Use It!: fix link) |
Klahnakoski (talk | contribs) (add charts) |
||
| Line 5: | Line 5: | ||
ActiveData is built on top of ElasticSearch, a fast, distributed, redundant document store. ActiveData provides the benefits of familiar and succinct SQL by translating SQL-like queries to ElasticSearch queries, | ActiveData is built on top of ElasticSearch, a fast, distributed, redundant document store. ActiveData provides the benefits of familiar and succinct SQL by translating SQL-like queries to ElasticSearch queries, | ||
== Charts == | |||
ActiveData is fast enough to support dashboards. | |||
=== Build times === | |||
{| class="wikitable" | |||
|- | |||
| style="vertical-align:top;width:300px;" | [http://people.mozilla.org/~klahnakoski/MoBuildbotTimings/Builds-Overview.html Build Times] | |||
|| Time series view of build times by platform and build type. Click on a bar to get a scatter plot view. | |||
|- | |||
| style="vertical-align:top;width:300px;" | [http://people.mozilla.org/~klahnakoski/MoBuildbotTimings/Builds-Detail.html Detailed Build Times] | |||
|| Scatter plot of build times. Use the left navigation panel to choose a combination. Click on a data point to see the Buildbot step times and Mozharness step times. | |||
|- | |||
| style="vertical-align:top;width:300px;" | [http://people.mozilla.org/~klahnakoski/MoBuildbotTimings/Buildbot-Simulator.html Buildbot Simulator]<br><span style="color:red">incomplete</span> | |||
|| An incomplete Buildbot scheduling simulator. It can be used to see past wait times, queue size, and inter-job delays. | |||
|- | |||
| style="vertical-align:top;width:300px;" | [http://people.mozilla.org/~klahnakoski/MoBuildbotTimings/index.html Test Runtimes] | |||
|| Choose test suite and machine pool to get an average run time for each of the buildbot steps, and Mozharness steps. | |||
|} | |||
===Unit Test Visualization=== | |||
With all unit test results in ActiveData, we can get accurate estimates of "failure rate"; and be able to focus on the most-failing tests. | |||
{| class="wikitable" | |||
|- | |||
| style="vertical-align:top;width:300px;" | [http://people.mozilla.org/~klahnakoski/testfailures/ Top Intermittent Failures] | |||
|| List of top 30 most-failing unit tests, and list of top 30 most-recent failing tests. Click on the link to get a scatterplot. | |||
|- | |||
| style="vertical-align:top;width:300px;" | [http://people.mozilla.org/~klahnakoski/testfailures/test.html Find Test Results] | |||
|| Use the search bar to find a test. A list of matching tests, and platform combinations will show the unit test failures and durations. | |||
|} | |||
== Problem == | == Problem == | ||