Confirmed users
2,197
edits
TestEngineering/Performance/Results: Difference between revisions
Jump to navigation
Jump to search
TestEngineering/Performance/Results (view source)
Revision as of 13:16, 13 August 2019
, 13 August 2019no edit summary
No edit summary |
No edit summary |
||
| Line 1: | Line 1: | ||
{{DISPLAYTITLE:{{wip|Firefox Performance Results}}}} | {{DISPLAYTITLE:{{wip|Firefox Performance Results}}}} | ||
There are a variety of places where performance results are available, some of these can be queried directly, and others are dashboards built on top of those sources. | There are a variety of places where performance results are available, some of these can be queried directly, and others are dashboards built on top of those sources. | ||
| Line 6: | Line 5: | ||
{{todo|for now just gathering ideas}} | {{todo|for now just gathering ideas}} | ||
* Does my patch affect performance? | * Does my patch affect performance? | ||
** [[#Compare|Perfherder compare]] | |||
* Did my push affect performance? | * Did my push affect performance? | ||
** [[#Compare|Perfherder compare]] | |||
* How does Firefox compare against other browsers? | * How does Firefox compare against other browsers? | ||
** [[#Firefox Health|Firefox Health]] | |||
** [[#Firefox Performance Dashboard|Firefox Performance Dashboard]] | |||
* Are we meeting our goals? | * Are we meeting our goals? | ||
** [[#Firefox Health|Firefox Health]] | |||
* What performance tests are we running? | * What performance tests are we running? | ||
** [[#ActiveData|ActiveData]] | |||
* What platforms are we running performance tests against? | * What platforms are we running performance tests against? | ||
** [[#ActiveData|ActiveData]] | |||
= What do we have? = | = What do we have? = | ||
== ActiveData | == ActiveData == | ||
ActiveData is a collection of billions of records covering unit tests, jobs, performance data, and source code revision history | ActiveData is a collection of billions of records covering unit tests, jobs, performance data, and source code revision history. | ||
* Access: Public | * Access: Public | ||
* Audience: Engineers | * Audience: Engineers | ||
* Documentation: [[EngineeringProductivity/Projects/ActiveData]] | * Documentation: [[EngineeringProductivity/Projects/ActiveData]] | ||
* Issue tracker: https://bugzilla.mozilla.org/buglist.cgi?product=Testing&component=ActiveData&resolution=--- | * Issue tracker: https://bugzilla.mozilla.org/buglist.cgi?product=Testing&component=ActiveData&resolution=--- | ||
* Contact: Kyle Lahnakoski [ekyle] | * Contact: Kyle Lahnakoski [ekyle] | ||
=== Examples === | === Query Tool === | ||
The intended use for ActiveData is for automated clients or for building dashboards, however the query tool can be used for exploration. | |||
* Location: https://activedata.allizom.org/tools/query.html | |||
* Source code: https://github.com/mozilla/activedata | |||
==== Examples ==== | |||
* [https://activedata.allizom.org/tools/query.html#query_id=rqnxuVpf Performance frameworks] | * [https://activedata.allizom.org/tools/query.html#query_id=rqnxuVpf Performance frameworks] | ||
* [https://activedata.allizom.org/tools/query.html#query_id=rqnxuVpf Performance suites] | * [https://activedata.allizom.org/tools/query.html#query_id=rqnxuVpf Performance suites] | ||
* [https://activedata.allizom.org/tools/query.html#query_id=1dtPBeZR Performance suites running on Android hardware] | * [https://activedata.allizom.org/tools/query.html#query_id=1dtPBeZR Performance suites running on Android hardware] | ||
== | === Recipes === | ||
Due to the size and complexity of ActiveData, using it to answer everyday questions is not a straightforward task and the built-in query tool is often insufficient. ActiveData Recipes was created to provide an intuitive way to not only use ActiveData, but to save your queries for future use and share them with others. | Due to the size and complexity of ActiveData, using it to answer everyday questions is not a straightforward task and the built-in query tool is often insufficient. ActiveData Recipes was created to provide an intuitive way to not only use ActiveData, but to save your queries for future use and share them with others. | ||
* Location: https://adr-dev.herokuapp.com/ | * Location: https://adr-dev.herokuapp.com/ | ||
* Audience: Engineers, Managers | * Audience: Engineers, Managers | ||
* Documentation: https://active-data-recipes.readthedocs.io/ | * Documentation: https://active-data-recipes.readthedocs.io/ | ||
| Line 126: | Line 135: | ||
== Ad-hoc results == | == Ad-hoc results == | ||
Before performance tests are fully automated and integrated into our pipeline, we often run manual or semi-automated tests. These results are often presented in ways that don't fit into our existing reporting structures, such as spreadsheets or documents. The following list of links serves as a repository for these results: | |||
* [https://drive.google.com/drive/u/0/folders/1Px8gLDqVfFhJF_nv5nrmYom7DRBTOAYp Performance/Testing/Results] | |||
* [https://drive.google.com/drive/folders/11a90GH_xwcqwkcAmzCZAkwmQeuSoXA3n Performance/Projects/Desktop/Testing] | * [https://drive.google.com/drive/folders/11a90GH_xwcqwkcAmzCZAkwmQeuSoXA3n Performance/Projects/Desktop/Testing] | ||