342
edits
TestEngineering/Performance/Glossary: Difference between revisions
Jump to navigation
Jump to search
TestEngineering/Performance/Glossary (view source)
Revision as of 07:55, 9 January 2020
, 9 January 2020→Nudge
Alexandrui (talk | contribs) |
Alexandrui (talk | contribs) (→Nudge) |
||
| Line 35: | Line 35: | ||
Some tests will post results in a small range, and when we get a data point significantly outside the range, it is easy to identify. | Some tests will post results in a small range, and when we get a data point significantly outside the range, it is easy to identify. | ||
The problem is that many tests have a large range of expected results. It makes it hard to determine what a regression is when we might have a range += 4% from the median and we have a 3% regression. It is obvious in the graph over time, but hard to tell until you have many future data points. | The problem is that many tests have a large range of expected results. It makes it hard to determine what a regression is when we might have a range += 4% from the median and we have a 3% regression. It is obvious in the graph over time, but hard to tell until you have many future data points. | ||
== Perf Sheriff == | == Perf Sheriff == | ||