342
edits
TestEngineering/Performance/FAQ: Difference between revisions
Jump to navigation
Jump to search
TestEngineering/Performance/FAQ (view source)
Revision as of 14:22, 14 February 2020
, 14 February 2020→Multi Modal
Alexandrui (talk | contribs) |
Alexandrui (talk | contribs) |
||
| Line 237: | Line 237: | ||
This affects the Talos Sheriff because on Monday when our volume of pushes picks up, we get a larger range of values. Due to the way we calculate a regression, it means that we see a shift in our expected range on Monday. Usually these alerts are generated Monday evening/Tuesday morning. These are typically small regressions (<3%) and on the noisier tests. | This affects the Talos Sheriff because on Monday when our volume of pushes picks up, we get a larger range of values. Due to the way we calculate a regression, it means that we see a shift in our expected range on Monday. Usually these alerts are generated Monday evening/Tuesday morning. These are typically small regressions (<3%) and on the noisier tests. | ||
== | == What is a multi-modal test? == | ||
Many tests are bi-modal or multi-modal. This means that they have a consistent set of values, but 2 or 3 of them. Instead of having a bunch of scattered values between the low and high, you will have 2 values, the lower one and the higher one. | Many tests are bi-modal or multi-modal. This means that they have a consistent set of values, but 2 or 3 of them. Instead of having a bunch of scattered values between the low and high, you will have 2 values, the lower one and the higher one. | ||