Confirmed users
3,376
edits
(initial alerts faq) |
m (→Why does Alert Manager print -xx%: - minor cleanup) |
||
| Line 34: | Line 34: | ||
= Why does Alert Manager print -xx% = | = Why does Alert Manager print -xx% = | ||
The alert will either be a regression or an improvement. For the alerts we show by default, it is regressions only. It is important to know the severity of an alert. For example a 3% regression is important to understand, but a 30% regression probably needs to be fixed ASAP. | The alert will either be a regression or an improvement. For the alerts we show by default, it is regressions only. It is important to know the severity of an alert. For example a 3% regression is important to understand, but a 30% regression probably needs to be fixed ASAP. This is annotated as a XX% in the UI. We use -XX% to denote a regression, and for the improvement alerts it is +XX%. | ||
NOTE: for the reverse tests we take that into account, so whenever there is a -XX%, that is the percent of the regression. | NOTE: for the reverse tests we take that into account, so whenever there is a -XX%, that is the percent of the regression. | ||