Confirmed users
514
edits
Regression Testing: Difference between revisions
Jump to navigation
Jump to search
Formatting
(Information from Thunderbird:Testing/Regression) |
(Formatting) |
||
| Line 7: | Line 7: | ||
However, to do anything, we need a "regression range", and we need your help for that. The idea is to find a 1-day range of changes that broke things for you, which limits the amount of changes to look at. For that, you need to look at the nightlies and test a number of them. | However, to do anything, we need a "regression range", and we need your help for that. The idea is to find a 1-day range of changes that broke things for you, which limits the amount of changes to look at. For that, you need to look at the nightlies and test a number of them. | ||
= How to find a regression range using nightly builds = | |||
# Find the last nightly that works and first nightly that breaks. Do a so-called "binary search", e.g. try March 1 (works) and March 30 (fails), then the middle, i.e. March 15 (works), then again the middle, i.e. March 22 (fails), March 18 (works), March 20 (fails), March 19 (works). Now you know that it broke between March 19 and March 20. | # Find the last nightly that works and first nightly that breaks. Do a so-called "binary search", e.g. try March 1 (works) and March 30 (fails), then the middle, i.e. March 15 (works), then again the middle, i.e. March 22 (fails), March 18 (works), March 20 (fails), March 19 (works). Now you know that it broke between March 19 and March 20. | ||