QA/Desktop Firefox/Releases/Effect Of Uplifts

From MozillaWiki
Jump to: navigation, search

Effect of Uplifts

Point Release Drivers

  • Firefox 23.0.1:
    • bug 901944 caused by bug 847267 which landed on mozilla-central on 2013-05-05 and rode the trains
    • bug 902532 caused by bug 857830 which landed on mozilla-central on 2013-05-07 and rode the trains
    • bug 901527 caused by bug 886886 which landed on mozilla-central on 2013-07-22 and was uplifted to mozilla-beta and mozilla-aurora after only 5 hours on Nightly
  • Firefox 20.0.1:
    • bug 857291 caused by bug 807678 which landed on mozilla-central on 2012-12-24 and rode the trains
    • bug 846848 caused by OS.File not being on QA's radar as it rode the trains

Landings per Channel

The following shows when a bug was fixed (based on the state of the status flag during the 6-week period).

Firefox Version Nightly Aurora Beta  % Uplifts Point Releases
10 113 170 128 73% 2
11 90 713 283 92% 0
12 356 332 150 58% 0
13 207 316 214 72% 1
14 306 506 279 72% 1
15 340 563 381 74% 1
16 397 460 275 65% 2
17 353 563 420 75% 1
18 532 1069 545 75% 2
19 853 857 332 58% 2
20 783 644 408 57% 1
21 844 514 277 48% 0
22 550 472 247 57% 0
23 683 484 360 55% 1
24 600 494 400 60% 0
Average 467 544 313 66% 1

QA Metrics Landings per Channel 20131015.png

Conclusions & Analysis

  • Uplifts account for ~66% of all fixes going into a given release
  • All versions requiring at least one point release occurred when uplifts accounted for 55% or more of the fixes
  • All versions requiring at least two point releases occurred when uplifts accounted for ~60% or more of the fixes
  • Hypothesis: volume of landings is increasing instability (ie. likelihood of needing a follow-up release)