|
|
| Line 23: |
Line 23: |
| * {{block|}} [https://moztrap.mozilla.org/manage/case/1372/ Verify update applies with root-owned files] ({{bug|789958}}) --> cannot automate | | * {{block|}} [https://moztrap.mozilla.org/manage/case/1372/ Verify update applies with root-owned files] ({{bug|789958}}) --> cannot automate |
| * {{done|}} [https://moztrap.mozilla.org/manage/case/1529/ Private Browsing data does not cache] ({{bug|787743}}) --> covered in [http://hg.mozilla.org/qa/mozmill-tests/file/tip/tests/functional/testPrivateBrowsing/testAboutCache.js mozmill] | | * {{done|}} [https://moztrap.mozilla.org/manage/case/1529/ Private Browsing data does not cache] ({{bug|787743}}) --> covered in [http://hg.mozilla.org/qa/mozmill-tests/file/tip/tests/functional/testPrivateBrowsing/testAboutCache.js mozmill] |
|
| |
| == Effect of Uplifts ==
| |
| === Point Release Drivers ===
| |
| * Firefox 23.0.1:
| |
| ** {{bug|901944}} caused by {{bug|847267}} which landed on mozilla-central on 2013-05-05 and rode the trains
| |
| ** {{bug|902532}} caused by {{bug|857830}} which landed on mozilla-central on 2013-05-07 and rode the trains
| |
| ** {{bug|901527}} caused by {{bug|886886}} which landed on mozilla-central on 2013-07-22 and was uplifted to mozilla-beta and mozilla-aurora after only 5 hours on Nightly
| |
| * Firefox 20.0.1:
| |
| ** {{bug|857291}} caused by {{bug|807678}} which landed on mozilla-central on 2012-12-24 and rode the trains
| |
| ** {{bug|846848}} caused by OS.File not being on QA's radar as it rode the trains
| |
|
| |
| === Landings per Channel ===
| |
| The following shows when a bug was fixed (based on the state of the status flag during the 6-week period).
| |
|
| |
| {| class="querytable" style="width:60%"
| |
| | class="header" style="width:10%" | Firefox Version
| |
| | class="header" style="width:10%" | Nightly
| |
| | class="header" style="width:10%" | Aurora
| |
| | class="header" style="width:10%" | Beta
| |
| | class="header" style="width:10%" | % Uplifts
| |
| | class="header" style="width:10%" | Point Releases
| |
| |-
| |
| | 10
| |
| | 113
| |
| | 170
| |
| | 128
| |
| | 73%
| |
| | 2
| |
| |-
| |
| | 11
| |
| | 90
| |
| | 713
| |
| | 283
| |
| | 92%
| |
| | 0
| |
| |-
| |
| | 12
| |
| | 356
| |
| | 332
| |
| | 150
| |
| | 58%
| |
| | 0
| |
| |-
| |
| | 13
| |
| | 207
| |
| | 316
| |
| | 214
| |
| | 72%
| |
| | 1
| |
| |-
| |
| | 14
| |
| | 306
| |
| | 506
| |
| | 279
| |
| | 72%
| |
| | 1
| |
| |-
| |
| | 15
| |
| | 340
| |
| | 563
| |
| | 381
| |
| | 74%
| |
| | 1
| |
| |-
| |
| | 16
| |
| | 397
| |
| | 460
| |
| | 275
| |
| | 65%
| |
| | 2
| |
| |-
| |
| | 17
| |
| | 353
| |
| | 563
| |
| | 420
| |
| | 75%
| |
| | 1
| |
| |-
| |
| | 18
| |
| | 532
| |
| | 1069
| |
| | 545
| |
| | 75%
| |
| | 2
| |
| |-
| |
| | 19
| |
| | 853
| |
| | 857
| |
| | 332
| |
| | 58%
| |
| | 2
| |
| |-
| |
| | 20
| |
| | 783
| |
| | 644
| |
| | 408
| |
| | 57%
| |
| | 1
| |
| |-
| |
| | 21
| |
| | 844
| |
| | 514
| |
| | 277
| |
| | 48%
| |
| | 0
| |
| |-
| |
| | 22
| |
| | 550
| |
| | 472
| |
| | 247
| |
| | 57%
| |
| | 0
| |
| |-
| |
| | 23
| |
| | 683
| |
| | 484
| |
| | 360
| |
| | 55%
| |
| | 1
| |
| |-
| |
| | 24
| |
| | 600
| |
| | 494
| |
| | 400
| |
| | 60%
| |
| | 0
| |
| |-
| |
| | '''Average'''
| |
| | '''467'''
| |
| | '''544'''
| |
| | '''313'''
| |
| | '''66%'''
| |
| | '''1'''
| |
| |}
| |
|
| |
| [[Image:QA_Metrics_Landings_per_Channel_20131015.png]]
| |
|
| |
| === Conclusions & Analysis ===
| |
| * Uplifts account for ~66% of all fixes going into a given release
| |
| * All versions requiring at least one point release occurred when uplifts accounted for 55% or more of the fixes
| |
| * All versions requiring at least two point releases occurred when uplifts accounted for ~60% or more of the fixes
| |
| * ''Hypothesis'': volume of landings is increasing instability (ie. likelihood of needing a follow-up release)
| |