QA/Desktop Firefox/Releases: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
Line 23: Line 23:
* {{block|}} [https://moztrap.mozilla.org/manage/case/1372/ Verify update applies with root-owned files] ({{bug|789958}}) --> cannot automate
* {{block|}} [https://moztrap.mozilla.org/manage/case/1372/ Verify update applies with root-owned files] ({{bug|789958}}) --> cannot automate
* {{done|}} [https://moztrap.mozilla.org/manage/case/1529/ Private Browsing data does not cache] ({{bug|787743}}) --> covered in [http://hg.mozilla.org/qa/mozmill-tests/file/tip/tests/functional/testPrivateBrowsing/testAboutCache.js mozmill]
* {{done|}} [https://moztrap.mozilla.org/manage/case/1529/ Private Browsing data does not cache] ({{bug|787743}}) --> covered in [http://hg.mozilla.org/qa/mozmill-tests/file/tip/tests/functional/testPrivateBrowsing/testAboutCache.js mozmill]
== Effect of Uplifts ==
=== Point Release Drivers ===
* Firefox 23.0.1:
** {{bug|901944}} caused by {{bug|847267}} which landed on mozilla-central on 2013-05-05 and rode the trains
** {{bug|902532}} caused by {{bug|857830}} which landed on mozilla-central on 2013-05-07 and rode the trains
** {{bug|901527}} caused by {{bug|886886}} which landed on mozilla-central on 2013-07-22 and was uplifted to mozilla-beta and mozilla-aurora after only 5 hours on Nightly
* Firefox 20.0.1:
** {{bug|857291}} caused by {{bug|807678}} which landed on mozilla-central on 2012-12-24 and rode the trains
** {{bug|846848}} caused by OS.File not being on QA's radar as it rode the trains
=== Landings per Channel ===
The following shows when a bug was fixed (based on the state of the status flag during the 6-week period).
{| class="querytable" style="width:60%"
| class="header" style="width:10%" | Firefox Version
| class="header" style="width:10%" | Nightly
| class="header" style="width:10%" | Aurora
| class="header" style="width:10%" | Beta
| class="header" style="width:10%" | % Uplifts
| class="header" style="width:10%" | Point Releases
|-
| 10
| 113
| 170
| 128
| 73%
| 2
|-
| 11
| 90
| 713
| 283
| 92%
| 0
|-
| 12
| 356
| 332
| 150
| 58%
| 0
|-
| 13
| 207
| 316
| 214
| 72%
| 1
|-
| 14
| 306
| 506
| 279
| 72%
| 1
|-
| 15
| 340
| 563
| 381
| 74%
| 1
|-
| 16
| 397
| 460
| 275
| 65%
| 2
|-
| 17
| 353
| 563
| 420
| 75%
| 1
|-
| 18
| 532
| 1069
| 545
| 75%
| 2
|-
| 19
| 853
| 857
| 332
| 58%
| 2
|-
| 20
| 783
| 644
| 408
| 57%
| 1
|-
| 21
| 844
| 514
| 277
| 48%
| 0
|-
| 22
| 550
| 472
| 247
| 57%
| 0
|-
| 23
| 683
| 484
| 360
| 55%
| 1
|-
| 24
| 600
| 494
| 400
| 60%
| 0
|-
| '''Average'''
| '''467'''
| '''544'''
| '''313'''
| '''66%'''
| '''1'''
|}
[[Image:QA_Metrics_Landings_per_Channel_20131015.png]]
=== Conclusions & Analysis ===
* Uplifts account for ~66% of all fixes going into a given release
* All versions requiring at least one point release occurred when uplifts accounted for 55% or more of the fixes
* All versions requiring at least two point releases occurred when uplifts accounted for ~60% or more of the fixes
* ''Hypothesis'': volume of landings is increasing instability (ie. likelihood of needing a follow-up release)

Revision as of 18:54, 7 February 2014

Regressions

Firefox 29

  • [ON TRACK] Excessive memory while loading PDF thumbnail view (bug 839548) --> automate via bug 851507

Firefox 20

  • [ON TRACK] Random, unpredictable behavior with multiple YouTube embeds (bug 833823) -->

Firefox 19

Firefox 17

Firefox 16

Firefox 15

Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Desktop_Firefox/Releases&oldid=920057"