QA/Desktop Firefox/Releases/Metrics: Difference between revisions

no edit summary
No edit summary
No edit summary
Line 1: Line 1:
https://docs.google.com/spreadsheet/ccc?key=0AmkRt0ylPb8zdHVUR292bEdXMTdaNl95Zm9TWkNJdHc&usp=sharing
* https://docs.google.com/a/mozilla.com/spreadsheets/d/1alrc8mxfFJNvpSeNvEqO0Pu78X4GM51lkML3IqlXg-4/edit#gid=0


Release Metrics:
= 2014 =
* Bugs by status
== April ==
* Reopened bugs
=== Stats ===
* Regressions
3821 bugs reported
* Topcrashes
* 3028 bugs confirmed
* Confirmed bugs
* 140 reported bugs wontfixed
* Top components by volume, regessions, topcrash
* 229 reported bugs were regressions
* Add charts to testplan for Fx28


= Firefox 28 =
1563 bugs fixed
== Bugs by Version ==
* 414 fixed bugs verified
<bugzilla>
* 140 fixed bugs reopened
{
* 251 fixed bugs in-testsuite
  "include_fields":"id,summary,status,resolution",
  "version":"28 branch",
  "cf_status_firefox28":"---",
  "f1":"op_sys",
  "o1":"nowordssubstr",
  "v1":"Android Gonk"
}
</bugzilla>


== Bugs by Status Flag ==
239 reported bugs were crashes
<bugzilla>
* 11 crashes were topcrashes
{
  "include_fields":"id,summary,status,resolution",
  "f1":"cf_status_firefox28",
  "o1":"nowordssubstr",
  "v1":"--- unaffected",
  "f2":"version",
  "o2":"nowordssubstr",
  "v2":"\"28 branch\"",
  "f3":"op_sys",
  "o3":"nowordssubstr",
  "v3":"Android Gonk"
}
</bugzilla>


= Firefox 27 =
203 patches were nominated to uplift
== Bugs by Version ==
* 165/168 Aurora uplifts approved
<bugzilla>
* 30/32 Beta uplifts approved
{
* 1/3 Release uplifts approved
  "include_fields":"id,summary,status,resolution",
  "version":"27 branch",
  "cf_status_firefox27":"---",
  "f1":"op_sys",
  "o1":"nowordssubstr",
  "v1":"Android Gonk"
}
</bugzilla>


== Bugs by Status Flag ==
=== Conclusions ===
<bugzilla>
* 10% fewer bugs reported
{
* 23% fewer regressions 
  "include_fields":"id,summary,status,resolution",
* 26% more crashes but 52% fewer topcrashes
  "f1":"cf_status_firefox27",
* 49% fewer uplifts
  "o1":"nowordssubstr",
  "v1":"--- unaffected",
  "f2":"version",
  "o2":"nowordssubstr",
  "v2":"\"27 branch\"",
  "f3":"op_sys",
  "o3":"nowordssubstr",
  "v3":"Android Gonk"
}
</bugzilla>
 
= Firefox 26 =
== Bugs by Version ==
<bugzilla>
{
  "include_fields":"id,summary,status,resolution",
  "version":"26 branch",
  "cf_status_firefox26":"---",
  "f1":"op_sys",
  "o1":"nowordssubstr",
  "v1":"Android Gonk"
}
</bugzilla>
 
== Bugs by Status Flag ==
<bugzilla>
{
  "include_fields":"id,summary,status,resolution",
  "f1":"cf_status_firefox26",
  "o1":"nowordssubstr",
  "v1":"--- unaffected",
  "f2":"version",
  "o2":"nowordssubstr",
  "v2":"\"26 branch\"",
  "f3":"op_sys",
  "o3":"nowordssubstr",
  "v3":"Android Gonk"
}
</bugzilla>
 
= Firefox 25 =
== Bugs by Version ==
<bugzilla>
{
  "include_fields":"id,summary,status,resolution",
  "version":"25 branch",
  "cf_status_firefox25":"---",
  "f1":"op_sys",
  "o1":"nowordssubstr",
  "v1":"Android Gonk"
}
</bugzilla>
 
== Bugs by Status Flag ==
<bugzilla>
{
  "include_fields":"id,summary,status,resolution",
  "f1":"cf_status_firefox25",
  "o1":"nowordssubstr",
  "v1":"--- unaffected",
  "f2":"version",
  "o2":"nowordssubstr",
  "v2":"\"25 branch\"",
  "f3":"op_sys",
  "o3":"nowordssubstr",
  "v3":"Android Gonk"
}
</bugzilla>
Confirmed users
14,525

edits