QA/Desktop Firefox/Releases

Regressions

Regression	Versions	Manual Coverage	Automation Coverage
bug 848663 Can’t update from FF19.0 to FF19.0.1	Firefox 19+	testcase	Nominated: bug 853147
bug 834667 Playing youtube video in html5 starts to leak memory	Firefox 19+	testcase	Nominated: bug 851502
bug 839548 Excessive memory while loading PDF thumbnail view	Pending bug fix	Pending bug fix	Nominated: bug 851507
bug 789958 Verify update applies with root-owned files	Firefox 15+	testcase	n/a - not automatable
bug 789422 What's New page on Firefox update	Firefox 16+	testcase	nominated
bug 650355: Stop accepting md5 hash algorithm	Firefox 16+	testcase	nominated
Mac OSX 10.8 code-signing	Firefox 17+	testcase	?
Breakpad end-to-end functionality	Firefox 17+	testcase	?
Mac OSX 32-bit mode compatibility	Firefox 17+	testcase	?
Mac OSX 10.5 De-support	Firefox 17+	testcase	?
bug 833823 Random, unpredictable behavior with multiple YouTube embeds	Firefox 20+	?	nominated
bug 787743 Private Browsing data does not cache	Firefox 15+	testcase	testcase

Metrics

Visualizations

Metric	Interpretations
	Number of reported bugs is relatively flat over time Number of confirmed bugs is up over time
	Verifying fixes is not keeping pace with patch landings
	Dips in ADIs coincide with spikes in unconfirmed bugs Verifications seem to have little effect on ADIs

Raw Data

Release	Updates	ADIs	Verified	Fixed	Affected	Wontfix	Unconfirmed	Reported	in-testsuite+
Firefox 19	2	96.789	278	833	166	122	361	1087	202
Firefox 18	2	106.071	318	694	243	143	340	1385	246
Firefox 17	1	72.758	287	396	173	132	579	1300	178
Firefox 16	2	108.437	137	283	128	176	388	1190	217
Firefox 15	1	102.702	185	261	84	99	415	1357	198
Firefox 14	1	97.377	144	219	85	86	367	1163	146
Firefox 13	1	89.853	177	169	91	74	479	1289	160
Firefox 12	0	97.323	169	176	88	74	450	1336	209
Firefox 11	0	94.203	164	120	88	96	426	1050	218
Firefox 10	2	88.823	80	159	95	84	546	1418	239

Dashboard, Spreadsheet