CrashKill: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
Line 13: Line 13:
==Top Crashes==
==Top Crashes==


There are a number of bug queries that we triage regularly in order to stay on top of issues. Finding reproducible steps and helping us make them actionable will have a direct and in many cases significant impact on our users due to the volume involved. Not all bugs are fixes in our code. Many are 3rd party issues that can be resolved through outreach and/or blocklisting.
There are a number of reports that we triage regularly in order to stay on top of issues, most notably the topcrash reports as linked in the front page of Socorro crash-stats (see top links in the Reports & Tools section of this page). Finding reproducible steps and helping us make them actionable will have a direct and in many cases significant impact on our users due to the volume involved. Not all bugs are fixes in our code. Many are 3rd party issues that can be resolved through outreach and/or blocklisting.
 
===Firefox Desktop===
* Top crash lists
**[http://bit.ly/vO7SxB Top crashes]
**[http://bit.ly/xa8sDH Reproducible top crashes]
**[http://bit.ly/z0wY8v Top hangs]
**[https://bugzilla.mozilla.org/buglist.cgi?keywords=topcrash&keywords_type=allwords&field0-0-0=status_whiteboard&type0-0-1=notsubstring&field0-0-1=status_whiteboard&resolution=---&status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=startupcrash&value0-0-1=%5Bmobile-crash%5D&type0-0-0=notsubstring&value0-0-0=%5Bnative-crash%5D&product=Core&product=Firefox&product=Toolkit&list_id=6869062 Startup top crashes]
**[http://bit.ly/yrvVAY Reproducible crashes]
**[https://bugzilla.mozilla.org/buglist.cgi?keywords=crash%2C%20testcase&type0-1-0=notsubstring&keywords_type=allwords&field0-0-0=status_whiteboard&type0-0-0=notsubstring&value0-0-0=%5Bnative-crash%5D&resolution=---&query_format=advanced&product=Core&product=Firefox&product=Toolkit&list_id=6869124 Crashes with testcase]
**[[CrashKill/TopCrashBlocklist]]
 
* Other notable crash queries
**[http://bit.ly/GDK8v2 Unconfirmed crashes]
**[http://bit.ly/GLDEXZ Crash regressions]
 
===Firefox Metro===
* Top crash lists (may overlap desktop)
**[https://bugzilla.mozilla.org/buglist.cgi?keywords=topcrash-metro&keywords_type=allwords&list_id=9405510&resolution=---&query_format=advanced Top crashes]
**[https://bugzilla.mozilla.org/buglist.cgi?keywords=topcrash-metro%20reproducible&keywords_type=allwords&list_id=9405557&resolution=---&query_format=advanced Reproducible top crashes]
 
===Firefox Mobile===
* Top crash lists
**[http://bit.ly/tr4pBc Top crashes]
**[https://bugzilla.mozilla.org/buglist.cgi?keywords=topcrash%2C%20reproducible&keywords_type=allwords&resolution=---&status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=%5Bnative-crash%5D&product=Core&product=Firefox%20for%20Android&list_id=6869268 Reproducible top crashes]
**[https://bugzilla.mozilla.org/buglist.cgi?keywords=crash%2C%20reproducible&keywords_type=allwords&resolution=---&status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=%5Bnative-crash%5D&product=Core&product=Firefox%20for%20Android&list_id=6869223 Reproducible crashes]
**[https://bugzilla.mozilla.org/buglist.cgi?keywords=crash%2C%20testcase&keywords_type=allwords&resolution=---&status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=%5Bnative-crash%5D&product=Core&product=Firefox%20for%20Android&list_id=6869254 Crashes with testcase]
* Other notable crash queries
**[https://bugzilla.mozilla.org/buglist.cgi?keywords=crash%2C%20regression&keywords_type=allwords&resolution=---&status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=%5Bnative-crash%5D&product=Core&product=Firefox%20for%20Android&list_id=6869306 Crash regressions]
 
==== Contribute! ====
* [https://wiki.mozilla.org/CrashKill/Mobile_Process Bug Processing for Mobile]
 
===Firefox OS===
* Top crash lists
**[https://bugzilla.mozilla.org/buglist.cgi?keywords=topcrash&keywords_type=allwords&resolution=---&status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=%5Bb2g-crash%5D&list_id=6868997 Top crashes]
 
===Tracking a particular release===
* Firefox Desktop & Mobile
**[https://bugzilla.mozilla.org/buglist.cgi?keywords=crash&keywords_type=allwords&resolution=---&resolution=FIXED&query_format=advanced&f1=cf_status_firefox23&o1=notequals&v1=fixed&f2=cf_status_firefox23&o2=notequals&v2=verified&f3=cf_status_firefox23&o3=notequals&v3=unaffected&field0-0-0=cf_tracking_firefox23&type0-0-0=equals&value0-0-0=%2B&list_id=6954997 Tracking Firefox 23]
**[https://bugzilla.mozilla.org/buglist.cgi?keywords=crash&keywords_type=allwords&resolution=---&resolution=FIXED&query_format=advanced&f1=cf_status_firefox24&o1=notequals&v1=fixed&f2=cf_status_firefox24&o2=notequals&v2=verified&f3=cf_status_firefox24&o3=notequals&v3=unaffected&field0-0-0=cf_tracking_firefox24&type0-0-0=equals&value0-0-0=%2B&list_id=6955004 Tracking Firefox 24]
**[https://bugzilla.mozilla.org/buglist.cgi?keywords=crash&keywords_type=allwords&resolution=---&resolution=FIXED&query_format=advanced&f1=cf_status_firefox25&o1=notequals&v1=fixed&f2=cf_status_firefox25&o2=notequals&v2=verified&f3=cf_status_firefox25&o3=notequals&v3=unaffected&field0-0-0=cf_tracking_firefox25&type0-0-0=equals&value0-0-0=%2B&list_id=6955007 Tracking Firefox 25]
**[https://bugzilla.mozilla.org/buglist.cgi?keywords=crash&keywords_type=allwords&resolution=---&resolution=FIXED&query_format=advanced&f1=cf_status_firefox26&o1=notequals&v1=fixed&f2=cf_status_firefox26&o2=notequals&v2=verified&f3=cf_status_firefox26&o3=notequals&v3=unaffected&field0-0-0=cf_tracking_firefox26&type0-0-0=equals&value0-0-0=%2B&list_id=7542075 Tracking Firefox 26]
 
**[https://bugzilla.mozilla.org/buglist.cgi?keywords=crash&keywords_type=allwords&resolution=---&resolution=FIXED&query_format=advanced&f1=cf_status_firefox34&o1=notequals&v1=fixed&f2=cf_status_firefox33&o2=notequals&v2=verified&f3=cf_status_firefox33&o3=notequals&v3=unaffected&field0-0-0=cf_tracking_firefox33&type0-0-0=equals&value0-0-0=%2B&list_id=7542075 Tracking Firefox 33]
 
**[https://bugzilla.mozilla.org/buglist.cgi?keywords=crash&keywords_type=allwords&resolution=---&resolution=FIXED&query_format=advanced&f1=cf_status_firefox34&o1=notequals&v1=fixed&f2=cf_status_firefox34&o2=notequals&v2=verified&f3=cf_status_firefox34&o3=notequals&v3=unaffected&field0-0-0=cf_tracking_firefox34&type0-0-0=equals&value0-0-0=%2B&list_id=7542075 Tracking Firefox 34]
 
* Firefox Metro
**[https://bugzilla.mozilla.org/showdependencytree.cgi?id=855294&hide_resolved=1 Tracking Firefox for Metro]
* Firefox Mobile
**[https://bugzilla.mozilla.org/buglist.cgi?keywords=crash&keywords_type=allwords&resolution=---&resolution=FIXED&query_format=advanced&f1=cf_status_firefox23&o1=notequals&v1=fixed&f2=cf_status_firefox23&o2=notequals&v2=verified&f3=cf_status_firefox23&o3=notequals&v3=unaffected&f4=cf_blocking_fennec&o4=equals&v4=23%2B&list_id=6955060 Tracking Firefox for Android 23]
**[https://bugzilla.mozilla.org/buglist.cgi?keywords=crash&keywords_type=allwords&resolution=---&resolution=FIXED&query_format=advanced&f1=cf_status_firefox24&o1=notequals&v1=fixed&f2=cf_status_firefox24&o2=notequals&v2=verified&f3=cf_status_firefox24&o3=notequals&v3=unaffected&f4=cf_blocking_fennec&o4=equals&v4=24%2B&list_id=6955069 Tracking Firefox for Android 24]
**[https://bugzilla.mozilla.org/buglist.cgi?keywords=crash&keywords_type=allwords&resolution=---&resolution=FIXED&query_format=advanced&f1=cf_status_firefox25&o1=notequals&v1=fixed&f2=cf_status_firefox25&o2=notequals&v2=verified&f3=cf_status_firefox25&o3=notequals&v3=unaffected&f4=cf_blocking_fennec&o4=equals&v4=25%2B&list_id=6955076 Tracking Firefox for Android 25]
**[https://bugzilla.mozilla.org/buglist.cgi?keywords=crash&keywords_type=allwords&resolution=---&resolution=FIXED&query_format=advanced&f1=cf_status_firefox26&o1=notequals&v1=fixed&f2=cf_status_firefox26&o2=notequals&v2=verified&f3=cf_status_firefox26&o3=notequals&v3=unaffected&f4=cf_blocking_fennec&o4=equals&v4=26%2B&list_id=7542090 Tracking Firefox for Android 26]
* Firefox OS
** [https://bugzilla.mozilla.org/buglist.cgi?keywords=crash&keywords_type=allwords&resolution=---&resolution=FIXED&query_format=advanced&f1=cf_status_b2g18&o1=notequals&v1=fixed&f2=cf_status_b2g18&o2=notequals&v2=verified&o3=notequals&f3=cf_status_b2g18&v3=unaffected&f4=cf_blocking_b2g&o4=equals&v4=leo%2B&list_id=6955197 Tracking 1.1 leo]
** [https://bugzilla.mozilla.org/buglist.cgi?keywords=crash&keywords_type=allwords&resolution=---&resolution=FIXED&query_format=advanced&f1=cf_status_b2g18&o1=notequals&v1=fixed&f2=cf_status_b2g18&o2=notequals&v2=verified&o3=notequals&f3=cf_status_b2g18&v3=unaffected&f4=cf_blocking_b2g&o4=equals&v4=hd%2B&list_id=6955214 Tracking 1.1 HD]


== Reports & Tools ==
== Reports & Tools ==

Revision as of 15:17, 16 September 2014

General Agenda

Crashkill team works to track and escalate stability issues for both Desktop and Mobile products. Our activities include....

  • Track general stability for all our releases and development channels.
  • Triage Top Crashes to find owners, set priorities, and identify vender outreach issues.
  • Ensure that crash bugs are logged and updated with new information.
  • Identify top tools issues so we can find & fix faster.
  • Identify the first thing we want to do to increase developer awareness and commitment to fixing top crashers.
  • Identify the first thing we want to automate.
  • Working with the Socorro team to get features on the roadmap that help us find and diagnose crash bugs better.
  • Set topcrash threshold criteria.

Top Crashes

There are a number of reports that we triage regularly in order to stay on top of issues, most notably the topcrash reports as linked in the front page of Socorro crash-stats (see top links in the Reports & Tools section of this page). Finding reproducible steps and helping us make them actionable will have a direct and in many cases significant impact on our users due to the volume involved. Not all bugs are fixes in our code. Many are 3rd party issues that can be resolved through outreach and/or blocklisting.

Reports & Tools

Mozilla collects crash data which can be easily viewed using Socorro (a web interface to the crash reports). We use Socorro and its numerous reports to monitor stability rates on a daily basis.


We also have a list of additional reports that we have developed to help us understand certain crashes and trends. We plan over time to integrate these into Socorro and most of these are on the roadmap already.

Planning

  • CrashKill/Plan
  • We are actively working with the Socorro team on a list of priorities for getting features into Socorro that will help crash analysis. We update the list quarterly.

Stability Related Projects

Crash Analysis

We have been doing some analysis on fixed crash bugs to better understand how they get fixed. Our results are compiled in this spreadsheet.

Specific Mac version crashes

Triage

Work Weeks

Weekly Crashkill Meetings

We meet each week to talk about stability issues across releases and channels.

Logistics

  • Monday @ 10:00am PT
  • Mozilla office conference rooms:
    • Mountain View: Stargate SG-1, 2nd floor
    • San Francisco: Noise Pop, 7th floor
    • Toronto: High Park
  • Vidyo: Stability (Guest URL)
  • Phone: 650-903-0800 or 650-215-1282 x92 Conf# 98200 (US/INTL) or 1-800-707-2533 (pin 369) Conf# 98200 (US)
  • Back channel: #crashkill on irc.mozilla.org
  • Meeting notes & queries: https://wiki.mozilla.org/CrashKill#Meeting_notes

<createbox> align=left type=create preload=CrashKill/CrashKill-Template default=2026-01-05 prefix=CrashKill/ </createbox>

Meeting notes

2014

2013

2012

Newsletter

Old Stuff