Firefox Core Engineering/Get More Data Faster: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(created)
 
(added banner)
 
(12 intermediate revisions by 2 users not shown)
Line 1: Line 1:
{{FirefoxCoreEngineering_banner}}
This effort is establish a shorter path between client crashes and actionable data.
This effort is establish a shorter path between client crashes and actionable data.


== Step 1==
==Step 1: in progress==
# Land content crash ping (enables new crash ping types)​.​ [end of Q4 2016]
# <strike>Land content crash ping (enables new crash ping types)​.​ [end of Q4 2016]</strike> '''completed: {{Bugzilla|1293656}}'''
# Determine how to report on unsymbolicated stack in crash pings (we want to identify what we can answer from the data we collect now, without aggregating and without symbolicating)​.​ [mid-January 2017]
# <strike>Determine how to report on unsymbolicated stack in crash pings (we want to identify what we can answer from the data we collect now, without aggregating and without symbolicating)​.​ [mid-January 2017]</strike>
# Scale/load test the new symbolapi.m.o (we want to know if this will serve its current function AND a future function for release users)​. [mid-January 2017]
# <strike>Scale/load test the new symbolapi.m.o (we want to know if this will serve its current function AND a future function for release users)​. [mid-January 2017]</strike> '''This has been abandoned in favor of a rewrite led by peterbe.'''
# Determine if we can include frame pointers on release (because it enables future steps). [end of Q4 2016]​
# <strike>Determine if we can include frame pointers on release (because it enables future steps). [end of Q4 2016]​</strike> '''completed: {{Bugzilla|1322735}}'''
# <strike>Add support for CFI-based stack-walking</strike> '''completed: {{Bugzilla|1333126}}'''
# Re-engineer the crash handling code '''in progress: {{Bugzilla|1323979}}'''
# Add support for getting client-side stacks traces Fennec '''in progress: {{Bugzilla|1307153}}'''


== Step 2==
==Step 2: in progress==
# Land the CrashSender (so we can send a crash ping as soon as possible)​. [mid-January 2017]​
# <strike>Land the pingSender (so we can send a crash ping as soon as possible)​. [mid-January 2017]</strike> '''completed​: {{Bugzilla|1310703}}'''
# Symbolicate crash ping stacks either via batch in data processing or client-side -- depending on the outcome of Step 1.3 and 1.4.​ [TBD]​
# Symbolicate crash ping stacks via batch in data processing. --together with--
# <strike>Create "client-side" signatures from symbolicated stacks via batch in data processing.</strike>​ '''completed: {{Bugzilla|1357431}}'''


==Step 3==
==Step 3==
# Create "client-side" signatures -- depending on Step 2.2 (whether the stacks in crash pings are symbolicated or not) and Step 1.2 (whether we need to establish these signatures in a data source or in a process on the ping itself).​ [TBD]​
# Implement clustering of crashes on the client-side, based on signatures. [TBD]
# Possibly introduce new crash ping types (gpu, etc).​ [TBD]​
# Establish means of identifying top crashers in client-side data via signatures. [TBD]
# Enable correlating between client-side crash clusters and crash-stats-side crash clusters, via client crash id (see {{Bugzilla|1322611}}). [TBD]


==Step 4==
==Step 4==
# Implement clustering of crashes on the client-side (probably based on signatures) -- depending on Step 3.1. [TBD]
# Symbolicate crash ping stacks on the client, via https://symbolserver.mozilla.org/symbolicate (see peterbe). [TBD]
# Return signatures to the client, via a signature service. [TBD]


==Step 5==
==Step 5==
# Allow for correlating between client-side crash clusters and crash-stats-side crash clusters. [TBD]
# Introduce new crash ping types beyond Main and Content (GPU ({{Bugzilla|1297843}} and {{Bugzilla|1352496}}), webextension, etc). [TBD]

Latest revision as of 22:01, 5 February 2018

Stop (medium size).png
The Firefox Core Engineering (FCE) team ran from March 2016 through January 2018. All work on that team has been dispersed to other teams.

This page should be considered legacy.

For more information on previously-FCE activities, go by individuals listed in Historical knowledge areas. (If you're in a pinch, ask ddurst.)

This effort is establish a shorter path between client crashes and actionable data.

Step 1: in progress

  1. Land content crash ping (enables new crash ping types)​.​ [end of Q4 2016] completed: 1293656
  2. Determine how to report on unsymbolicated stack in crash pings (we want to identify what we can answer from the data we collect now, without aggregating and without symbolicating)​.​ [mid-January 2017]
  3. Scale/load test the new symbolapi.m.o (we want to know if this will serve its current function AND a future function for release users)​. [mid-January 2017] This has been abandoned in favor of a rewrite led by peterbe.
  4. Determine if we can include frame pointers on release (because it enables future steps). [end of Q4 2016]​ completed: 1322735
  5. Add support for CFI-based stack-walking completed: 1333126
  6. Re-engineer the crash handling code in progress: 1323979
  7. Add support for getting client-side stacks traces Fennec in progress: 1307153

Step 2: in progress

  1. Land the pingSender (so we can send a crash ping as soon as possible)​. [mid-January 2017] completed​: 1310703
  2. Symbolicate crash ping stacks via batch in data processing. --together with--
  3. Create "client-side" signatures from symbolicated stacks via batch in data processing.​ completed: 1357431

Step 3

  1. Implement clustering of crashes on the client-side, based on signatures. [TBD]
  2. Establish means of identifying top crashers in client-side data via signatures. [TBD]
  3. Enable correlating between client-side crash clusters and crash-stats-side crash clusters, via client crash id (see 1322611). [TBD]

Step 4

  1. Symbolicate crash ping stacks on the client, via https://symbolserver.mozilla.org/symbolicate (see peterbe). [TBD]
  2. Return signatures to the client, via a signature service. [TBD]

Step 5

  1. Introduce new crash ping types beyond Main and Content (GPU (1297843 and 1352496), webextension, etc). [TBD]
Retrieved from "https://wiki.mozilla.org/index.php?title=Firefox_Core_Engineering/Get_More_Data_Faster&oldid=1188548"