Electrolysis/Multi Release Criteria

Page to collect and track Electrolysis Multi Process release criteria.

Rollout Criteria

We plan to ship e10s-multi in Firefox 54/55 using a staged rollout.
See elan's e10s-multi release plan.

• Stability dashboards:
  • e10s-multi
    • Firefox 54 Release <- Need link to telemetry report
    • Firefox 54 Beta <- Need link to telemetry report
    • "M+(c-s)" is the metric that matters: main (chrome) process crash rate + content process crash rate - content process shutdown crash rate.
  • e10s
    • Firefox 48 Release
    • Firefox 48 Beta

Release Criteria

Stability

Responsible	jimm
Accountable	chutten

Description	Metric	e10s Analysis	Analysis By	e10s value	e10s-multi value	Criteria Met?	Criteria Met Signed-off By
chrome + content crash rate	(chrome + (content - content shutdown termination crash reports) ) / 1000 use hours	"M+(c-s)" on 48 Beta Update Link here	TBD	5.20 crashes/khour	TBD	TBD	TBD

Crash rates exclude XP and deprecated OS X operating systems

• More information on Stability analysis

Jank

Responsible	Gabor
Accountable	chutten

Description	Metric	e10s Analysis	e10s-multi Analysis	Analysis By	Criteria Met?	Criteria Met Signed-off By
GC pauses	GC_MAX_PAUSE_MS (parent, children)	beta 46 experiment	TBD	TBD	TBD	TBD
Cycle Collector pauses	CYCLE_COLLECTOR_MAX_PAUSE (parent, children)	beta 46 experiment	TBD	TBD	TBD	TBD
Event loop lag	INPUT_EVENT_RESPONSE_MS	beta 46 experiment Nightly 48 telemetry	TBD	TBD	TBD	TBD
Browser responsiveness during page load	Tab paint test	N/A	Need bug	TBD	TBD	TBD
FX_TAB_SWITCH_TOTAL_MS	TBD	beta 46 experiment Need updated link	52.66 ms (median) < 82.61 ms (median)	TBD	TBD	TBD

• More information on Jank analysis
• Jank analysis meta bug 1251377

Page Load

Responsible	jimm
Accountable	TBD

Metric	Analysis	Analysis By	e10s value	e10s-multi value	Criteria Met?	Criteria Met Signed-off By
FX_PAGE_LOAD_MS ±5%	beta 46 experiment (bug 1228020) Need updated link	TBD	e10s is much better.	TBD	TBD	TBD

• More information on Page Load analysis
• Page Load analysis meta bug 1251549

Memory Usage

Responsible	Gabor
Accountable	erahm

Metric	Analysis	e10s value	e10s-multi value	Criteria Met?	Criteria Met Signed-off By
MEMORY_TOTAL ±25% (browser + content process)	beta 46 experiment and erahm's blog post Need updated link(s)		TBD	TBD	TBD
VSIZE_MAX_CONTIGUOUS (browser + content process)	beta 46 experiment Need updated link		TBD	TBD	TBD
Additional Metric(s) Needed? - process count 2, 4 and 8 data comparisons? - AWSY?

• We expect e10s-multi MEMORY_TOTAL to regress compared to e10s because we are using more processes.
• erahm's blog post: Memory Usage of Firefox with e10s Enabled

Slow Scripts

Responsible	jimm
Accountable	chutten

Description	Metric	Analysis	Analysis By	e10s value	e10s-multi value	Criteria Met?	Criteria Met Signed-off By
Slow script warnings	SLOW_SCRIPT_PAGE_COUNT	beta 47 experiment Need updated link	TBD	0.00158655016424 warnings per use hour (aka 630 hours/warning) (bug 1260769)	TBD	TBD	TBD

• More information on slow script analysis
• Slow script analysis meta bug 1251545

Tests

All unit tests disabled for e10s-multi must be triaged and:

• re-enabled (and fixed, if necessary)
• or annotated that the test is irrelevant for e10s-multi
• or deleted

We want each test directory to be signed-off by the feature area's owner.

Responsible	e10s - Blake, GaboR
Accountable

• e10s-multi test meta bug 1315042
• Perfherder e10s dashboard <- Need updated link

Task	Owner	Criteria Met?	Criteria Met Signed-off By
Write test plan	Tracy	In progress: almost done (based on this doc triage)	TBD
Execute test plan	Tracy, SV	In progress	TBD
Re-enable disabled e10s tests	Gabor, Blake	In progress	TBD