Electrolysis/Multi Release Criteria

Page to collect and track Electrolysis Multi Process release criteria.

Rollout Criteria

We plan to ship e10s-multi in Firefox 54/55 using a staged rollout.
See elan's e10s-multi release plan.

• Stability dashboards:
  • e10s-multi
    • Firefox 54 Release <- Need link to telemetry report
    • Firefox 54 Beta <- Need link to telemetry report
    • "M+(c-s)" is the metric that matters: main (chrome) process crash rate + content process crash rate - content process shutdown crash rate.
  • e10s
    • Firefox 48 Release
    • Firefox 48 Beta

Release Criteria

Stability

Responsible	jimm
Accountable	chutten

Description	Metric	e10s Analysis	Analysis By	e10s value	e10s-multi value	Criteria Met?	Criteria Met Signed-off By
chrome + content crash rate	(chrome + (content - content shutdown termination crash reports) ) / 1000 use hours	"M+(c-s)" on 48 Beta Update Link here	TBD	5.20 crashes/khour	TBD	TBD	TBD

Crash rates exclude XP and deprecated OS X operating systems

• More information on Stability analysis

Jank

Responsible	Gabor
Accountable	chutten

Description	Metric	e10s Analysis	e10s-multi Analysis	Analysis By	Criteria Met?	Criteria Met Signed-off By
GC pauses	GC_MAX_PAUSE_MS (parent, children)	beta 46 experiment	TBD	TBD	TBD	TBD
Cycle Collector pauses	CYCLE_COLLECTOR_MAX_PAUSE (parent, children)	beta 46 experiment	TBD	TBD	TBD	TBD
Event loop lag	INPUT_EVENT_RESPONSE_MS	beta 46 experiment Nightly 48 telemetry	TBD	TBD	TBD	TBD
Browser responsiveness during page load	Tab paint test	N/A	Need bug	TBD	TBD	TBD
FX_TAB_SWITCH_TOTAL_MS	TBD	beta 46 experiment Need updated link	52.66 ms (median) < 82.61 ms (median)	TBD	TBD	TBD

• More information on Jank analysis
• Jank analysis meta bug 1251377

Page Load

Responsible	jimm
Accountable	TBD

Metric	Analysis	Analysis By	e10s value	e10s-multi value	Criteria Met?	Criteria Met Signed-off By
FX_PAGE_LOAD_MS ±5%	beta 46 experiment (bug 1228020) Need updated link	TBD	e10s is much better.	TBD	TBD	TBD

• More information on Page Load analysis
• Page Load analysis meta bug 1251549

Memory Usage

Responsible	Blake
Accountable	erahm

Metric	Analysis	e10s value	e10s-multi value	Criteria Met?	Criteria Met Signed-off By
MEMORY_TOTAL ±25% (browser + content process)	beta 46 experiment and erahm's blog post Need updated link(s)		TBD	TBD	TBD
VSIZE_MAX_CONTIGUOUS (browser + content process)	beta 46 experiment Need updated link		TBD	TBD	TBD
Additional Metric(s) Needed? - process count 2, 4 and 8 data comparisons? - AWSY?

• We expect e10s-multi MEMORY_TOTAL to regress compared to e10s because we are using more processes.
• erahm's blog post: Memory Usage of Firefox with e10s Enabled

Slow Scripts

Responsible	jimm
Accountable	chutten

Description	Metric	Analysis	Analysis By	e10s value	e10s-multi value	Criteria Met?	Criteria Met Signed-off By
Slow script warnings	SLOW_SCRIPT_PAGE_COUNT	beta 47 experiment Need updated link	TBD	0.00158655016424 warnings per use hour (aka 630 hours/warning) (bug 1260769)	TBD	TBD	TBD

• More information on slow script analysis
• Slow script analysis meta bug 1251545

Tests

All unit tests disabled for e10s-multi must be triaged and:

• re-enabled (and fixed, if necessary)
• or annotated that the test is irrelevant for e10s-multi
• or deleted

We want each test directory to be signed-off by the feature area's owner.

Responsible	e10s - Blake, GaboR
Accountable

• e10s-multi test meta bug 1315042
• Perfherder e10s dashboard <- Need updated link

Task	Owner	Criteria Met?	Criteria Met Signed-off By
Write test plan	Tracy	In progress: almost done (based on this doc triage)	TBD
Execute test plan	Tracy, SV	In progress	TBD
Re-enable disabled e10s tests	Gabor, Blake	In progress	TBD

Release Blocking Bugs

All M9 bugs must be fixed before we release.

Responsible	jimm
Accountable	gabor

• Bugzilla query for e10s blocking bugs: is.gd/e10s_blockers

M9 bugs

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);

Release Criteria bugs

Need updated bug list

Bugzilla query error

Query options must be valid JSON.1

APZ Bugs

Need updated bug list

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);

Accessibility

• Accessibility (a11y) does not block the initial release of e10s because e10s will only be enabled for users not using a11y.

Add-ons

• Add-on support does not block the initial release of e10s because e10s will only be enabled for users without add-ons.

Service Workers

• ???