Electrolysis/Multi Release Criteria
Page to collect and track Electrolysis Multi Process release criteria.
Rollout Criteria
We plan to ship e10s-multi in Firefox 54/55 using a staged rollout.
See elan's e10s-multi release plan.
- Stability dashboards:
- e10s Multi Reports
- Firefox 54 Release <- Need link to telemetry report
- Firefox 54 Beta <- Need link to telemetry report
- "M+(c-s)" is the metric that matters: main (chrome) process crash rate + content process crash rate - content process shutdown crash rate.
- e10s Release Reports
- e10s Multi Reports
Release Criteria
Stability
| Responsible | Jim Mathies |
|---|---|
| Accountable | Ben Miroglio |
| Metric | Description | Report Links | Analysis By | Results for Child Process Cohorts | Criteria Met? | Criteria Met Signed-off By | |
|---|---|---|---|---|---|---|---|
| 1 | 4 | ||||||
| Crash Rate | (chrome crashes + (content process(es) - content process(es) shutdown termination crash reports)) / 1000 use hours | TBD | TBD | TBD | TBD | TBD | TBD |
Jank
| Responsible | Jim Mathies |
|---|---|
| Accountable | Ben Miroglio |
| Metric | Description | Report Links | Analysis By | Results for Child Process Cohorts | Criteria Met? | Criteria Met Signed-off By | |
|---|---|---|---|---|---|---|---|
| 1 | 4 | ||||||
| GC_MAX_PAUSE_MS | Longest GC slice in a single GC cycle in milliseconds, broken down by parent and child process(es). | TBD | TBD | TBD | TBD | TBD | TBD |
| CYCLE_COLLECTOR_MAX_PAUSE | Longest pause for an individual slice of one cycle collection, including preparation in milliseconds, broken down by parent and child process(es). | TBD | TBD | TBD | TBD | TBD | TBD |
| INPUT_EVENT_RESPONSE_MS | Time in milliseconds for input event lifetime (created -> fully handled) including traversal to a child process and back. (Need Chris Hutten to confirm this description.) | TBD | TBD | TBD | TBD | TBD | TBD |
| FX_TAB_SWITCH_TOTAL_MS | Time in milliseconds a tab switch takes, including first paint of the tab. | TBD | TBD | TBD | TBD | TBD | TBD |
| Talos tp5o_responsiveness | Questions: 1) Do we need a new perfherder page for comparing non-e10s with e10s? (E10s dashboard: Perfherder) 2) What's the default process count under e10s for beta Talos? |
TBD | TBD | TBD | TBD | TBD | TBD |
Page Load
| Responsible | Jim Mathies |
|---|---|
| Accountable | Ben Miroglio |
| Metric | Description | Report Links | Analysis By | Results for Child Process Cohorts | Criteria Met? | Criteria Met Signed-off By | |
|---|---|---|---|---|---|---|---|
| 1 | 4 | ||||||
| FX_PAGE_LOAD_MS ±5% | Time taken to load a page (ms). This includes all static contents, no dynamic content. Loading of about: pages is not counted. | TBD | TBD | TBD | TBD | TBD | TBD |
Memory Usage
| Responsible | Jim Mathies |
|---|---|
| Accountable | Ben Miroglio |
| Metric | Description | Report Links | Analysis By | Results for Child Process Cohorts | Criteria Met? | Criteria Met Signed-off By | |
|---|---|---|---|---|---|---|---|
| 1 | 4 | ||||||
| MEMORY_TOTAL | Total Memory Across All Processes (KB). Question: what is an acceptable regression here when comparing browser using 1 content process vs. 4? How should we measure / compare the numbers? (Jeff Griffiths) |
TBD | TBD | TBD | TBD | TBD | TBD |
| MEMORY_VSIZE_MAX_CONTIGUOUS | Maximum-sized block of contiguous virtual memory (KB). | TBD | TBD | TBD | TBD | TBD | TBD |
| Are We Slim Yet | Need an explanation of what this is and a link to the dashboard / test result. | TBD | TBD | TBD | TBD | TBD | TBD |
- erahm's blog post: Memory Usage of Firefox with e10s Enabled
Slow Scripts
| Responsible | Jim Mathies |
|---|---|
| Accountable | Ben Miroglio |
| Metric | Description | Report Links | Analysis By | Results for Child Process Cohorts | Criteria Met? | Criteria Met Signed-off By | |
|---|---|---|---|---|---|---|---|
| 1 | 4 | ||||||
| SLOW_SCRIPT_NOTICE_COUNT | Total count of slow script notices displayed to user. | TBD | TBD | TBD | TBD | TBD | TBD |
| SLOW_SCRIPT_PAGE_COUNT | The number of pages that trigger slow script notices. | TBD | TBD | TBD | TBD | TBD | TBD |
| SLOW_SCRIPT_NOTIFY_DELAY | The difference between the js slow script timeout for content set in prefs and the actual time we waited before displaying the notification in milliseconds. | TBD | TBD | TBD | TBD | TBD | TBD |
Tests
All unit tests disabled for e10s-multi must be triaged and:
- re-enabled (and fixed, if necessary)
- or annotated that the test is irrelevant for e10s-multi
- or deleted
We want each test directory to be signed-off by the feature area's owner.
| Responsible | Blake, Gabor |
|---|---|
| Accountable |
- e10s-multi test meta bug 1315042
- Perfherder e10s dashboard <- Need updated link
| Task | Owner | Criteria Met? | Criteria Met Signed-off By |
|---|---|---|---|
| Write test plan | Tracy | Done | Tracy |
| Execute test plan | Tracy, SV | In progress | TBD |
| Re-enable disabled e10s tests | Gabor, Blake | In progress | TBD |