MozillaWiki

Electrolysis/Multi Release Criteria: Difference between revisions

Page Discussion

Electrolysis/Multi Release Criteria (view source)

Revision as of 15:01, 23 May 2017

600 bytes removed ,  23 May 2017
m
→‎UI Smoothness
 
(33 intermediate revisions by 2 users not shown)
Line 20: Line 20:


1) We can't rely on Talos numbers generated in automation for beta builds. The default there is one content process. We'll have to use try runs of the beta code base to generate comparisons.
1) We can't rely on Talos numbers generated in automation for beta builds. The default there is one content process. We'll have to use try runs of the beta code base to generate comparisons.
2) 32-bit / 64-bit builds for Windows - which? both?
3) Probes we might want to add:
{| class="wikitable"
! COMPOSITOR_ANIMATION_MAX_CONTIGUOUS_DROPS_APZ
|style="width:300px;"|For APZ/scrolling compositor animations, the maximum number of contiguous frame drops encountered
|-
! COMPOSITOR_ANIMATION_MAX_CONTIGUOUS_DROPS_CHROME
| For compositor animations of chrome-process layers, the maximum number of contiguous frame drops encountered
|-
! COMPOSITOR_ANIMATION_MAX_CONTIGUOUS_DROPS_CONTENT
| For compositor animations of content-process layers, the maximum number of contiguous frame drops encountered
|-
! TIME_TO_NON_BLANK_PAINT_MS
| The time between navigation start and the first non-blank paint of a foreground root content document, in milliseconds. This only records documents that were in an active docshell throughout the whole time between navigation start and non-blank paint. The non-blank paint timestamp is taken during display list building and does not include rasterization or compositing of that paint.
|}


== AWSY Notes ==
== AWSY Notes ==
Line 88: Line 70:
! Regression(s)
! Regression(s)
| Blake Kaplan, Gabor Krizsanits
| Blake Kaplan, Gabor Krizsanits
|-
! Report Link
|[https://metrics.mozilla.com/protected/bmiroglio/multi/e10sMulti_experiment.html e10s-multi performance in Telemetry]
|}
|}


{| class="wikitable"
{| class="wikitable"
|-
|-
!rowspan="2"|Metric
!Metric
!rowspan="2"|Description
!Description
!rowspan="2"|Report Links
!Analysis By
!rowspan="2"|Analysis By
!Criteria Met?
!rowspan="1" colspan="2"|Results for Child Process Cohorts
!Criteria Met Signed-off By
!rowspan="2"|Criteria Met?
!rowspan="2"|Criteria Met Signed-off By
|-
! 1
! 4
|-
|-
| GC_MAX_PAUSE_MS
| GC_MAX_PAUSE_MS
| style="background-color: White;width:250px;" | Longest GC slice in a single GC cycle in milliseconds, broken down by parent and child process(es).
| style="background-color: White;width:250px;" | Longest GC slice in a single GC cycle in milliseconds, broken down by parent and child process(es).
| style="background-color: White;" | TBD
| style="background-color: White;" | ben/tracy
| style="background-color: White;" | TBD
| style="background-color: White;" |  
| style="background-color: White;" |  
Win: ?<br/>
Win: YES<br/>
OSX: ?<br/>
OSX: limited data<br/>
Linux: ?
Linux: limited data
| style="background-color: White;" |
Win: ?<br/>
OSX: ?<br/>
Linux: ?
| style="background-color: White;" | TBD
| style="background-color: White;" | TBD
| style="background-color: White;" | TBD
|-
|-
| CYCLE_COLLECTOR_MAX_PAUSE
| CYCLE_COLLECTOR_MAX_PAUSE
| style="background-color: White;width:250px;" | Longest pause for an individual slice of one cycle collection, including preparation in milliseconds, broken down by parent and child process(es).
| style="background-color: White;width:250px;" | Longest pause for an individual slice of one cycle collection, including preparation in milliseconds, broken down by parent and child process(es).
| style="background-color: White;" | TBD
| style="background-color: White;" | ben/tracy
| style="background-color: White;" | TBD
| style="background-color: White;" |
Win: ?<br/>
OSX: ?<br/>
Linux: ?
| style="background-color: White;" |  
| style="background-color: White;" |  
Win: ?<br/>
Win: YES<br/>
OSX: ?<br/>
OSX: limited data<br/>
Linux: ?
Linux: limited data
| style="background-color: White;" | TBD
| style="background-color: White;" | TBD
| style="background-color: White;" | TBD
|-
|-
| INPUT_EVENT_RESPONSE_MS
| INPUT_EVENT_RESPONSE_MS
| style="background-color: Tomato;width:250px;" | Time in milliseconds for input event lifetime (created -> fully handled) including traversal to a child process and back. (Need Chris Hutten to confirm this description.)
| style="background-color: White;width:250px;" | Time in milliseconds for input event lifetime (created -> fully handled) including traversal to a child process and back.  
| style="background-color: White;" | TBD
| style="background-color: White;" | ben/tracy
| style="background-color: White;" | TBD
| style="background-color: White;" |  
| style="background-color: White;" |  
Win: ?<br/>
Win: YES<br/>
OSX: ?<br/>
OSX: limited data<br/>
Linux: ?
Linux: limited data
| style="background-color: White;" |
Win: ?<br/>
OSX: ?<br/>
Linux: ?
| style="background-color: White;" | TBD
| style="background-color: White;" | TBD
| style="background-color: White;" | TBD
|-
|-
| FX_TAB_SWITCH_TOTAL_MS
| FX_TAB_SWITCH_TOTAL_MS
| style="background-color: White;width:250px;" | Time in milliseconds a tab switch takes, including first paint of the tab.
| style="background-color: White;width:250px;" | Time in milliseconds a tab switch takes, including first paint of the tab.
| style="background-color: White;" | TBD
| style="background-color: White;" | ben/tracy
| style="background-color: White;" | TBD
| style="background-color: White;" |  
| style="background-color: White;" |  
Win: ?<br/>
Win: YES<br/>
OSX: ?<br/>
OSX: limited data<br/>
Linux: ?
Linux: limited data
| style="background-color: White;" |
Win: ?<br/>
OSX: ?<br/>
Linux: ?
| style="background-color: White;" | TBD
| style="background-color: White;" | TBD
| style="background-color: White;" | TBD
|}
{| class="wikitable"
|-
!rowspan="2"|Metric
!rowspan="2"|Description
!rowspan="2"|Report Links
!rowspan="2"|Analysis By
!rowspan="1" colspan="2"|Results for Child Process Cohorts
!rowspan="2"|Criteria Met?
!rowspan="2"|Criteria Met Signed-off By
|-
! 1
! 4
|-
|-
| tp5o_responsiveness [https://treeherder.mozilla.org/perf.html#/graphs?timerange=604800&series=%5Btry,6be9b4d8231c4ed2bccfcc497c5af51317f67552,1,1%5D&highlightedRevisions=4aeff94a7fc8&highlightedRevisions=abd843dd9c40 graph]
| tp5o_responsiveness [https://treeherder.mozilla.org/perf.html#/graphs?timerange=604800&series=%5Btry,6be9b4d8231c4ed2bccfcc497c5af51317f67552,1,1%5D&highlightedRevisions=4aeff94a7fc8&highlightedRevisions=abd843dd9c40 graph]
| style="background-color: White;width:250px;" | TP5O Talos numbers, comparing current single process beta builds with try runs using the beta code base and four content processes.<br/>Targets: 64-bit opt/pgo builds
| style="background-color: White;width:250px;" | TP5O Talos numbers, comparing current single process beta builds with try runs using the beta code base and four content processes.<br/>Targets: 64-bit opt/pgo builds
| style="background-color: White;" | [https://treeherder.mozilla.org/perf.html#/compare?originalProject=try&originalRevision=4aeff94a7fc872e4716def28f89647fd0d0b4488&newProject=try&newRevision=abd843dd9c400aa08a06a64bf886e5fc972e407a&framework=1&filter=e10s&showOnlyImportant=0 Perherder Comparison]<br/>
| style="background-color: White;" | [https://treeherder.mozilla.org/perf.html#/compare?originalProject=try&originalRevision=96e5124a8a1c&newProject=try&newRevision=4c1f1a121337&framework=1&showOnlyImportant=0 Comparison 20170522]
run 5/9-5/10
[https://treeherder.mozilla.org/perf.html#/compare?originalProject=try&originalRevision=4aeff94a7fc872e4716def28f89647fd0d0b4488&newProject=try&newRevision=abd843dd9c400aa08a06a64bf886e5fc972e407a&framework=1&filter=e10s&showOnlyImportant=0 Comparison 20170510]
| style="background-color: White;" | tracy
| style="background-color: White;" | tracy
| style="background-color: White;" |  
| style="background-color: White;" |  
Win7 32bit: 6.93<br/>
Win7 32bit: 6.11<br/>
Win8 64bit: 5.13<br/>
Win8 64bit: 4.93<br/>
OSX: n/a<br/>
OSX: n/a<br/>
Linux: [https://treeherder.mozilla.org/perf.html#/graphs?series=%5Bmozilla-beta,8cba34a5b756cc4c005381526f637533c22f2f31,1,1%5D&selected=%5Bmozilla-beta,8cba34a5b756cc4c005381526f637533c22f2f31,198607,95684037%5D 4.58]
Linux: 4.55
| style="background-color: White;" |  
| style="background-color: White;" |  
Win7 32bit: 6.27<br/>
Win7 32bit: 6.25 (+2.39%)<br/>
Win8 64bit: 5.67<br/>
Win8 64bit: 4.86 (-1.40%)<br/>
OSX: n/a<br/>
OSX: n/a<br/>
Linux: 4.52
Linux: 4.52 (-0.59)
| style="background-color: #FFFF99;" | NO - pending investigation in {{bug|1362920}}
| style="background-color: #99FF99;" | YES - note: {{bug|1362920}}
| style="background-color: White;" | TBD
| style="background-color: White;" | TBD
|}
|}
Line 193: Line 163:
! Regression(s)
! Regression(s)
| Blake Kaplan, Gabor Krizsanits
| Blake Kaplan, Gabor Krizsanits
|-
! Report Link
|[https://metrics.mozilla.com/protected/bmiroglio/multi/e10sMulti_experiment.html e10s-multi performance in Telemetry]
|}
|}


{| class="wikitable"
{| class="wikitable"
|-
|-
!rowspan="2"|Metric
!Metric
!rowspan="2"|Description
!Description
!rowspan="2"|Report Links
!Analysis By
!rowspan="2"|Analysis By
!Criteria Met?
!rowspan="1" colspan="2"|Results for Child Process Cohorts
!Criteria Met Signed-off By
!rowspan="2"|Criteria Met?
!rowspan="2"|Criteria Met Signed-off By
|-
! 1
! 4
|-
|-
| FX_PAGE_LOAD_MS
| FX_PAGE_LOAD_MS
| style="background-color: White;width:250px;"|Time taken to load a page (ms). This includes all static contents, no dynamic content. Loading of about: pages is not counted.
| style="background-color: White;width:250px;"|Time taken to load a page (ms). This includes all static contents, no dynamic content. Loading of about: pages is not counted.
| style="background-color: White;" | TBD
| style="background-color: White;" | ben/tracy
| style="background-color: White;" | TBD
| style="background-color: White;" |  
| style="background-color: White;" |  
Win: ?<br/>
Win: YES<br/>
OSX: ?<br/>
OSX: limited data<br/>
Linux: ?
Linux: limited data
| style="background-color: White;" |
Win: ?<br/>
OSX: ?<br/>
Linux: ?
| style="background-color: White;" | TBD
| style="background-color: White;" | TBD
| style="background-color: White;" | TBD
|}
|}
Line 252: Line 214:
| TART [https://treeherder.mozilla.org/perf.html#/graphs?timerange=604800&series=%5Btry,f36eb8fccce4dc7259b699af75ddd07d63cd914e,1,1%5D&highlightedRevisions=4aeff94a7fc8&highlightedRevisions=abd843dd9c40 graph]
| TART [https://treeherder.mozilla.org/perf.html#/graphs?timerange=604800&series=%5Btry,f36eb8fccce4dc7259b699af75ddd07d63cd914e,1,1%5D&highlightedRevisions=4aeff94a7fc8&highlightedRevisions=abd843dd9c40 graph]
| Tab animation regression test (Talos).
| Tab animation regression test (Talos).
| style="background-color: White;" | [https://treeherder.mozilla.org/perf.html#/compare?originalProject=try&originalRevision=4aeff94a7fc872e4716def28f89647fd0d0b4488&newProject=try&newRevision=abd843dd9c400aa08a06a64bf886e5fc972e407a&framework=1&filter=e10s&showOnlyImportant=0 Perfherder Comparison]<br/>
| style="background-color: White;" | [https://treeherder.mozilla.org/perf.html#/compare?originalProject=try&originalRevision=96e5124a8a1c&newProject=try&newRevision=4c1f1a121337&framework=1&showOnlyImportant=0 20170522]
run 5/9-5/10
<br/>[https://treeherder.mozilla.org/perf.html#/compare?originalProject=try&originalRevision=4aeff94a7fc872e4716def28f89647fd0d0b4488&newProject=try&newRevision=abd843dd9c400aa08a06a64bf886e5fc972e407a&framework=1&filter=e10s&showOnlyImportant=0 20170510]
| style="background-color: White;" | tracy
| style="background-color: White;" | tracy
| style="background-color: White;" |  
| style="background-color: White;" |  
Win7 32bit: 7.34<br/>
Win7 32bit: 7.36<br/>
Win8 64bit: 6.26<br/>
Win8 64bit: 6.26<br/>
OSX: 11.22<br/>
OSX: 11.18<br/>
Linux: 6.29
Linux: 6.31
| style="background-color: White;" |  
| style="background-color: White;" |  
Win7 32bit: 7.35<br/>
Win7 32bit: 7.34 (-0.27%)<br/>
Win8 64bit: 6.25<br/>
Win8 64bit: 6.21 (-0.81%)<br/>
OSX: 11.17<br/>
OSX: 11.35 (+1.54%)<br/>
Linux: 6.27
Linux: 6.32 (+0.17%)
| style="background-color: #99FF99;" | YES
| style="background-color: #99FF99;" | YES
| style="background-color: White;" | TBD
| style="background-color: White;" | TBD
Line 270: Line 232:
| TPAINT [https://treeherder.mozilla.org/perf.html#/graphs?timerange=604800&highlightedRevisions=4aeff94a7fc8&highlightedRevisions=abd843dd9c40 graph]
| TPAINT [https://treeherder.mozilla.org/perf.html#/graphs?timerange=604800&highlightedRevisions=4aeff94a7fc8&highlightedRevisions=abd843dd9c40 graph]
| First paint for a new window (Talos).
| First paint for a new window (Talos).
| style="background-color: White;" | [https://treeherder.mozilla.org/perf.html#/compare?originalProject=try&originalRevision=4aeff94a7fc872e4716def28f89647fd0d0b4488&newProject=try&newRevision=abd843dd9c400aa08a06a64bf886e5fc972e407a&framework=1&filter=e10s&showOnlyImportant=0 Perfherder Comparison]<br/>
| style="background-color: White;" | [https://treeherder.mozilla.org/perf.html#/compare?originalProject=try&originalRevision=96e5124a8a1c&newProject=try&newRevision=4c1f1a121337&framework=1&showOnlyImportant=0 20170522]
run 5/9-5/10
<br/>[https://treeherder.mozilla.org/perf.html#/compare?originalProject=try&originalRevision=4aeff94a7fc872e4716def28f89647fd0d0b4488&newProject=try&newRevision=abd843dd9c400aa08a06a64bf886e5fc972e407a&framework=1&filter=e10s&showOnlyImportant=0 20170510]
| style="background-color: White;" | tracy
| style="background-color: White;" | tracy
| style="background-color: White;" |  
| style="background-color: White;" |  
Win7 32bit: 294.32<br/>
Win7 32bit: 298.80<br/>
Win8 64bit: 288.36<br/>
Win8 64bit: 283.82<br/>
OSX: 325.042<br/>
OSX: 323.16<br/>
Linux: 276.33
Linux: 277.12
| style="background-color: White;" |  
| style="background-color: White;" |  
Win7 32bit: 298.68<br/>
Win7 32bit: 296.06 (-0.92%)<br/>
Win8 64bit: 287.07<br/>
Win8 64bit: 287.60 (+1.33%)<br/>
OSX: 320.40<br/>
OSX: 322.43 (-0.23%)<br/>
Linux: 273.71
Linux: 277.34 (+0.08%)
| style="background-color: #99FF99;" | YES
| style="background-color: #99FF99;" | YES
| style="background-color: White;" | TBD
| style="background-color: White;" | TBD
Line 288: Line 250:
| TRESIZE [https://treeherder.mozilla.org/perf.html#/graphs?timerange=604800&series=%5Btry,4ac681a39a4caefb56468c5bc86fa23b8cee4c4f,1,1%5D&highlightedRevisions=4aeff94a7fc8&highlightedRevisions=abd843dd9c40 graph]
| TRESIZE [https://treeherder.mozilla.org/perf.html#/graphs?timerange=604800&series=%5Btry,4ac681a39a4caefb56468c5bc86fa23b8cee4c4f,1,1%5D&highlightedRevisions=4aeff94a7fc8&highlightedRevisions=abd843dd9c40 graph]
| Window resize responsiveness (Talos).
| Window resize responsiveness (Talos).
| style="background-color: White;" | [https://treeherder.mozilla.org/perf.html#/compare?originalProject=try&originalRevision=4aeff94a7fc872e4716def28f89647fd0d0b4488&newProject=try&newRevision=abd843dd9c400aa08a06a64bf886e5fc972e407a&framework=1&filter=e10s&showOnlyImportant=0 Perfherder Comparison]<br/>
| style="background-color: White;" | [https://treeherder.mozilla.org/perf.html#/compare?originalProject=try&originalRevision=96e5124a8a1c&newProject=try&newRevision=4c1f1a121337&framework=1&showOnlyImportant=0 20170522]
run 5/9-5/10
<br/>[https://treeherder.mozilla.org/perf.html#/compare?originalProject=try&originalRevision=4aeff94a7fc872e4716def28f89647fd0d0b4488&newProject=try&newRevision=abd843dd9c400aa08a06a64bf886e5fc972e407a&framework=1&filter=e10s&showOnlyImportant=0 20170510]
| style="background-color: White;" | tracy
| style="background-color: White;" | tracy
| style="background-color: White;" |  
| style="background-color: White;" |  
Win7 32bit: 11.91<br/>
Win7 32bit: 11.99<br/>
Win8 64bit: 10.62<br/>
Win8 64bit: 10.65<br/>
OSX: 28.69<br/>
OSX: 28.87<br/>
Linux: 23.01
Linux: 23.34
| style="background-color: White;" |  
| style="background-color: White;" |  
Win7 32bit: 11.93<br/>
Win7 32bit: 11.95 (-0.33%)<br/>
Win8 64bit: 10.63<br/>
Win8 64bit: 10.61 (-0.42%)<br/>
OSX: 28.82<br/>
OSX: 28.89 (+0.07%)<br/>
Linux: 23.59
Linux: 23.90 (+2.38%)
| style="background-color: #99FF99;" | YES
| style="background-color: #99FF99;" | YES
| style="background-color: White;" | TBD
| style="background-color: White;" | TBD
Line 316: Line 278:
! Regression(s)
! Regression(s)
| Blake Kaplan, Gabor Krizsanits
| Blake Kaplan, Gabor Krizsanits
|-
! Report Link
|[https://metrics.mozilla.com/protected/bmiroglio/multi/e10sMulti_experiment.html e10s-multi performance in Telemetry]
|}
|}


{| class="wikitable"
{| class="wikitable"
|-
|-
!rowspan="2"|Metric
!Metric
!rowspan="2"|Description
!Description
!rowspan="2"|Report Links
!Analysis By
!rowspan="2"|Analysis By
!Criteria Met?
!rowspan="1" colspan="2"|Results for Child Process Cohorts
!Criteria Met Signed-off By
!rowspan="2"|Criteria Met?
!rowspan="2"|Criteria Met Signed-off By
|-
! 1
! 4
|-
|-
| MEMORY_TOTAL
| MEMORY_TOTAL
| style="background-color: White;width:250px;"|  Total memory across all processes (KB).
| style="background-color: White;width:250px;"|  Total memory across all processes (KB).
| style="background-color: White;" | TBD
| style="background-color: White;" | ben/tracy
| style="background-color: White;" | TBD
| style="background-color: White;" |  
| style="background-color: White;" |  
Win: ?<br/>
Win: YES<br/>
OSX: ?<br/>
OSX: limited data<br/>
Linux: ?
Linux: limited data
| style="background-color: White;" |
Win: ?<br/>
OSX: ?<br/>
Linux: ?
| style="background-color: White;" | TBD
| style="background-color: White;" | TBD
| style="background-color: White;" | TBD
|-
|-
| MEMORY_VSIZE_MAX_CONTIGUOUS
| MEMORY_VSIZE_MAX_CONTIGUOUS
| style="background-color: White;width:250px;"| Maximum-sized block of contiguous virtual memory (KB).
| style="background-color: White;width:250px;"| Maximum-sized block of contiguous virtual memory (KB).
| style="background-color: White;" | TBD
| style="background-color: White;" | ben/tracy
| style="background-color: White;" | TBD
| style="background-color: White;" |
Win: ?<br/>
OSX: ?<br/>
Linux: ?
| style="background-color: White;" |  
| style="background-color: White;" |  
Win: ?<br/>
Win: YES<br/>
OSX: ?<br/>
OSX: limited data<br/>
Linux: ?
Linux: limited data
| style="background-color: White;" | TBD
| style="background-color: White;" | TBD
|-
| MEMORY_DISTRIBUTION_AMONG_CONTENT
| style="background-color: White;width:250px;"|  Absolute difference of each content process' USS and the mean of USS, normalized by the mean, as a percentage. Measure memory consumption distribution between content processes. We're looking for ugly numbers here while running with 4+ content processes. Does not apply to single content process configs.
| style="background-color: White;" | TBD
| style="background-color: White;" | TBD
| style="background-color: White;" | N/A
| style="background-color: White;" |
Win: ?<br/>
OSX: ?<br/>
Linux: ?
| style="background-color: White;" | TBD
| style="background-color: White;" | TBD
| style="background-color: White;" | TBD
|}
|}
Line 549: Line 485:
! Regression(s)
! Regression(s)
| Blake Kaplan, Gabor Krizsanits, Mike Conley
| Blake Kaplan, Gabor Krizsanits, Mike Conley
|-
! Report Link
|[https://metrics.mozilla.com/protected/bmiroglio/multi/e10sMulti_experiment.html e10s-multi performance in Telemetry]
|}
|}


{| class="wikitable"
{| class="wikitable"
|-
|-
!rowspan="2"|Metric
!Metric
!rowspan="2"|Description
!Description
!rowspan="2"|Report Links
!Analysis By
!rowspan="2"|Analysis By
!Criteria Met?
!rowspan="1" colspan="2"|Results for Child Process Cohorts
!Criteria Met Signed-off By
!rowspan="2"|Criteria Met?
!rowspan="2"|Criteria Met Signed-off By
|-
! 1
! 4
|-
|-
| FX_TAB_SWITCH_UPDATE_MS
| FX_TAB_SWITCH_UPDATE_MS
| style="background-color: White;width:250px;"| Time in ms spent updating UI in response to a tab switch.
| style="background-color: White;width:250px;"| Time in ms spent updating UI in response to a tab switch.
| style="background-color: White;" | TBD
| style="background-color: White;" | ben/tracy
| style="background-color: White;" | TBD
| style="background-color: White;" |  
| style="background-color: White;" |  
Win: ?<br/>
Win: YES<br/>
OSX: ?<br/>
OSX: limited data<br/>
Linux: ?
Linux: limited data
| style="background-color: White;" |
Win: ?<br/>
OSX: ?<br/>
Linux: ?
| style="background-color: White;" | TBD
| style="background-color: White;" | TBD
| style="background-color: White;" | TBD
|-
|-
| FX_TAB_SWITCH_TOTAL_E10S_MS
| FX_TAB_SWITCH_TOTAL_E10S_MS
| style="background-color: White;width:250px;"| Time in ms between tab selection and tab content paint.
| style="background-color: White;width:250px;"| Time in ms between tab selection and tab content paint.
| style="background-color: White;" | TBD
| style="background-color: White;" | ben/tracy
| style="background-color: White;" | TBD
| style="background-color: White;" |
Win: ?<br/>
OSX: ?<br/>
Linux: ?
| style="background-color: White;" |  
| style="background-color: White;" |  
Win: ?<br/>
Win: YES<br/>
OSX: ?<br/>
OSX: limited data<br/>
Linux: ?
Linux: limited data
| style="background-color: White;" | TBD
| style="background-color: White;" | TBD
| style="background-color: White;" | TBD
|-
|-
| FX_TAB_SWITCH_SPINNER_VISIBLE_MS
| FX_TAB_SWITCH_SPINNER_VISIBLE_MS
| style="background-color: White;width:250px;"| Time in ms spent updating UI in response to a tab switch.
| style="background-color: White;width:250px;"| Time in ms spent updating UI in response to a tab switch.
| style="background-color: White;" | TBD
| style="background-color: White;" | ben/tracy
| style="background-color: White;" | TBD
| style="background-color: White;" |  
| style="background-color: White;" |  
Win: ?<br/>
Win: YES<br/>
OSX: ?<br/>
OSX: limited data<br/>
Linux: ?
Linux: limited data
| style="background-color: White;" |
Win: ?<br/>
OSX: ?<br/>
Linux: ?
| style="background-color: White;" | TBD
| style="background-color: White;" | TBD
| style="background-color: White;" | TBD
|-
|-
| FX_TAB_SWITCH_SPINNER_VISIBLE_LONG_MS
| FX_TAB_SWITCH_SPINNER_VISIBLE_LONG_MS
| style="background-color: White;width:250px;"| If the spinner interstitial displays during tab switching, records the time in ms the graphic is visible. This probe is similar to FX_TAB_SWITCH_SPINNER_VISIBLE_MS, but is for truly degenerate cases.
| style="background-color: White;width:250px;"| If the spinner interstitial displays during tab switching, records the time in ms the graphic is visible. This probe is similar to FX_TAB_SWITCH_SPINNER_VISIBLE_MS, but is for truly degenerate cases.
| style="background-color: White;" | TBD
| style="background-color: White;" | ben/tracy
| style="background-color: White;" | TBD
| style="background-color: White;" |  
| style="background-color: White;" |  
Win: ?<br/>
Win: YES<br/>
OSX: ?<br/>
OSX: limited data<br/>
Linux: ?
Linux: limited data
| style="background-color: White;" |
Win: ?<br/>
OSX: ?<br/>
Linux: ?
| style="background-color: White;" | TBD
| style="background-color: White;" | TBD
|-
| FX_TAB_REMOTE_NAVIGATION_DELAY_MS<br/>
| style="background-color: White;width:250px;"| Time taken in milliseconds between the browser sending a naviagion event to content and content receiving it. This message can be either SessionStore:restoreTabContent or WebNavigation:LoadURI and these names are used as keys for this histogram. This is e10s only and recorded in the content process. Measures delays associated with child process creation. [https://telemetry.mozilla.org/new-pipeline/dist.html#!arch=x86&cumulative=0&e10s=true&end_date=2017-05-16&keys=WebNavigation%253ALoadURI!SessionStore%253ArestoreTabContent!__none__!__none__&max_channel_version=beta%252F54&measure=FX_TAB_REMOTE_NAVIGATION_DELAY_MS&min_channel_version=nightly%252F55&processType=*&product=Firefox&sanitize=0&sort_keys=submissions&start_date=2017-04-20&table=0&trim=0&use_submission_date=0 TELEMETRY LINK]
| style="background-color: White;" | ben/tracy
| style="background-color: lightgreen;" |
Win: [https://telemetry.mozilla.org/new-pipeline/dist.html#!arch=x86&cumulative=0&e10s=true&end_date=2017-05-15&keys=WebNavigation%253ALoadURI!SessionStore%253ArestoreTabContent!__none__!__none__&max_channel_version=beta%252F54&measure=FX_TAB_REMOTE_NAVIGATION_DELAY_MS&min_channel_version=beta%252F51&os=Windows_NT&processType=*&product=Firefox&sanitize=1&sort_keys=submissions&start_date=2017-05-04&table=0&trim=1&use_submission_date=0 YES]<br/>
OSX: [https://telemetry.mozilla.org/new-pipeline/dist.html#!arch=x86-64!x86&cumulative=0&e10s=true&end_date=2017-05-15&keys=WebNavigation%253ALoadURI!SessionStore%253ArestoreTabContent!__none__!__none__&max_channel_version=beta%252F54&measure=FX_TAB_REMOTE_NAVIGATION_DELAY_MS&min_channel_version=beta%252F51&os=Darwin&processType=*&product=Firefox&sanitize=1&sort_keys=submissions&start_date=2017-05-04&table=0&trim=1&use_submission_date=0 YES]<br/>
Linux: [https://telemetry.mozilla.org/new-pipeline/dist.html#!arch=x86-64!x86&cumulative=0&e10s=true&end_date=2017-05-16&keys=WebNavigation%253ALoadURI!SessionStore%253ArestoreTabContent!__none__!__none__&max_channel_version=beta%252F54&measure=FX_TAB_REMOTE_NAVIGATION_DELAY_MS&min_channel_version=beta%252F51&os=Linux&processType=*&product=Firefox&sanitize=1&sort_keys=submissions&start_date=2017-05-04&table=0&trim=1&use_submission_date=0 YES]
| style="background-color: White;" | TBD
| style="background-color: White;" | TBD
|}
{| class="wikitable"
|-
|-
| FX_TAB_REMOTE_NAVIGATION_DELAY_MS
!rowspan="2"|Metric
| style="background-color: White;width:250px;"| Time taken in milliseconds between the browser sending a naviagion event to content and content receiving it. This message can be either SessionStore:restoreTabContent or WebNavigation:LoadURI and these names are used as keys for this histogram. This is e10s only and recorded in the content process. Measures delays associated with child process creation.
!rowspan="2"|Description
| style="background-color: White;" | TBD
!rowspan="2"|Report Links
| style="background-color: White;" | TBD
!rowspan="2"|Analysis By
| style="background-color: White;" |  
!rowspan="1" colspan="2"|Results for Child Process Cohorts
Win: ?<br/>
!rowspan="2"|Criteria Met?
OSX: ?<br/>
!rowspan="2"|Criteria Met Signed-off By
Linux: ?
|-
| style="background-color: White;" |  
! 1
Win: ?<br/>
! 4
OSX: ?<br/>
Linux: ?
| style="background-color: White;" | TBD
| style="background-color: White;" | TBD
|-
|-
| TPS Test
| TPS Test [https://treeherder.mozilla.org/perf.html#/graphs?timerange=604800&series=%5Btry,d96c356354e1d01835f87142841749ee6d353184,1,1%5D&highlightedRevisions=4aeff94a7fc8&highlightedRevisions=abd843dd9c40 graph]
| Tab switch timing (Talos)
| Tab switch timing (Talos)
| style="background-color: White;" | [https://treeherder.mozilla.org/perf.html#/compare?originalProject=try&originalRevision=4aeff94a7fc872e4716def28f89647fd0d0b4488&newProject=try&newRevision=abd843dd9c400aa08a06a64bf886e5fc972e407a&framework=1&filter=e10s&showOnlyImportant=0 Perfherder Comparison]<br/>
| style="background-color: White;" | [https://treeherder.mozilla.org/perf.html#/compare?originalProject=try&originalRevision=96e5124a8a1c&newProject=try&newRevision=4c1f1a121337&framework=1&showOnlyImportant=0 20170522]
run 5/9-5/10
<br/>[https://treeherder.mozilla.org/perf.html#/compare?originalProject=try&originalRevision=4aeff94a7fc872e4716def28f89647fd0d0b4488&newProject=try&newRevision=abd843dd9c400aa08a06a64bf886e5fc972e407a&framework=1&filter=e10s&showOnlyImportant=0 20170510]
| style="background-color: White;" | tracy
| style="background-color: White;" | tracy
| style="background-color: White;" |  
| style="background-color: White;" |  
Win7 32bit: 26.89<br/>
Win7-32bit: 26.87<br/>
Win8 64bit: 24.54<br/>
Win8-64bit: 24.06<br/>
OSX: 28.20<br/>
OSX: 29.39<br/>
Linux: 29.37
Linux: 29.74
| style="background-color: White;" |  
| style="background-color: White;" |  
Win7 32bit: 27.24<br/>
Win7-32bit: 28.80 (+10.92%)<br/>
Win8 64bit: 24.52<br/>
Win8-64bit: 22.83 (-5.11%)<br/>
OSX: 31.11<br/>
OSX: 25.48 (-13.30%)<br/>
Linux: 29.47
Linux: 28.66 (-3.65%)
| style="background-color: #FFFF99;" | NO - OS X is showing a 10% regression that may actually be related to {{bug|1362920}} (even though that bug is listed as Win7, I think it may affect all Win and Mac)
| style="background-color: #99FF99;" | YES - note: {{bug|1362920}}
| style="background-color: White;" | TBD
| style="background-color: White;" | TBD
|}
|}
Line 669: Line 587:
! Regression(s)
! Regression(s)
| Blake Kaplan, Gabor Krizsanits
| Blake Kaplan, Gabor Krizsanits
|-
! Report Link
|[https://metrics.mozilla.com/protected/bmiroglio/multi/e10sMulti_experiment.html e10s-multi performance in Telemetry]
|}
|}


{| class="wikitable"
{| class="wikitable"
|-
|-
!rowspan="2"|Metric
!Metric
!rowspan="2"|Description
!Description
!rowspan="2"|Report Links
!Analysis By
!rowspan="2"|Analysis By
!Criteria Met?
!rowspan="1" colspan="2"|Results for Child Process Cohorts
!Criteria Met Signed-off By
!rowspan="2"|Criteria Met?
!rowspan="2"|Criteria Met Signed-off By
|-
! 1
! 4
|-
|-
| SLOW_SCRIPT_NOTICE_COUNT
| SLOW_SCRIPT_NOTICE_COUNT
| style="background-color: White;width:250px;"| Total count of slow script notices displayed to user.
| style="background-color: White;width:250px;"| Total count of slow script notices displayed to user.
| style="background-color: White;" | TBD
| style="background-color: White;" | ben/tracy
| style="background-color: White;" | TBD
| style="background-color: #FFFF99;" |  
| style="background-color: White;" |
Win: YES<br/>
Win: ?<br/>
OSX: limited data<br/>
OSX: ?<br/>
Linux: no data
Linux: ?
| style="background-color: White;" |  
Win: ?<br/>
OSX: ?<br/>
Linux: ?
| style="background-color: White;" | TBD
| style="background-color: White;" | TBD
| style="background-color: White;" | TBD
|-
|-
| SLOW_SCRIPT_PAGE_COUNT
| SLOW_SCRIPT_PAGE_COUNT
| style="background-color: White;width:250px;"| The number of pages that trigger slow script notices.
| style="background-color: White;width:250px;"| The number of pages that trigger slow script notices.
| style="background-color: White;" | TBD
| style="background-color: White;" | ben/tracy
| style="background-color: White;" | TBD
| style="background-color: #FFFF99;" |  
| style="background-color: White;" |
Win: YES<br/>
Win: ?<br/>
OSX: limited data<br/>
OSX: ?<br/>
Linux: no data
Linux: ?
| style="background-color: White;" |  
Win: ?<br/>
OSX: ?<br/>
Linux: ?
| style="background-color: White;" | TBD
| style="background-color: White;" | TBD
| style="background-color: White;" | TBD
|-
|-
| SLOW_SCRIPT_NOTIFY_DELAY
| SLOW_SCRIPT_NOTIFY_DELAY
| style="background-color: White;width:250px;"| The difference between the js slow script timeout for content set in prefs and the actual time we waited before displaying the notification in milliseconds.
| style="background-color: White;width:250px;"| The difference between the js slow script timeout for content set in prefs and the actual time we waited before displaying the notification in milliseconds.
| style="background-color: White;" | TBD
| style="background-color: White;" | ben/tracy
| style="background-color: White;" | TBD
| style="background-color: #FFFF99;" |  
| style="background-color: White;" |
Win: YES<br/>
Win: ?<br/>
OSX: limited data<br/>
OSX: ?<br/>
Linux: no data
Linux: ?
| style="background-color: White;" |  
Win: ?<br/>
OSX: ?<br/>
Linux: ?
| style="background-color: White;" | TBD
| style="background-color: White;" | TBD
| style="background-color: White;" | TBD
|}
|}
Line 760: Line 658:
|-
|-
! Accountable
! Accountable
| SoftVision
| SoftVision / tracy
|-
|-
! Sign Off
! Sign Off
| SoftVision / Jeff Griffiths
| Jeff Griffiths / tracy
|}
|}


Line 776: Line 674:
| Tracy
| Tracy
| style="background-color: LightGreen;" | Done
| style="background-color: LightGreen;" | Done
| style="background-color: LightGreen;" | Tracy
| style="background-color: LightGreen;" | tracy
|-
|-
| [https://wiki.mozilla.org/QA/e10s_Multi Execute test plan]
| [https://wiki.mozilla.org/QA/e10s_Multi Execute test plan]
| Tracy, Ben M, SV
| Tracy, Ben M, SV
| style="background-color: LightYellow;" | In progress
| style="background-color: LightGreen;" | on going perf testing.  so far so good
| style="background-color: White;" | TBD
| style="background-color: white;" | tbd
|}
|}
Twalker
Confirmed users
4,072

edits

Retrieved from "https://wiki.mozilla.org/Special:MobileDiff/1170975...1171816"