Electrolysis/Multi Release Criteria: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(slow script updates)
(testing entries updates)
Line 255: Line 255:


== Tests ==
== Tests ==
{| class="wikitable"
! Responsible
| Blake Kaplan / Gabor Kriszanits
|-
! Accountable
| Blake Kaplan
|-
! Sign Off
| Module Owners / Jeff Griffiths
|}


All unit tests disabled for e10s-multi must be triaged and:
All unit tests disabled for e10s-multi must be triaged and:
Line 263: Line 274:


We want each test directory to be signed-off by the feature area's owner.
We want each test directory to be signed-off by the feature area's owner.
* e10s-multi test meta {{bug|1315042}}
== QA Test Plan ==


{| class="wikitable"
{| class="wikitable"
! Responsible
! Responsible
| Blake, Gabor<br>
| Erin Lancaster
|-
|-
! Accountable
! Accountable
|  
| SoftVision
|-
! Sign Off
| SoftVision / Jeff Griffiths
|}
|}
* e10s-multi test meta {{bug|1315042}}
* [https://treeherder.mozilla.org/perf.html#/e10s Perfherder e10s dashboard] '''<span style="color:#9932cc"> <- Need updated link</span>'''


{| class="wikitable"
{| class="wikitable"
Line 290: Line 305:
| Tracy, SV
| Tracy, SV
| style="background-color: LightYellow;" | In progress
| style="background-color: LightYellow;" | In progress
| style="background-color: #b0e0e6;" | '''<span style="color:#9932cc"> TBD</span>'''
| style="background-color: White;" | TBD
|-
| Re-enable [https://bugzilla.mozilla.org/show_bug.cgi?id=1315042 disabled e10s tests]
| Gabor, Blake
| style="background-color: LightYellow;" | In progress
| style="background-color: #b0e0e6;" | '''<span style="color:#9932cc"> TBD</span>'''
|}
|}

Revision as of 14:33, 1 May 2017

Page to collect and track Electrolysis Multi Process release criteria.

Rollout Criteria

We plan to ship e10s-multi in Firefox 54/55 using a staged rollout.
See elan's e10s-multi release plan.

  • Stability dashboards:

Release Criteria

Stability

Responsible Jim Mathies
Accountable Ben Miroglio
Metric Description Report Links Analysis By Results for Child Process Cohorts Criteria Met? Criteria Met Signed-off By
1 4
Crash Rate (chrome crashes + (content process(es) - content process(es) shutdown termination crash reports)) / 1000 use hours TBD TBD TBD TBD TBD TBD

Jank

Responsible Jim Mathies
Accountable Ben Miroglio
Metric Description Report Links Analysis By Results for Child Process Cohorts Criteria Met? Criteria Met Signed-off By
1 4
GC_MAX_PAUSE_MS Longest GC slice in a single GC cycle in milliseconds, broken down by parent and child process(es). TBD TBD TBD TBD TBD TBD
CYCLE_COLLECTOR_MAX_PAUSE Longest pause for an individual slice of one cycle collection, including preparation in milliseconds, broken down by parent and child process(es). TBD TBD TBD TBD TBD TBD
INPUT_EVENT_RESPONSE_MS Time in milliseconds for input event lifetime (created -> fully handled) including traversal to a child process and back. (Need Chris Hutten to confirm this description.) TBD TBD TBD TBD TBD TBD
FX_TAB_SWITCH_TOTAL_MS Time in milliseconds a tab switch takes, including first paint of the tab. TBD TBD TBD TBD TBD TBD
Talos tp5o_responsiveness Questions:
1) Do we need a new perfherder page for comparing non-e10s with e10s? (E10s dashboard: Perfherder)
2) What's the default process count under e10s for beta Talos? 		TBD TBD TBD TBD TBD TBD

Page Load

Responsible Jim Mathies
Accountable Ben Miroglio
Metric Description Report Links Analysis By Results for Child Process Cohorts Criteria Met? Criteria Met Signed-off By
1 4
FX_PAGE_LOAD_MS ±5% Time taken to load a page (ms). This includes all static contents, no dynamic content. Loading of about: pages is not counted. TBD TBD TBD TBD TBD TBD

Memory Usage

Responsible Jim Mathies
Accountable Ben Miroglio
Metric Description Report Links Analysis By Results for Child Process Cohorts Criteria Met? Criteria Met Signed-off By
1 4
MEMORY_TOTAL Total Memory Across All Processes (KB).
Question: what is an acceptable regression here when comparing browser using 1 content process vs. 4? How should we measure / compare the numbers? (Jeff Griffiths) 		TBD TBD TBD TBD TBD TBD
MEMORY_VSIZE_MAX_CONTIGUOUS Maximum-sized block of contiguous virtual memory (KB). TBD TBD TBD TBD TBD TBD
Are We Slim Yet Need an explanation of what this is and a link to the dashboard / test result. TBD TBD TBD TBD TBD TBD

Slow Scripts

Responsible Jim Mathies
Accountable Ben Miroglio
Metric Description Report Links Analysis By Results for Child Process Cohorts Criteria Met? Criteria Met Signed-off By
1 4
SLOW_SCRIPT_NOTICE_COUNT Total count of slow script notices displayed to user. TBD TBD TBD TBD TBD TBD
SLOW_SCRIPT_PAGE_COUNT The number of pages that trigger slow script notices. TBD TBD TBD TBD TBD TBD
SLOW_SCRIPT_NOTIFY_DELAY The difference between the js slow script timeout for content set in prefs and the actual time we waited before displaying the notification in milliseconds. TBD TBD TBD TBD TBD TBD

Tests

Responsible Blake Kaplan / Gabor Kriszanits
Accountable Blake Kaplan
Sign Off Module Owners / Jeff Griffiths

All unit tests disabled for e10s-multi must be triaged and:

  • re-enabled (and fixed, if necessary)
  • or annotated that the test is irrelevant for e10s-multi
  • or deleted

We want each test directory to be signed-off by the feature area's owner.

QA Test Plan

Responsible Erin Lancaster
Accountable SoftVision
Sign Off SoftVision / Jeff Griffiths
Task Owner Criteria Met? Criteria Met Signed-off By
Write test plan Tracy Done Tracy
Execute test plan Tracy, SV In progress TBD
Retrieved from "https://wiki.mozilla.org/index.php?title=Electrolysis/Multi_Release_Criteria&oldid=1169781"