|
|
| (10 intermediate revisions by the same user not shown) |
| Line 1: |
Line 1: |
| [[File:Yellow-sm.jpg|thumbnail|left]]<br> | | [[File:Green-sm.jpg|thumbnail|left]]<br> |
|
| |
|
| =e10s Update: '''May 20'''= | | =e10s Update: '''July 1'''= |
| ==Executive Summary== | | ==Executive Summary== |
| * The biggest news is that the e10s [https://wiki.mozilla.org/Electrolysis/Experiments#Beta_47 Experiment for Firefox 47] Beta has been approved to run for the entire Beta cycle (vs. being disabled at Beta 6). This means that stability is trending in the right direction and that RelMan has been provided the [https://sql.telemetry.mozilla.org/dashboard/release-management-dashboard Telemetry-based stability dashboard] they need to easily decipher e10s vs. non-e10s crashes. The experiment will end when Firefox 47 goes to GA on June 7 and we will repeat a similar experiment for Firefox Beta 48 with an eye towards shipping to 1% of our Firefox 48 GA population so long as we meet our Release Criteria. | | * The biggest news is that the stability release criteria for Beta 48 has been signed off on [https://wiki.mozilla.org/Electrolysis/Release_Criteria#Stability]. Slow script count is also within release criteria target. |
| | * We are also at [https://wiki.mozilla.org/E10s/Status/m9#Open_M9_bugs 0 M9's] (and have been) for a few weeks |
| | * As of this week, 569K users have been exposed to e10s in Beta 48. |
| | * Given that we have met all of our release criteria and we have not regressed since 47 beta, the project is now designated 'green' or 'on track' to ride the trains to GA and be gradually rolled out (1% at start) to eligible users (41% of total population) or about 800K users for the first 3 weeks. |
| | * '''So what's the release plan?''' We are working on a day-by-day snapshot of the activities that have to occur once Firefox 48 goes to GA. This is basically a small 'throttle team' who will be at helm of throttling e10s up or down (or disabling). This is driven by RelMan but will be supported by e10s subject matter experts so that decisions can be made quickly. You can refer to these docs for more info and WIP details: http://bit.ly/29mIbXs and |
|
| |
|
| * As of this week, 800,000 users have been exposed to e10s in Beta. Our two biggest risk areas remain stability and slow script count.
| |
|
| |
| Digging into the stability data is an ongoing effort, and we have found OS versions make a difference:
| |
| **XP Crash Rates are bringing our numbers up; excluding NT data indicates that e10s is more stable than non-e10s (see this [https://sql.telemetry.mozilla.org/queries/369#table query]). Next steps here include figuring out if graphics acceleration is part of this (for non-e10s, too).
| |
| **Additionally, we have found that stability is worse for Mac OS X 10.6-10.8. These OS versions will be no longer supported as of Firefox 49.
| |
| **Next Steps include excluding experiment participants who are using these OS versions and see how it impacts our crash stats. Additionally, we will be dissecting the data around Slow Script Count in a similar way to see if it helps find a solution.
| |
|
| |
|
| |
|
| |
|
| |
|
| |
| With the approach of Firefox 47 Beta 4 on May 10, stability and unearthing [https://docs.google.com/document/d/150XUlvXi13mliWIixS5x5DoLE14ySxItBhQfCIKg1NI/edit important details we need to line up for a staged rollout to GA] remains our central focus.
| |
|
| |
| ==Why yellow? e10s is designated 'yellow' or 'at risk' because: ==
| |
| Stability is our #1 risk to our plan to stay enable for the entire beta cycle in Firefox 47. We also need to continue to make progress on an issue with [https://bugzilla.mozilla.org/show_bug.cgi?id=1260769 slow scripts]. All other areas of release criteria are looking good.
| |
|
| |
|
| ==Next Steps== | | ==Next Steps== |
| * 04/10: Firefox 47 Beta 3 Ships | | * 05/20: Firefox 47 Beta 7 Ships |
| * 05/11: Second derived data set available (2 weeks of data) | | * 05/25: Fourth derived data set available (4 weeks of data) |
| * 05/12: Quality check point | | * 05/24: Release plan review |
|
| |
|
| ==Release Criteria==
| |
| * See the wiki for up-to-date [https://wiki.mozilla.org/Electrolysis/Release_Criteria e10s release criteria status]
| |
|
| |
|
| ==Add-Ons + WebExtensions== | | ==Add-Ons + WebExtensions== |
| Line 34: |
Line 21: |
|
| |
|
| ==Automated tests== | | ==Automated tests== |
| * Everything we can have enabled in production is enabled, everything else is enabled on a separate branch called 'Ash'.
| | * We are at about 90% [https://wiki.mozilla.org/Electrolysis/Test_Coverage Test coverage for all channels. We have touched base with all module owners. Not all of them have signed off specifically but we are calling it within acceptable range for shipping at this point. |
| * We have all tests be owned | | |
| * We would like each directory signed-off by test owners week of 06/05
| |
| *We're tracking all the tests and who owns them, [https://docs.google.com/spreadsheets/d/10UeyRoiWV2HjkWwAU51HXyXAV7YLi4BjDm55mr5Xv6c/edit#gid=1777180571 here]
| |
| *We are tracking tests that are running and passing on some platforms, but are disabled on others.From a feature coverage point of view, it's in pretty great shape. There's very little that is disabled both on opt *and* debug on a same platform (meaning that that test is not running on this platform). Look for the "Fully disabled in a platform" entries in this [https://docs.google.com/spreadsheets/d/1oBnRct8FuTnAoVfbE08m10UHi1_5kOFaOPglJ6ittWc/edit#gid=0 spreadsheet].
| |
|
| |
|
| ==A11y== | | ==A11y== |
| * Proposed technical path to encourage a11y clients to communicate directly with the content process {{bug|1258839}}. dbolter is getting some first impressions from clients to see if this is a viable approach. | | * It's looking like the initial API support will land in 50 |
| | |
| * We're also looking into Windows touchscreen/a11y compat, see more information as the plan is taking shape, [https://public.etherpad-mozilla.org/p/a11y+e10s here]. | | * We're also looking into Windows touchscreen/a11y compat, see more information as the plan is taking shape, [https://public.etherpad-mozilla.org/p/a11y+e10s here]. |
|
| |
|