E10s/Status/March25: Difference between revisions

 
(8 intermediate revisions by the same user not shown)
Line 1: Line 1:
[[File:Yellow-sm.jpg|thumbnail|left]]<br>
[[File:Yellow-sm.jpg|thumbnail|left]]<br>


=e10s Weekly Update: '''March 25'''=
=e10s Update: '''March 29'''=
==Executive Summary==
==Executive Summary==
* Our current Plan of record is to continue to conduct A/B Experiments in our beta channel until we can [https://bugzilla.mozilla.org/show_bug.cgi?id=1259512 lower our rate of content process and Plugin crashes]. Our latest A/B experiment derived data set indicates we have work to do on stability before we're ready to ship to beta. We are, however, hitting our goals in many areas of our [https://wiki.mozilla.org/Electrolysis/Release_Criteria release criteria] such as Page Load, Startup/Shutdown time, and Scrolling. We still have work to do in areas such as UI Smoothness, Plugin Jank, Memory Usage, and GFX Performance. We have made excellent progress in our cadence of deploying A/B experiments and quickly ascertaining the data so we have hit a place where we are tightly coordinated and people are moving on issues swiftly. Another important thing to note is that we are currently using the System Add-On to deploy our A/B experiments so we are testing the mechanism we designed to ship e10s rather than using experiment code.
* Our current Plan of record is to continue to conduct A/B Experiments in our beta channel until we can [https://bugzilla.mozilla.org/show_bug.cgi?id=1259512 lower our rate of main process, content, and Plugin crashes]. Our latest A/B experiment derived data set indicates we have work to do on stability before we're ready to ship to beta. We are, however, hitting our goals in many areas of our [https://wiki.mozilla.org/Electrolysis/Release_Criteria release criteria] such as Page Load, Startup/Shutdown time, and Scrolling. We still have work to do in areas such as UI Smoothness, Plugin Jank, Memory Usage, and GFX Performance but not to the level that would necessarily block beta. We have made excellent progress in our cadence of deploying A/B experiments and quickly ascertaining the data so we have hit a place where we are tightly coordinated and people are empowered with the right data to move on issues swiftly. Another important thing to note is that we are currently using the System Add-On to deploy our A/B experiments so we are testing the mechanism we designed to ship e10s rather than using experiment code.


* The team has shifted to burning down M9's [https://wiki.mozilla.org/E10s/Status/m9]. M9 tickets need to hit zero before we're ready to do our cohort release for GA. M9 is focused on fixing issues derived from our Telemetry A/B experiments such as top crashes, regressions, and backlog items deemed to be blockers by product. We have hit a stage where a portion of the M9's are the responsibility of teams outside of the e10s team so we will be rolling those tickets into central triage managed by RelMan to help with load balance.  
* The team has shifted to burning down M9's [https://wiki.mozilla.org/E10s/Status/m9]. M9 tickets need to hit zero before we're ready to do our cohort release for GA. M9 is focused on fixing issues derived from our Telemetry A/B experiments such as top crashes, regressions, and backlog items deemed to be blockers by product. We have hit a stage where a portion of the M9's are the responsibility of teams outside of the e10s team so we will be rolling those tickets into central triage managed by RelMan to help with load balance.  


*With the approach of Firefox 47 merging to Beta on April 18, market readiness remains our central focus.
*With the approach of Firefox 47 merging to Beta on April 18, market readiness remains our central focus. Overall, the phase of the project we current is best described as Convergence. 


==Why yellow? e10s is designated 'yellow' or 'at risk' because: ==
==Why yellow? e10s is designated 'yellow' or 'at risk' because: ==
Our release criteria indicates we have more work to do on the stability side. Given that we are at week 4 in our release cycle, we will likely continue to do experiments in Beta 47 vs. releasing to a % of our  cohort population.
Incoming data from our latest A/B experiment indicates we have more work to do on the stability side. Given that we are at week 4 in our dev cycle leading to Firefox 47 beta, we will likely continue to do experiments in Beta 47 vs. releasing to a % of our  cohort population.


==Highlights and Accomplishments==
==Highlights and Accomplishments==
*Check out a summary of the engineering happenings this last week: https://wiki.mozilla.org/Electrolysis/Meetings/2016-03-24
*Check out a summary of the engineering happenings last week: https://wiki.mozilla.org/Electrolysis/Meetings/2016-03-24


*We've also made great progress fixing automated tests; by early next week we will have [https://docs.google.com/spreadsheets/d/10UeyRoiWV2HjkWwAU51HXyXAV7YLi4BjDm55mr5Xv6c/edit#gid=1558085802 owners for all tests]
*We've also made great progress fixing automated tests; by early next week we will have [https://docs.google.com/spreadsheets/d/10UeyRoiWV2HjkWwAU51HXyXAV7YLi4BjDm55mr5Xv6c/edit#gid=1558085802 owners for all tests]


*WIP: manual test plan. Manual testing has been ongoing, this new test plan has new layout that is easier to follow along with risk commentary, etc. More to share soon on that.
*WIP: manual test plan. Manual testing has been ongoing, this new test plan has new layout that is easier to follow along with risk commentary, etc. More to share soon on that.
==Next Steps==
* The main and content process crashes are well-documented. Next, we need to dig into the plugin crashes
* Triage the [https://bugzilla.mozilla.org/showdependencytree.cgi?id=1198187&hide_resolved=1 RC Blocker Meta dependency tree] to identify the the precise tasks that need to happen prior to GA (besides M9s)
* Now that we have a track back schedule, and we tightly coordinated
** Track back schedule captures transitioning to beta.
** Roll-Out plan (transitioning from beta to release)
==Release Criteria==
*


==Add-Ons + WebExtensions==
==Add-Ons + WebExtensions==
Line 46: Line 56:
|-
|-
! Date !! Trunk !! Aurora !! Beta !! Release
! Date !! Trunk !! Aurora !! Beta !! Release
|-
| 3-30 || 40 default (working on m5) || 39 off || 38 off || 37 off
|-
| 5-11 || 41 default (working on m6) || 40 prompt || 39 off || 38 off
|-
| 6-29 || 42 default (working on m7/m8) || 41 prompt|| 40 off || 39 off
|-
| 8-10 || 43 default (working on m8) || 42 default || 41 off || 40 off
|-
| 9-21 || 44 default (release criteria driven) || 43 default || 42 off || 41 off
|-
| 11-02 || 45 default (release criteria driven) || 44 default || 43 off || 42 off
|-
| 12-14 || 46 default (release criteria driven) || 45 default || 44 A/B || 43 off
|-
| 1-25 || 47 default (release criteria driven) || 46 default || 45 A/B || 44 off
|-
|-
| 3-07 || 48 default (release criteria driven) || 47 default || 46 A/B || 45 off
| 3-07 || 48 default (release criteria driven) || 47 default || 46 A/B || 45 off
canmove, Confirmed users, Bureaucrats and Sysops emeriti
5,401

edits