Firefox/AddOns/Status/current: Difference between revisions

Jump to navigation Jump to search

Firefox/AddOns/Status/current (view source)

Revision as of 23:28, 29 December 2016

3 bytes added ,  29 December 2016
→‎Add-ons/e10s Program Status Report: changed order
Line 18: Line 18:
**In 49 and 50 the qualification criteria limited the number of users activated at once.  Beta 51 targeting would be more users than we want to activate at once in Release.  If the Beta goes well, Release expansion criteria will be Release 50 requirements (MPC=True and webextensions) and a list of all add-ons that hit a threshold of use in Beta 51.
**In 49 and 50 the qualification criteria limited the number of users activated at once.  Beta 51 targeting would be more users than we want to activate at once in Release.  If the Beta goes well, Release expansion criteria will be Release 50 requirements (MPC=True and webextensions) and a list of all add-ons that hit a threshold of use in Beta 51.


== Release 49 Details ==
 
 
== Beta/Release 51 Details ==
[[File:Green-sm.jpg|frameless|15px]] On track, issues well managed [[File:Yellow-sm.jpg|frameless|15px]] Some risks, unknowns without clear mitigations [[File:Red-sm.jpg|frameless|15px]] Blocked on deliverables, needs decision, escalation required
[[File:Green-sm.jpg|frameless|15px]] On track, issues well managed [[File:Yellow-sm.jpg|frameless|15px]] Some risks, unknowns without clear mitigations [[File:Red-sm.jpg|frameless|15px]] Blocked on deliverables, needs decision, escalation required


Line 29: Line 31:
|-
|-


|Experiment Definition
|Beta 51 Experiment Definition/selection
|<!-- For Red/Yellow/Green Status un-comment for the color you are reporting -->
|<!-- For Red/Yellow/Green Status un-comment for the color you are reporting -->
<!--[[File:Red-sm.jpg|frameless|25px]]<br>-->
<!--[[File:Red-sm.jpg|frameless|25px]]<br>-->
<!-- [[File:Yellow-sm.jpg|frameless|25px]]<br>-->
<!-- [[File:Yellow-sm.jpg|frameless|25px]]<br>-->
[[File:Green-sm.jpg|frameless|25px]]<br>
[[File:Green-sm.jpg|frameless|25px]]<br>
|[https://docs.google.com/spreadsheets/d/1zE1TNV0z6gaYgugBAns3XXDexLDHAa2Dmj0EVQIg8tc/edit?usp=sharing Targeting 8 named] tested and marked MPC:true add-ons and all webextensions based (~950)
|[https://bugzilla.mozilla.org/show_bug.cgi?id=1314429 Target continues to contain MPC:webextensions and MPC=True - expanding to all but those marked MPC=False]. Beta 1-5 were a baseline at same criteria as Release 50, Beta 6 has the expansion.
|
|
|Beta49
|Beta51
|-
|-


|Beta Release Criteria
|Release Management Approval
|<!-- For Red/Yellow/Green Status un-comment for the color you are reporting -->
|<!-- For Red/Yellow/Green Status un-comment for the color you are reporting -->
<!--[[File:Red-sm.jpg|frameless|25px]]<br>-->
<!--[[File:Red-sm.jpg|frameless|25px]]<br>-->
<!--[[File:Yellow-sm.jpg|frameless|25px]]<br>-->
<!--[[File:Yellow-sm.jpg|frameless|25px]]<br>-->
[[File:Green-sm.jpg|frameless|25px]]<br>
[[File:Green-sm.jpg|frameless|25px]]<br>
|Using the [https://docs.google.com/spreadsheets/d/1j1GnKGaMmdHDHccanst8EQC2wSK07pvRnHAWISv5FoA/edit#gid=0 RC from e10s], choosing the ones that are applicable from telemetry and stability
|First-second January need to look at how stability and perf has been doing to determine if will continue into release. If it continues, experiment will be disabled and will need to test MPC=True, webextensions, and an allow list of add-ons that hit sufficient numbers in Beta.  This is an intermediary step for throttle-ing the numbers of users added to e10s in one release.
|
|
|Beta
|Release51
|-
|-


|Data Collection & Analysis
|<!-- For Red/Yellow/Green Status un-comment for the color you are reporting -->
<!--[[File:Red-sm.jpg|frameless|25px]]<br>-->
<!--[[File:Yellow-sm.jpg|frameless|25px]]<br>-->
[[File:Green-sm.jpg|frameless|25px]]<br>
|Beta successfully delivered to 28,000 addons\e10s Test users and 28,000 addons\no-e10s control.  Beta [https://sql.telemetry.mozilla.org/dashboard/stability-comparison-for-e10s-add-ons-experiment Stability] and [https://github.com/dzeber/e10s_analyses/blob/beta-49-addons/beta/49/week3/e10s_experiment.ipynb Performance] metrics in place.  Released to 3.6 million users. Release stability and engagement metrics in place.
|
|Release
|-
|Release Metrics & Criteria
|<!-- For Red/Yellow/Green Status un-comment for the color you are reporting -->
<!--[[File:Red-sm.jpg|frameless|25px]]<br>-->
<!--[[File:Yellow-sm.jpg|frameless|25px]]<br>-->
[[File:Green-sm.jpg|frameless|25px]]<br>
|Fewer metrics are available in Release.  [https://sql.telemetry.mozilla.org/dashboard/stability-metrics-for-e10s-add-ons-experiment-release-49-50-51- Stability] and [https://sql.telemetry.mozilla.org/dashboard/client-count-firefox-e10s-release- Daily Active Users] are monitored.
|
|Release49
|}
|}
== Release 50 Details ==
== Release 50 Details ==
[[File:Green-sm.jpg|frameless|15px]] On track, issues well managed [[File:Yellow-sm.jpg|frameless|15px]] Some risks, unknowns without clear mitigations [[File:Red-sm.jpg|frameless|15px]] Blocked on deliverables, needs decision, escalation required
[[File:Green-sm.jpg|frameless|15px]] On track, issues well managed [[File:Yellow-sm.jpg|frameless|15px]] Some risks, unknowns without clear mitigations [[File:Red-sm.jpg|frameless|15px]] Blocked on deliverables, needs decision, escalation required
Line 102: Line 85:
|}
|}


== Beta/Release 51 Details ==
== Release 49 Details ==
[[File:Green-sm.jpg|frameless|15px]] On track, issues well managed [[File:Yellow-sm.jpg|frameless|15px]] Some risks, unknowns without clear mitigations [[File:Red-sm.jpg|frameless|15px]] Blocked on deliverables, needs decision, escalation required
[[File:Green-sm.jpg|frameless|15px]] On track, issues well managed [[File:Yellow-sm.jpg|frameless|15px]] Some risks, unknowns without clear mitigations [[File:Red-sm.jpg|frameless|15px]] Blocked on deliverables, needs decision, escalation required


Line 113: Line 96:
|-
|-


|Beta 51 Experiment Definition/selection
|Experiment Definition
|<!-- For Red/Yellow/Green Status un-comment for the color you are reporting -->
|<!-- For Red/Yellow/Green Status un-comment for the color you are reporting -->
<!--[[File:Red-sm.jpg|frameless|25px]]<br>-->
<!--[[File:Red-sm.jpg|frameless|25px]]<br>-->
<!-- [[File:Yellow-sm.jpg|frameless|25px]]<br>-->
<!-- [[File:Yellow-sm.jpg|frameless|25px]]<br>-->
[[File:Green-sm.jpg|frameless|25px]]<br>
[[File:Green-sm.jpg|frameless|25px]]<br>
|[https://bugzilla.mozilla.org/show_bug.cgi?id=1314429 Target continues to contain MPC:webextensions and MPC=True - expanding to all but those marked MPC=False]. Beta 1-5 were a baseline at same criteria as Release 50, Beta 6 has the expansion.
|[https://docs.google.com/spreadsheets/d/1zE1TNV0z6gaYgugBAns3XXDexLDHAa2Dmj0EVQIg8tc/edit?usp=sharing Targeting 8 named] tested and marked MPC:true add-ons and all webextensions based (~950)
|
|Beta49
|-
 
|Beta Release Criteria
|<!-- For Red/Yellow/Green Status un-comment for the color you are reporting -->
<!--[[File:Red-sm.jpg|frameless|25px]]<br>-->
<!--[[File:Yellow-sm.jpg|frameless|25px]]<br>-->
[[File:Green-sm.jpg|frameless|25px]]<br>
|Using the [https://docs.google.com/spreadsheets/d/1j1GnKGaMmdHDHccanst8EQC2wSK07pvRnHAWISv5FoA/edit#gid=0 RC from e10s], choosing the ones that are applicable from telemetry and stability
|
|
|Beta51
|Beta
|-
|-


|Release Management Approval
|Data Collection & Analysis
|<!-- For Red/Yellow/Green Status un-comment for the color you are reporting -->
|<!-- For Red/Yellow/Green Status un-comment for the color you are reporting -->
<!--[[File:Red-sm.jpg|frameless|25px]]<br>-->
<!--[[File:Red-sm.jpg|frameless|25px]]<br>-->
<!--[[File:Yellow-sm.jpg|frameless|25px]]<br>-->
<!--[[File:Yellow-sm.jpg|frameless|25px]]<br>-->
[[File:Green-sm.jpg|frameless|25px]]<br>
[[File:Green-sm.jpg|frameless|25px]]<br>
|First-second January need to look at how stability and perf has been doing to determine if will continue into release.  If it continues, experiment will be disabled and will need to test MPC=True, webextensions, and an allow list of add-ons that hit sufficient numbers in Beta.  This is an intermediary step for throttle-ing the numbers of users added to e10s in one release.
|Beta successfully delivered to 28,000 addons\e10s Test users and 28,000 addons\no-e10s control.  Beta [https://sql.telemetry.mozilla.org/dashboard/stability-comparison-for-e10s-add-ons-experiment Stability] and [https://github.com/dzeber/e10s_analyses/blob/beta-49-addons/beta/49/week3/e10s_experiment.ipynb Performance] metrics in place.  Released to 3.6 million users. Release stability and engagement metrics in place.
|
|
|Release51
|Release
|-
|-


|Release Metrics & Criteria
|<!-- For Red/Yellow/Green Status un-comment for the color you are reporting -->
<!--[[File:Red-sm.jpg|frameless|25px]]<br>-->
<!--[[File:Yellow-sm.jpg|frameless|25px]]<br>-->
[[File:Green-sm.jpg|frameless|25px]]<br>
|Fewer metrics are available in Release.  [https://sql.telemetry.mozilla.org/dashboard/stability-metrics-for-e10s-add-ons-experiment-release-49-50-51- Stability] and [https://sql.telemetry.mozilla.org/dashboard/client-count-firefox-e10s-release- Daily Active Users] are monitored.
|
|Release49
|}
|}


== Projects to ease the transition ==
== Projects to ease the transition ==
Sescalante
Confirmed users
1,094

edits

Retrieved from "https://wiki.mozilla.org/Special:MobileDiff/1158185"

Navigation menu