Firefox/Sync/Progress Report/2017Q3: Difference between revisions

(added a couple missing bullets)
(Added scores and updated comments for all objectives)
 
(5 intermediate revisions by the same user not shown)
Line 1: Line 1:
__NOTOC__
__NOTOC__
<big><big>'''August 2, 2017'''</big></big>
<big><big>'''September 27, 2017'''</big></big>


== OKR Progress ==
== OKR Progress ==
Line 16: Line 16:
|style="text-align: center; background-color: #f9d9a8"|Jul 25
|style="text-align: center; background-color: #f9d9a8"|Jul 25
|style="text-align: center; background-color: #f9d9a8"|Aug 2
|style="text-align: center; background-color: #f9d9a8"|Aug 2
|style="text-align: center; background-color: #f9d9a8"|Aug 16
|style="text-align: center; background-color: #f9d9a8"|Aug 24
|style="text-align: center; background-color: #f9d9a8"|Aug 30
|style="text-align: center; background-color: #f9d9a8"|Sep 7
|style="text-align: center; background-color: #f9d9a8"|Sep 13
|style="text-align: center; background-color: #f9d9a8"|Sep 18
|style="text-align: center; background-color: #f9d9a8"|Sep 27
|style="text-align: center; background-color: #f9d9a8"|Score
|-
|-
|rowspan=2| 1. To enable bi-directional bookmarks on iOS by Firefox 57.
|rowspan=2| 1. To enable bi-directional bookmarks on iOS by Firefox 57.
Line 29: Line 29:
|align="center"|65%
|align="center"|65%
|align="center"|65%
|align="center"|65%
|align="center"|
|align="center"|95%
|align="center"|
|align="center"|--
|align="center"|
|align="center"|100%
|align="center"|
|align="center"|1.0
|align="left"|
|align="left"|
Bookmarks are Sync'd from iOS to desktop.
Bookmarks are Sync'd from iOS to desktop.
*[https://bugzilla.mozilla.org/show_bug.cgi?id=1380060 Bug 1380056: Bug 1380056: [Meta] Allow simple bidirectional bookmarks syncing]
*[https://bugzilla.mozilla.org/show_bug.cgi?id=1380060 Bug 1380060: Sync new local bookmarks into Mobile Bookmarks]
*[https://bugzilla.mozilla.org/show_bug.cgi?id=1380063 Bug 1380063: Make a combined local + buffer Mobile Bookmarks folder the default bookmarks view]
|
|
*Went unexpectedly well. Has landed.
*Done!
|-
|-
|align="left"| 1.2 Users can delete their mobile bookmarks from their iOS device.
|align="left"| 1.2 Users can delete their mobile bookmarks from their iOS device.
Line 48: Line 44:
|align="center"|50%
|align="center"|50%
|align="center"|50%
|align="center"|50%
|align="center"|
|align="center"|95%
|align="center"|
|align="center"|--
|align="center"|
|align="center"|100%
|align="center"|
|align="center"|1.0
|align="left"|
|align="left"|
Ability to delete mobile bookmarks from iOS device and Sync those deletions to desktop.
Ability to delete mobile bookmarks from iOS device and Sync those deletions to desktop.
*[https://bugzilla.mozilla.org/show_bug.cgi?id=1380062 Bug 1380062: Allow bookmarks deletion in Mobile Bookmarks and sync it]
*[https://bugzilla.mozilla.org/show_bug.cgi?id=1387492 Bug 1387492: Allow remote Mobile Bookmarks]
|
|
*Also going well.  
*Done!  
|-
|-
|rowspan=5| 2. To have our data provide valuable insights about Sync engine errors and bookmark validation.
|rowspan=5| 2. To have our data provide valuable insights about Sync engine errors and bookmark validation.
Line 67: Line 61:
|align="center"|50%
|align="center"|50%
|align="center"|75%
|align="center"|75%
|align="center"|
|align="center"|90%
|align="center"|
|align="center"|--
|align="center"|
|align="center"|90%
|align="center"|
|align="center"|1.0
|align="left"|
|align="left"|
Validated validation data
Validated validation data
*[https://bugzilla.mozilla.org/show_bug.cgi?id=1381642 Bug 1381642: Validate bookmark validator dashboards with ad-hoc analysis]
*[https://bugzilla.mozilla.org/show_bug.cgi?id=1381642 Bug 1381642: Validate bookmark validator dashboards with ad-hoc analysis]
|
|
*Work is progressing and results are looking good.
*To be written up by Sept. 29
 
 
 
Risks:
*Assume we won’t hire an analyst by end of Q3 to support our team.
|-
|-
| align="left"|2.2 Stand up dashboards with accurate bookmark validation data from Android and iOS.
| align="left"|2.2 Stand up dashboards with accurate bookmark validation data from Android and iOS.
Line 88: Line 77:
|align="center"|50%
|align="center"|50%
|align="center"|60%
|align="center"|60%
|align="center"|
|align="center"|60%
|align="center"|
|align="center"|--
|align="center"|
|align="center"|60%
|align="center"|
|align="center"|0.0
|align="left"|
|align="left"|
Bookmark validation dashboards for iOS and Android
Bookmark validation dashboards for iOS and Android
Line 97: Line 86:
*[https://bugzilla.mozilla.org/show_bug.cgi?id=1381643 Bug 1381643: Create bookmark validation dashboard]
*[https://bugzilla.mozilla.org/show_bug.cgi?id=1381643 Bug 1381643: Create bookmark validation dashboard]
|
|
*Still blocked on the pre-requisite of landing a bookmark validator for Android, but this has been reviewed and is almost ready.
*Didn't get this done.
 
 
Risks:
*Android validation data aren’t in yet.
*What’s the status of iOS sending pings? Landed, but we need to make sure they’re sent/received.
*Is our analysis correct? If not, we risk creating dashboards that don’t answer our questions.
 
|-
|-
| align="left"|2.3 Flatten Sync engine data.
| align="left"|2.3 Flatten Sync engine data.
Line 112: Line 94:
|align="center"|50%
|align="center"|50%
|align="center"|60%
|align="center"|60%
|align="center"|
|align="center"|80%
|align="center"|
|align="center"|--
|align="center"|
|align="center"|90%
|align="center"|
|align="center"|0.9
|align="left"|
|align="left"|
Provide better sync engine error data for dashboards.
Provide better sync engine error data for dashboards.
Line 121: Line 103:
*[https://bugzilla.mozilla.org/show_bug.cgi?id=1381641 Bug 1381641: Flatten Sync Engine data]
*[https://bugzilla.mozilla.org/show_bug.cgi?id=1381641 Bug 1381641: Flatten Sync Engine data]
|
|
*A lot of work has been completed but with mixed results.
*Flattening up the data is done and landed.  
*Have permission to do it in Scala and look at why it’s crashing the way it is.  
|-
|-
| align="left"|2.4 Stand up Sync Engine Dashboards.
| align="left"|2.4 Stand up Sync Engine Dashboards.
Line 130: Line 111:
|align="center"|40%
|align="center"|40%
|align="center"|40%
|align="center"|40%
|align="center"|
|align="center"|60%
|align="center"|
|align="center"|--
|align="center"|
|align="center"|60%
|align="center"|
|align="center"|0.0
|align="left"|
|align="left"|
Bookmark Validation Dashboard
Bookmark Validation Dashboard
*[https://bugzilla.mozilla.org/show_bug.cgi?id=1381643 Bug 1381643: Create bookmark validation dashboard]
*[https://bugzilla.mozilla.org/show_bug.cgi?id=1381643 Bug 1381643: Create bookmark validation dashboard]
|
|
*Dependent upon 2.3.
*2.2 is a blocker for 2.4
*Need to review with Leif.
|-
|-
| align="left"|2.5 Formulate concrete action items from the validation and sync engine data.
| align="left"|2.5 Formulate concrete action items from the validation and sync engine data.
Line 146: Line 128:
|align="center"|50%
|align="center"|50%
|align="center"|55%
|align="center"|55%
|align="center"|
|align="center"|50%
|align="center"|
|align="center"|--
|align="center"|
|align="center"|30%
|align="center"|
|align="center"|0.0
|align="left"|
|align="left"|
Implementation of a Repair Failure Strategy
Implementation of a Repair Failure Strategy
*[https://bugzilla.mozilla.org/show_bug.cgi?id=1340325 Bug 1340325: Define and implement repair failure strategy]
*[https://bugzilla.mozilla.org/show_bug.cgi?id=1340325 Bug 1340325: Define and implement repair failure strategy]
|
|
*Have been conducting some analysis of the validation and forming some ideas.
*No concrete action items formulated.
|-
|-
|rowspan=4| 3. To prevent bookmark corruption.
|rowspan=4| 3. To prevent bookmark corruption.
Line 166: Line 148:
|align="center"|70%
|align="center"|70%
|align="center"|80%
|align="center"|80%
|align="center"|
|align="center"|95%
|align="center"|
|align="center"|--
|align="center"|
|align="center"|95%
|align="center"|
|align="center"|1.0
|Version-based syncing of bookmarks
|Version-based syncing of bookmarks
*[https://bugzilla.mozilla.org/show_bug.cgi?id=1364644 Bug 1364644: Version-based syncing of bookmarks]
*[https://bugzilla.mozilla.org/show_bug.cgi?id=1364644 Bug 1364644: Version-based syncing of bookmarks]
|
|
*Agreed to move bookmark management to 57. Work itself is largely done. Some remaining changes will be done this week.
*Done!
*This work will make the work for 3.2 easier.
|-
|-
| align="left"|3.2 Prevent re-ordering of bookmarks on Android.
| align="left"|3.2 Prevent re-ordering of bookmarks on Android.
Line 182: Line 163:
|align="center"|50%
|align="center"|50%
|align="center"|60%
|align="center"|60%
|align="center"|
|align="center"|60%
|align="center"|
|align="center"|--
|align="center"|
|align="center"|50%
|align="center"|
|align="center"|0.0
|align="left"|
|align="left"|
Prevention of bookmark reordering on Android.
Prevention of bookmark reordering on Android.
*[https://bugzilla.mozilla.org/show_bug.cgi?id=1352947 Bug 1352947: Android writes many root folders with children missing or in the wrong order]
*[https://bugzilla.mozilla.org/show_bug.cgi?id=1352947 Bug 1352947: Android writes many root folders with children missing or in the wrong order]
|
|
*Have made progress on 3.1.
*Ran out of time due to higher priorities.
|-
|-
| align="left"|3.3 Analyze and prevent erroneous bookmark deduping on Desktop.
| align="left"|3.3 Analyze and prevent erroneous bookmark deduping on Desktop.
Line 198: Line 179:
|align="center"|60%
|align="center"|60%
|align="center"|75%
|align="center"|75%
|align="center"|
|align="center"|85%
|align="center"|
|align="center"|--
|align="center"|
|align="center"|90%
|align="center"|
|align="center"|0.8
|align="left"|
|align="left"|
Feature description(s)
Feature description(s)
Line 208: Line 189:
*[https://bugzilla.mozilla.org/show_bug.cgi?id=1305563 Bug 1305563: Buffering and two-phase application for Desktop]
*[https://bugzilla.mozilla.org/show_bug.cgi?id=1305563 Bug 1305563: Buffering and two-phase application for Desktop]
|
|
*Understand how iOS merge works now. Ported it to desktop. Merged trees can apply back to Places now.
*Review not fully complete but looking good. Don’t anticipate problems.
|-
|-
| align="left"|3.4 Batch upload API enabled for all users, with more than 99% of uploads fitting into a single atomic batch.
| align="left"|3.4 Batch upload API enabled for all users, with more than 99% of uploads fitting into a single atomic batch.
Line 214: Line 195:
|align="center"|75%
|align="center"|75%
|align="center"|80%
|align="center"|80%
|align="center"|
|align="center"|80%
|align="center"|
|align="center"|--
|align="center"|
|align="center"|80%
|align="center"|
|align="center"|0.8
|align="left"|
|align="left"|
Batch upload API enabled
Batch upload API enabled
Line 223: Line 204:
*[https://bugzilla.mozilla.org/show_bug.cgi?id=1378569 Bug 1378569: Increase max records per batch so ~99% of sync users are able to post all their bookmarks in a single batch]
*[https://bugzilla.mozilla.org/show_bug.cgi?id=1378569 Bug 1378569: Increase max records per batch so ~99% of sync users are able to post all their bookmarks in a single batch]
|
|
*Work is progressing well.
*Briefly enabled for all users.
*Still a little uncertainty but it’s come a long way from where it was.
 
 
|-
|-
|}
|}

Latest revision as of 02:09, 30 September 2017

September 27, 2017

OKR Progress

Objective Key Result Confidence Features Notes
Jul 6 Jul 25 Aug 2 Aug 24 Sep 7 Sep 18 Score
1. To enable bi-directional bookmarks on iOS by Firefox 57.

User story: As an iOS user, I’d like to see my existing mobile bookmarks on my desktop.

1.1 Users can see their mobile bookmarks on desktop. 50% 65% 65% 95% -- 100% 1.0

Bookmarks are Sync'd from iOS to desktop.

  • Done!
1.2 Users can delete their mobile bookmarks from their iOS device.

We don’t want to prevent users from deleting their mobile bookmarks from the mobile device.

50% 50% 50% 95% -- 100% 1.0

Ability to delete mobile bookmarks from iOS device and Sync those deletions to desktop.

  • Done!
2. To have our data provide valuable insights about Sync engine errors and bookmark validation. 2.1 Validate our validation data.

(Desktop, iOS and Android)

We don’t have confidence that our validation data query results and if they tell us what we want to know. Our analyses tell us different things depending on how they’re run. Let’s get a third party to review the validity of our queries and results.

50% 50% 75% 90% -- 90% 1.0

Validated validation data

  • To be written up by Sept. 29
2.2 Stand up dashboards with accurate bookmark validation data from Android and iOS.

Make sure that the Android and iOS pings are coming in and land the data in Presto in order to create dashboards.

50% 50% 60% 60% -- 60% 0.0

Bookmark validation dashboards for iOS and Android

  • Didn't get this done.
2.3 Flatten Sync engine data.

The engine data are currently unusable for creating dashboards. We need to flatten, have confidence in our results so that we can prioritize our fixes for Desktop.

50% 50% 60% 80% -- 90% 0.9

Provide better sync engine error data for dashboards.

  • Flattening up the data is done and landed.
2.4 Stand up Sync Engine Dashboards.

Using the flattened Sync engine data, stand up dashboards and have confidence in the analysis.

40% 40% 40% 60% -- 60% 0.0

Bookmark Validation Dashboard

  • 2.2 is a blocker for 2.4
  • Need to review with Leif.
2.5 Formulate concrete action items from the validation and sync engine data.

Create a backlog of prioritized bugs to be addressed as a result of our data discoveries.

60% 50% 55% 50% -- 30% 0.0

Implementation of a Repair Failure Strategy

  • No concrete action items formulated.
3. To prevent bookmark corruption. 3.1 Land the bookmark Sync tracker on Android.

In support of Full Bookmark Management that’s being introduced in 56.

Needs to land in nightly by: July 31st (56 goes to Beta on August 7).

50% 70% 80% 95% -- 95% 1.0 Version-based syncing of bookmarks
  • Done!
3.2 Prevent re-ordering of bookmarks on Android.

There is a recurring problem where users bookmarks are re-ordered on their mobile device. Fix this.

50% 50% 60% 60% -- 50% 0.0

Prevention of bookmark reordering on Android.

  • Ran out of time due to higher priorities.
3.3 Analyze and prevent erroneous bookmark deduping on Desktop.

There is a problem where users’ bookmarks are incorrectly deduped or reordered on their desktop device. This is a form of data loss.

60% 60% 75% 85% -- 90% 0.8

Feature description(s)

  • Review not fully complete but looking good. Don’t anticipate problems.
3.4 Batch upload API enabled for all users, with more than 99% of uploads fitting into a single atomic batch. 50% 75% 80% 80% -- 80% 0.8

Batch upload API enabled

  • Briefly enabled for all users.
  • Still a little uncertainty but it’s come a long way from where it was.