Confirmed users, Bureaucrats and Sysops emeriti
1,737
edits
Test Pilot/2016Q3: Difference between revisions
m
no edit summary
mNo edit summary |
mNo edit summary |
||
| Line 45: | Line 45: | ||
! Objective 2 | ! Objective 2 | ||
! Make it easy for existing Test Pilot users to learn about new experiments and start using them. | ! Make it easy for existing Test Pilot users to learn about new experiments and start using them. | ||
! | ! .77 | ||
! | ! | ||
|- | |- | ||
| KR1 | | KR1 | ||
| Get new experiment within 24 hours of launch at a rate 10% higher than our baseline engagement ratio. | | Get new experiment within 24 hours of launch at a rate 10% higher than our baseline engagement ratio. | ||
| | | <span style="color:green;font-weight:bold;">1.0</span> | ||
| this should have been "get x% of our users using a new experiment in y hours." Since the engagement ratio is based off of DAU and MAU it's not what we should use in the first 24 hours. NoMore404s had 10k users in the first week. | | this should have been "get x% of our users using a new experiment in y hours." Since the engagement ratio is based off of DAU and MAU it's not what we should use in the first 24 hours. NoMore404s had 10k users in the first week. | ||
|- | |- | ||
| KR2 | | KR2 | ||
| Implement a notification system in Test Pilot | | Implement a notification system in Test Pilot | ||
| | | <span style="color:orange;font-weight:bold;">0.8</span> | ||
| | | We did implement a push notification system, but it has some problems (weird empty messages) that we haven't solved and don't know how. We also added badging to our icon which has proven to be very successful. | ||
|- | |- | ||
| KR3 | | KR3 | ||
| 5% of active Test Pilot users share an experiment socially | | 5% of active Test Pilot users share an experiment socially | ||
| | | <span style="color:orange;font-weight:bold;">0.5</span> | ||
| | | This is really hard to measure as people could just be copying/pasting links to their social media. We've seen 363 "share" clicks from our site in the past 3 days, but weren't measuring earlier than that. 5% of our DAU (21120) is 1056 users. Q3 had 1500 sessions starting from facebook, 635 from twitter. | ||
|- | |- | ||
| | | | ||