QA/Fennec/draft mihai 2: Difference between revisions

Jump to navigation Jump to search
Line 35: Line 35:
== Acceptance Criteria==
== Acceptance Criteria==
*The feature does not introduce new regressions that affect performance and stability  
*The feature does not introduce new regressions that affect performance and stability  
*
*All w3c tests pass


==KPIs / Measurements Used:
==KPIs / Measurements Used:
*Qualitative:
*Qualitative:
** No negative feedback from users (SUMO/Google Play Store)
** No negative feedback from users
** Current % of RL users: we'd need to associate individual users with the telemetry events (mfinkle's script): http://cl.ly/1T36142z2X02
*Adoption: If we can't get % of users who use RL, we might be able to watch the adoption rate instead to measure this
** Monitor how many times users have seen the migration slide/info to know how many people actual use the concept of a RL
** Monitor how many times users clicked on the "offline" helper UI to get a baseline to compare it with viewed saved offline RL items
*Increase in ratio between stored RL items and loaded RL items (currently 0.75)
*Monitor how many people load RV items that are not in RL folder vs. RV items that are in the RL folder: that will help us understand if people understand the concept of read later / save for later
*Monitor how many people load RV items in offline vs. online mode to help us understand their mental model of using RV items for offline mode https://bugzilla.mozilla.org/show_bug.cgi?id=1243387
*More usage != more RL items, increased frequency of accessing RL folder now in comparison to previous panel view
*Funnel to understand how many people actually read saved RV items in offline mode: https://bugzilla.mozilla.org/show_bug.cgi?id=1246718
** User clicks on RV https://bugzilla.mozilla.org/show_bug.cgi?id=1246710
** User saves RV item to RL list (folder) https://bugzilla.mozilla.org/show_bug.cgi?id=1246712
** User loads RV item in offline vs online mode https://bugzilla.mozilla.org/show_bug.cgi?id=1243387


= Testing details =
= Testing details =
Confirmed users
1,235

edits

Navigation menu