QA/Fennec/Activity stream Mobile

From MozillaWiki
< QA‎ | Fennec
Revision as of 14:20, 28 December 2016 by Cfat (talk | contribs) (→‎Test Cases)
Jump to navigation Jump to search

Overview

Purpose

Activity Stream is a broad effort to help users recover things they’ve found before, move easily between Firefox on different devices, and discover new things on the web. Trough this, we hope to increased engagement and users retention.

Ownership

Developer contact: [mailto:]

QA: Carmen Fat

Overall Status

[LANDED] Nightly 53: Under switchboard experiment

[NOT LANDED] Aurora 53: NA

[NOT LANDED] Beta 53: NA

Testing Summary

Scope of testing

This wiki details the testing that will be performed for Activity Stream Android project. It defines the overall testing requirements and provides an integrated view of the project test activities. Its purpose is to document:

  • What will be tested
  • How testing will be performed

Environments

Testing will be performed on following devices:

  • Phones
    • 4.x
    • 5.x
    • 6.x
  • Tablet
    • 4.x
    • 5.x
    • 6.x
    • 7.x

Specifications

Activity stream for Android is an add-on that will comprise Top sites and Highlights in just one place, so that the user can access his favorite websites and bookmarks much easier. This will allow the user to limit the displayed pages or domains from his activity.

The scope of our testing is the Activity Stream add-on for Android and its functionality. The testing effort for Activity Stream for Android will be invested on the following areas:

  • integration: verify the add-on integration with the current browser functionalities and UI;
  • functionality: basic and advanced functionality to be verified according to the existing requirements;
  • testing how Bookmarks and History are imported in the add-on functionalities (from Firefox account).

Activity Stream for Android is shipped as an A/B experiment to 0% of Nightly users. To install the Activity stream add-on for Android, you must follow the next steps:

  • Install latest Nightly;
  • Tools -> Add-ons -> Browse all Firefox Add-ons;
  • Install Switchboard Experiments add-on;
  • In about:experiments, tap on Activity stream;
  • Settings -> Advanced -> Enable Activity stream.
  • screenshots

User stories

  • As a user, I want to be able to send feedback about by New Tab experience;
  • As a user, I want to manage my Highlights items so I have control over what is being shown;
  • As a user, I want to be able to dismiss items so that I can easily remove things I'm not interested in seeing;
  • As a user, I want to delete an item so it won't show up in my history;
  • As a user, I want to share the item with other apps or people;
  • As a user, I want to save the item for later, so I can bookmark it;
  • As a user, I want to tap on any item in my Highlights list so I can browse to it;
  • As a user, I want to see synced items in my Highlights;
  • As a user, I want to manage Top sites items so I have control over what is being shown;
  • As a user, I want to be able to dismiss items so that I can easily remove things I'm not interested in seeing;
  • As a user, I want to queue a top sites item in my tabs to browse to it later (open new tab);
  • As a user, I want to be able to copy the URL or share a top sites item without having to open the site;
  • As a user, I want to ensure that a particular item can be pinned to my home panel;
  • As a user, I want to change the name of a top sites item so i can more easily recover it later (mental queues);
  • As a user, I want to be able to add a top site to my Homescreen for easy recovery and access;
  • As a user, I want to tap on any item in my Top Sites list so I can browse to it;
  • As a user, I understand and expect to find the same AS items across all devices I synced Firefox to.

Acceptance Criteria

Testing details

Test Cases

Testing days

Date:28-12-2016

  • Created Test Plan


Bug Work

Tracking bugs

  • Meta bug
    • bug 1288099 - [meta] (activity-stream-android) [meta] Activity Stream on Android
Full Query
ID Priority Summary Status Assigned to
814801 P5 [meta] Incremental two-phase bookmark sync for Android Sync RESOLVED
1160526 P3 Sync not syncing tabs in reader view RESOLVED
1241114 -- [meta] Publish Nightly/Aurora to Google Play RESOLVED
1253111 P1 [Android] Upload records atomically RESOLVED :Grisha Kruglov
1265712 -- [meta] Improve website icon quality RESOLVED
1287643 P1 Implement FxA Push Endpoint registration on Fennec RESOLVED Edouard Oger [:eoger]
1288102 -- [meta] Activity Stream Panel RESOLVED
1288103 P1 Add build/feature flag for activity stream features RESOLVED Andrzej Hunt :ahunt
1288330 P1 Evaluate: Running fathom locally vs. metadata back-end service RESOLVED Sebastian Kaspari (:sebastian; :pocmo)
1288711 P1 (Activity Stream) Validating early prototypes RESOLVED Sebastian Kaspari (:sebastian; :pocmo)
1293710 P1 Obtain a list of "highlights" and display them in the AS panel RESOLVED Sebastian Kaspari (:sebastian; :pocmo)
1424783 P3 Top Site thumbnails in awesomescreen no longer appear RESOLVED

12 Total; 0 Open (0%); 12 Resolved (100%); 0 Verified (0%);


Still issues

Bug fixed

Signoff

Criteria

  • All test cases should be executed
  • All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed


Results

Nightly testing

  • There were no blockers found while testing this feature.
  • All bugs are fixed and verified

Aurora testing NA

Beta testing NA