QA/Fennec/Activity stream Mobile
From MozillaWiki
Contents
Overview
Purpose
Activity Stream is a broad effort to help users recover things they’ve found before, move easily between Firefox on different devices, and discover new things on the web. Trough this, we hope to increased engagement and users retention.
Ownership
Developer contact: Sebastian Kaspari
QA: Bogdan Surd
Overall Status
[LANDED] Nightly 55: LANDED
[NOT LANDED] Beta 54: NA
Testing Summary
Scope of testing
This wiki details the testing that will be performed for Activity Stream Android project. It defines the overall testing requirements and provides an integrated view of the project test activities. Its purpose is to document:
- What will be tested
- How testing will be performed
Environments
Testing will be performed on following devices:
- Phones
- 4.x
- 5.x
- 6.x
- Tablet
- 4.x
- 5.x
- 6.x
- 7.x
Specifications
Activity stream for Android is an add-on that will comprise Top sites and Highlights in just one place, so that the user can access his favorite websites and bookmarks much easier. This will allow the user to limit the displayed pages or domains from his activity.
The scope of our testing is the Activity Stream add-on for Android and its functionality. The testing effort for Activity Stream for Android will be invested on the following areas:
- integration: verify the add-on integration with the current browser functionalities and UI;
- functionality: basic and advanced functionality to be verified according to the existing requirements;
- testing how Bookmarks and History are imported in the add-on functionalities (from Firefox account).
Activity Stream for Android is shipped as an A/B experiment to 0% of Nightly users. To install the Activity stream add-on for Android, you must follow the next steps:
- Install latest Nightly;
- Tools -> Add-ons -> Browse all Firefox Add-ons;
- Install Switchboard Experiments add-on;
- In about:experiments, tap on Activity stream;
- Settings -> Advanced -> Enable Activity stream.
- First view of Activity Stream Panel
- First view of Activity Stream Panel after dismiss Welcome notification
- First opening of Context menu - Top sites
- First full view of Context menu - Top sites
- First opening of Context Menu - Highlights
- First full view of Context menu - Highlights
- Activity Stream Panel populated with websites
- Context menu triggered on Top sites for non default website
- Full Context menu triggered on Top sites for a non default website
- Context Menu triggered on Highlights for non default website
- Full Context menu triggered on Highlights for a non default website
User stories
- As a user, I want to be able to send feedback about by New Tab experience;
- As a user, I want to manage my Highlights items so I have control over what is being shown;
- As a user, I want to be able to dismiss items so that I can easily remove things I'm not interested in seeing;
- As a user, I want to delete an item so it won't show up in my history;
- As a user, I want to share the item with other apps or people;
- As a user, I want to save the item for later, so I can bookmark it;
- As a user, I want to tap on any item in my Highlights list so I can browse to it;
- As a user, I want to see synced items in my Highlights;
- As a user, I want to manage Top sites items so I have control over what is being shown;
- As a user, I want to be able to dismiss items so that I can easily remove things I'm not interested in seeing;
- As a user, I want to queue a top sites item in my tabs to browse to it later (open new tab);
- As a user, I want to be able to copy the URL or share a top sites item without having to open the site;
- As a user, I want to ensure that a particular item can be pinned to my home panel;
- As a user, I want to change the name of a top sites item so i can more easily recover it later (mental queues);
- As a user, I want to be able to add a top site to my Homescreen for easy recovery and access;
- As a user, I want to tap on any item in my Top Sites list so I can browse to it;
- As a user, I understand and expect to find the same AS items across all devices I synced Firefox to.
Acceptance Criteria
Testing details
Test Cases
- Test Case title
- https://docs.google.com/spreadsheets/d/1giXgLtKI2dz7YrTJshoSnjJBwBLL9Y844j41qWJ43qs/edit?usp=sharing
Testing days
Date: 28-12-2016
- Created Test Plan
Date: 2017-01-06
- Testing on latest Nightly with Honor Huawei 5x (Android 5.1.1)
- Test Cases: https://docs.google.com/spreadsheets/d/1giXgLtKI2dz7YrTJshoSnjJBwBLL9Y844j41qWJ43qs/edit#gid=1286142361
Date: 2017-01-10
- Verified bug:
- bug 1319254 - [AS] [Highlights] Implement empty state UI explaining what are the highlights
Date: 2017-01-17
- Testing on latest Nightly with Lenovo A536 (Android 4.4.2)
- Test Cases: https://docs.google.com/spreadsheets/d/1giXgLtKI2dz7YrTJshoSnjJBwBLL9Y844j41qWJ43qs/edit#gid=1286142361
Date: 2017-02-02
- Verified bugs:
- bug 1330986 - Activity stream - There are some missing icons and not properly rendered few ones on context menu
- bug 1325096 - Activity stream - Favicons and context menu icons are wrongly displayed
- Logged bug:
- bug 1336133 - Activity stream - On some tablets, context menu won't open when tapping the 3 dots button
Date: 2017-02-06
- Smoke-testing on latest Nightly with Asus ZenPad 8.0 Z380KL (Android 6.0.1)
- Test Cases: https://docs.google.com/spreadsheets/d/1giXgLtKI2dz7YrTJshoSnjJBwBLL9Y844j41qWJ43qs/edit#gid=1286142361
- Verified bug:
- bug 1325375 - Activity stream - Context menu is not displayed when tapping the 3 dots menu icon
- bug 1330986 - Activity stream - There are some missing icons and not properly rendered few ones on context menu
- bug 1323105 - [AS] [Pinned] Use VectorDrawable for pin icon in Top Sites
- bug 1290012 - Introduce setting to enable experimental activity stream feature
- Updated bug:
- bug 1324452 - Activity stream - Context menu is misplaced and wrongly rendered when turning tablet into landscape mode
Date: 2017-02-10
- Smoke-testing on latest Nightly using Oneplus Two (Android 6.0.1)
- Test Cases: https://docs.google.com/spreadsheets/d/1giXgLtKI2dz7YrTJshoSnjJBwBLL9Y844j41qWJ43qs/edit#gid=1286142361
- Logged bug:
- bug 1338561 - Activity stream - An incomplete preview context menu is displayed when the keyboard is triggered
Date: 2017-02-16
- Verified bugs:
- bug 1325931 - Activity stream - Title is not centred in the Top sites tile when website is pinned
- bug 1325375 - Activity stream - Context menu is not displayed when tapping the 3 dots menu icon
- bug 1311555 - Consider filling bookmark star in AS context menu for bookmarked pages
Date: 2017-02-20
- Verified bugs:
- bug 1320775 - [AS] [TopSites] Default top sites need good icons
- Logged bug:
- bug 1341042 - Activity stream - The bottom of the Top sites tiles is cut in landscape mode
- bug 1341049 - Activity stream - The space between Top sites tiles is too big when turning the device into landscape mode
Date: 2017-02-21
- Logged bug:
- bug 1341275 - Activity stream - Website icon from Context menu is inconsistent
Date: 2017-02-22
- Smoke-testing on latest Nightly using Asus Transformer Pad (Android 4.2.1)
- Test Cases: https://docs.google.com/spreadsheets/d/1giXgLtKI2dz7YrTJshoSnjJBwBLL9Y844j41qWJ43qs/edit#gid=1286142361
Date: 2017-10-26
- Sent sign-off
- Logged bug:
- bug 1411992 - [Activity Stream] - Remove separating line if nothing else is displayed in the Top Sites section
Bug Work
Tracking bugs
- Meta bug
- bug 1288099 - [meta] (activity-stream-android) [meta] Activity Stream on Android
12 Total; 0 Open (0%); 12 Resolved (100%); 0 Verified (0%);
- bug 1311099 - (as-android-newtab) [User Story][Android] Activity Stream New Tab UI
47 Total; 0 Open (0%); 41 Resolved (87.23%); 6 Verified (12.77%);
- bug 1311095 - (as-android-telemetry) [User Story][Android] AS Telemetry
10 Total; 0 Open (0%); 10 Resolved (100%); 0 Verified (0%);
- bug 1311093 - (as-android-metadata) [User Story][Android] Metadata Fetching
| ID | Priority | Summary | Status | Resolution | Assigned to |
|---|---|---|---|---|---|
| 1301717 | P1 | Store extracted website meta data | RESOLVED | FIXED | :Grisha Kruglov |
| 1301718 | P1 | Update Activity Stream Highlights page icons with PageMetadata's image_url | RESOLVED | FIXED | Michael Comella (:mcomella) [NI reported issues only: ex-Mozilla] |
| 1311434 | P1 | Add ruleset for extracting 'provider' name from web page to page-metadata-parser | RESOLVED | FIXED | Sebastian Kaspari (:sebastian; :pocmo) |
| 1313296 | P2 | Do not extract page metadata for "about" pages | RESOLVED | FIXED | Tom Klein |
| 1313515 | P2 | Select stored metadata for websites | RESOLVED | WONTFIX | |
| 1325380 | P1 | Use 'provider name' metadata for AS panel | RESOLVED | FIXED | Sebastian Kaspari (:sebastian; :pocmo) |
6 Total; 0 Open (0%); 6 Resolved (100%); 0 Verified (0%);
- bug 1311089 - (as-android-highlights) [User Story][Android] Highlights Algorithm
| ID | Priority | Summary | Status | Resolution | Assigned to |
|---|---|---|---|---|---|
| 1298785 | P2 | AS highlights: Group history by hostname | RESOLVED | WONTFIX | Andrzej Hunt :ahunt |
| 1298786 | P2 | AS highlights: Implement domain blacklist | RESOLVED | WONTFIX | Andrzej Hunt :ahunt |
| 1312016 | P1 | Implement highlights ranking/scoring | RESOLVED | FIXED | Sebastian Kaspari (:sebastian; :pocmo) |
| 1312017 | P1 | Activity Stream: Optimize highlights query | RESOLVED | FIXED | Sebastian Kaspari (:sebastian; :pocmo) |
| 1369604 | P1 | Activity Stream Highlights query is very slow | RESOLVED | FIXED | Michael Comella (:mcomella) [NI reported issues only: ex-Mozilla] |
5 Total; 0 Open (0%); 5 Resolved (100%); 0 Verified (0%);
- Bug Tracking - QA
12 Total; 0 Open (0%); 10 Resolved (83.33%); 2 Verified (16.67%);
- Meta bug
- bug 1377259 - (as-android-notyet) [meta] Activity Stream Android: Probably Not
17 Total; 0 Open (0%); 17 Resolved (100%); 0 Verified (0%);
- Meta bug
- bug 1377248 - (as-android-nicetohave) [meta] Activity Stream Android: Nice to have
16 Total; 0 Open (0%); 16 Resolved (100%); 0 Verified (0%);
- Meta bug
- bug 1377247 - (as-android-blockers) [meta] Activity Stream Android: Release blockers
40 Total; 0 Open (0%); 34 Resolved (85%); 6 Verified (15%);
Still issues
Bug fixed
Signoff
Criteria
- All test cases should be executed
- All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed
Results
Nightly testing
- There were no blockers found while testing this feature.
- All bugs are fixed and verified
Aurora testing NA
Beta testing NA
