QA/Fennec/Improve website icon quality
Overview
Purpose
The purpose of this wiki is to serve as a general test plan for verifying that users is provided with high quality icons
Ownership
Developer contact: X
QA: Sorina Florean
Overall Status
[LANDED] Nightly 49: Landed
[LANDED] Aurora 49: 2016-06-07
[LANDED] Beta 49: 2016-08-03
Testing Summary
Scope of testing
The testing will be focus on
- verifying the quality of website icons in the app
Environments
Testing will be performed on following devices:
- Phones
- 4.x
- 5.x
- 6.x
- Tablet
- 4.x
- 5.x
- 6.x
Specifications
- This is part of the top sites updates
- No favicon -> Show a box where the icon would be (much like the empty favicon state of Tablet UI) and display the TLD's first character.
- Less than ideal favicon -> Show a similar box but use the dominant color (from the less than ideal icon) as the fill color, and display the TLD's first character.
- Favicon! -> Show the favicon.
- Website icon
- Less than ideal favicon
User stories
- As a user, I want to be provided with high quality icons so I feel this is not a cheap-looking and feeling app
Acceptance Criteria
- High-res icons being used when available
KPI/Metrics:
- Hypothesis to see more engagement with the top sites panel and other list item views
Testing details
Test Cases
Testing days
Date:2016-05-04
- Created Test Plan
Date:2016-06-17
- Exploratory testing on 49 Aurora (2016-06-16) with Asus ZenPad 8 (Android 5.0.2) and Motorola Razr (Android 4.4.2)
- Aurora History Panel
- Aurora Top Sites
- Exploratory testing on latest Nightly with Nexus 5 (Android 6.0.1)
- Nightly History Panel
Date:2016-07-12
- Exploratory testing on latest Aurora, Nightly and 48 Beta 6 with:
- Motorola Razr (Android 4.4.4)
- LG G4 (Android 5.1)
Date:2016-08-04
- Exploratory testing on 49 Beta 1 with:
- Motorola Razr (Android 4.4.4)
- Asus ZenPad 8 (Android 5.0.2)
Date:2016-08-18
- Exploratory testing on latest Nightly with LG G4 (Android 5.1)
Date:2016-09-26
- Exploratory testing on all branches with Nexus 5 (Android 6.0.1)
Bug Work
Tracking bugs
- Meta bug
- bug 1265712 - (site-icons) [meta] Improve website icon quality
16 Total; 0 Open (0%); 11 Resolved (68.75%); 5 Verified (31.25%);
Still issues
[NEW] Bug 1265708 - Use apple-touch-icon-precomposed icons
[NEW] Bug 1263707 - Favicon (tippy top) pack for mobile
[NEW] Bug 1255048 - Use default Quick Search engine icons instead of favicons
[NEW] Bug 1234558 - Use icon from app manifest for "Add to home screen"
[NEW] Bug 925878 - Favicon redirection should exhibit better caching behavior
[NEW] Bug 1272648 - Consider supporting image_src icons
[NEW] Bug 1271594 - Tab.loadFavicon(): On failure discard explicit URL instead of first one
Bug fixed
[RESOLVED FIXED] Bug 1228680 - Replace default favicon (globe)
[RESOLVED FIXED] Bug 1265497 - Not-so-great favicon handling
[RESOLVED FIXED] Bug 1265710 - Consider using "Apple Touch Icons" in app UI (Instead of Favicons)
[RESOLVED FIXED] Bug 1265708 - No apple-touch-icon for some sites
[RESOLVED FIXED] Bug 1271634 - Link between history and favicon is not saved when favicon is loaded from cache
[RESOLVED FIXED] Bug 1269821 - Some favicon URLs are not stored or can not be restored
Signoff
Criteria
- All test cases should be executed
- All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed
Results
Nightly testing
- There were no blockers found while testing this feature.
- All bugs are fixed and verified
Aurora testing
- There were no blockers found while testing this feature.
- All bugs are fixed and verified
Beta testing
- There were no blockers found while testing this feature.
- All bugs are fixed and verified
