Overview

Purpose

The purpose of this wiki is to serve as a general test plan for verifying that top 5 Alexa sites are displayed in about:home in top sites grid view

Ownership

Developer contacts:

Ownership

Developer contacts: Mark Finkle (:mfinkle)

QA: Teodora Vermesan (:TeoVermesan)

Overall Status

[LANDED] Nightly 46: first landed on - 10-01-2016

[LANDED] Aurora 46: first landed on - 26-01-2016

[LANDED] Beta46 1: first landed on - 08-03-2016

Testing Summary

Scope of testing

The testing will be focus on

• verifying that top 5 alexa sites are displayed in about:home in top sites grid view
• verifying that the user is able to delete the top x Alexa websites from top sites if he doesn't like them
• verifying that the user can add his own sites to the topsites to control browser experience

Environments

Testing will be performed on following devices:

• Phones
  • 4.x
  • 5.x
  • 6.0
• Tablet
  • 4.x
  • 5.x
  • 6.0

Specifications

• Make sure to allow some room / flexibility to be used by the partner, followed by the remaining 3 from the standard list.
• Include one (last) tile to show the user it's their space to customize, e.g. with "+" tile
• For now, include top 5 Alexa sites (without adult content) globally

User stories

• As a user, I want to conveniently access the most browsed websites (by everyone) as some of them might be also used by me
• As a user, I want to delete the top x Alexa websites from my top sites if I don't like them
• As a user, I want to add my own sites to the topsites to control my browser experience

Acceptance Criteria

• Alexa websites won't overtake and ignore freceny of other websites
• Alexa websites show up without adult content

Testing details

Test Cases

• Alexa top 5 sites as default suggested tiles

Testing days

Date:13-01-2016

• Top 5 Alexa sites in about:home for Nightly

Date:01-02-2016

• Top 5 Alexa sites in about:home for Nightly

Bug Work

Tracking bugs

• bugs to track the feature

ex:

Full Query

ID	Summary	Priority	Status
1208410	Remove 'Firefox Marketplace' from the list of default Top Sites thumbnails	--	VERIFIED
1215731	Update suggested sites list to be helpful	--	RESOLVED
1232746	Document process for generating inline autocomplete domain list	--	RESOLVED
1238387	Gradle build fails because suggested sites resource not found.	--	RESOLVED

4 Total; 0 Open (0%); 3 Resolved (75%); 1 Verified (25%);

Still issues

[NEW] Bug 1215731 - Update suggested sites list to be helpful

Bug fixed

[RESOLVED FIXED] Bug 1232746 - Document process for generating inline autocomplete domain list
[RESOLVED FIXED] Bug 1238387 - Gradle build fails because suggested sites resource not found.
[RESOLVED FIXED] Bug 1208410 - Remove 'Firefox Marketplace' from the list of default Top Sites thumbnails

↳ 2015-10-19 : verified fixed on Firefox for Android 44.0.1 (2015-10-18) using Asus Transformer Pad (Android 4.2.1).

[RESOLVED FIXED] Bug 1216987 - Use Alexa top 5 sites as default suggested tiles

↳ 2016-01-15 : verified fixed on Firefox for Android 46.0a1 2016-01-15 using Asus Zenpad 8 (Android 5.0.2).

Signoff

Criteria

• All test cases should be executed
• All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed

Results

Nightly testing

• Top Sites display top 5 alexa top sites:
  • 1. Facebook
  • 2. Youtube
  • 3. Amazon
  • 4. Wikipedia
  • 5. Twitter

Aurora testing

• Top Sites display top 5 alexa top sites:
  • 1. Facebook
  • 2. Youtube
  • 3. Amazon
  • 4. Wikipedia
  • 5. Twitter

Beta testing

• Top Sites display top 5 alexa top sites:
  • 1. Facebook
  • 2. Youtube
  • 3. Amazon
  • 4. Wikipedia
  • 5. Twitter