QA/Fenix/Add-ons

From MozillaWiki
< QA
Jump to: navigation, search

Overview

Purpose

The purpose of this wiki is to serve as a general test plan for verifying that the users of Fenix can install, uninstall and update Extensions with GeckoView.

Ownership

Feature Owner: Vesta Zare

Engineers: Agi Sferro, Christian Sadelik, Arturo Mejia

QA: Mirabela Lobontiu

Overall Status

[LANDED] Nightly: first landed on - xx-yy-zzzz

[LANDED] Beta: first landed on - xx-yy-zzzz

Testing Summary

Scope of testing

The testing will be focused on:

  • Testing that approved add-ons are visible on the add-ons listing page.
  • Testing that approved add-ons can be installed and uninstalled.
  • Testing that approved add-ons can be enabled and disabled.
  • Testing that no add-ons that are not approved on Firefox Preview can be installed or enabled.
  • Testing that add-ons are active when enabled on web pages.
  • Testing that add-ons UI elements are present and functioning as expected in the menu areas.
  • Testing that the approved add-ons function as expected.

Milestone 1:

  • uBlock Origin, currently used by 14.5% of Fennec beta users

Milestone 2:

  • NoScript Security Suite 0.89% of Fennec beta users although a popular install according to AMO
  • HTTPS Everywhere: currently used by 3.3% of Fennec beta users
  • Privacy Badger: currently used by 2.6% of Fennec beta users
  • Dark Reader: currently used by 1.1% of Fennec beta users
  • Search By Image: currently used by 0.6% of Fennec beta users
  • Video download helper (Let’s investigate first!) 0.4% of Fennec beta users

Environments

Testing will be performed on the following devices:

  • Phones with Android 5.x, 6.x, 7.x, 8.x, 9.x, and 10.x
  • Tablets with Android 5.x, 6.x, 7.x, and 8.x

Specifications

  • information about the feature
    • how to use it: the user can get to the "Add-ons" page via the three-dot menu, or via the Settings menu.
    • turn on/off feature: the user can enable/disable the installed add-ons, or can remove the installed add-ons.
    • screenshots

User stories

  • As a user, I want to install add-ons that are available.
  • As a user, I want to enable/disable the installed add-ons.
  • As a user, I want to remove an installed add-on if I want to.

Acceptance Criteria

Testing details

Test Cases

Testing days

Date:08-01-2020

  • Created the Test Plan
  • Created the Test Cases

Bug Work

Tracking bugs

Full Query
ID Summary Priority Status
1554302 Cannot go back after navigating to main process pages (e.g. about: pages) P1 NEW
1582185 [meta] Add GeckoView support for installing/uninstalling extensions -- NEW
1582194 [meta] Support WebExtension APIs needed for Ad Blocking in GeckoView P2 NEW
1597793 Support tabs.onActivated P1 ASSIGNED
1598792 Expose |options_ui| to embedders P1 NEW
1599581 Implement update Extension P1 NEW
1599585 Implement enable/disable Extension P2 RESOLVED
1599897 When attaching a ActionDelegate, the delegate should receive the default action P2 RESOLVED
1600702 Main process pages do not render correctly after app is paused/resumed P1 RESOLVED
1600742 Implement list extensions P1 RESOLVED
1602565 WebExtension fails to register with "aEventDispatcher is null" P1 RESOLVED
1604222 Add a way to know if an addon is disabled by user or because not supported P1 RESOLVED

12 Total; 6 Open (50%); 6 Resolved (50%); 0 Verified (0%);


Still issues

Bug fixed

Signoff

Criteria

  • All test cases should be executed.
  • All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed.


Results

Nightly testing

  • There were no blockers found while testing this feature.
  • All bugs are fixed and verified.

Beta testing

  • There were no blockers found while testing this feature.
  • All bugs are fixed and verified.