QA/Fennec/Enable ETP

From MozillaWiki
< QA‎ | Fennec
Jump to: navigation, search
Last updated: 2019/08/16

Overview

Purpose

The purpose of this wiki is to serve as a general test plan for enable Enhanced Tracking Protection (“ETP”) tracking cookie restrictions in Fennec 68.

Ownership

Developer contact: Andrei Lazar

QA: Eliza Balazs

Overall Status

[LANDED] Nightly 70.0a1 (2019-07-10)

[LANDED] Fennec ESR 68 (2019-07-15)

Testing Summary

Timeline

  • bug 1554071 - Enable ETP tracking cookie restriction in Fennec 68

QA Calendar

  • Feature complete -
  • QA pre-merge Regression Testing - (Nighty sign-off)
  • Pre release preliminary status reports -
  • Pre-Release feature Sign-offs - (Beta sign-off)

Scope of testing

The testing will focus on verifying the enabling of the tracking cookie restrictions.

Environments

Testing will be performed on the following Android devices:

  • Devices with various Android versions.

Specifications

User stories

  • We would like to enable Enhanced Tracking Protection (“ETP”) tracking cookie restrictions in Fennec 68. ETP is a marketing term that includes multiple privacy features, including tracking cookie restrictions and a new Storage Access API. But in Fennec, we will only enable the tracking cookie restrictions. ETP is shipping to some Firefox 68 desktop users and later in Fenix. Since Fennec 68 will be maintained in ESR until mid-2020, we would like to use the same Tracking Protection code and have consistent messaging for all our browsers.
  • ETP blocks third-party tracking cookies, but not tracker code. Regular TP blocks both third-party tracking cookies and tracker code, but is more likely to break websites that rely on third-party code than ETP is. ETP also has heuristics to avoid blocking third-party cookies that are needed for functionality like Facebook Login and Comments.

Acceptance Criteria

Testing details

Test Cases

Testing days

Date: 05-29-2019

  • Created Test Plan

Date: 06-19-2019

  • Created Test Cases

Date: 06-24-2019

  • Sign-off requirement for ETP Test Plan

Date: 07-15-2019

  • We started to test on Fennec 70 with
    • Google Pixel (Android Q) and HTC 10 (Android 8.0.0)

Date: 07-18-2019

  • Tested on Fennec ESR 68.1b2 with OnePlus 5T (Android 9)

Date: 07-19-2019

  • Pre-Release Sign-Off sent (YELLOW)

Date: 08-02-2019

  • Bug verification with OnePlus 5T (Android 9)

Date: 08-13-2019

  • Bug verification with Samsung Galaxy S8 (Android 9)

Bug Work

Tracking bugs

  • bugs to track the feature
  • bug 1554071 - Enable ETP tracking cookie restriction in Fennec 68
Full Query
ID Priority Summary Status Resolution Whiteboard
1561385 P1 Enable ETP cookie tracking restrictions by default for all GV apps RESOLVED FIXED [geckoview:fenix:m7] [fennec68.1]
1566746 P2 Add Tracking Cookies details in the doorhanger RESOLVED INCOMPLETE
1566836 P2 Tracking cookies are not disabled from the doorhanger VERIFIED FIXED [fennec68.1]
1568521 P1 Tracking protection doorhanger's Enable/Disable states don't work VERIFIED FIXED
1570731 P2 The shield icon disappears from the address bar when the page is reloaded RESOLVED INCOMPLETE [fennec68.1]
1572139 P1 Enable sending UI notifications for ETP on mobile VERIFIED FIXED [fennec68.1]

6 Total; 0 Open (0%); 3 Resolved (50%); 3 Verified (50%);


Signoff

Criteria

Results

Nightly testing

  • Feature stable

Beta testing

  • Feature stable