QA/Fennec/Enable ETP
From MozillaWiki
Last updated: 2019/08/16
Overview
Purpose
The purpose of this wiki is to serve as a general test plan for enable Enhanced Tracking Protection (“ETP”) tracking cookie restrictions in Fennec 68.
Ownership
Developer contact: Andrei Lazar
QA: Eliza Balazs
Overall Status
[LANDED] Nightly 70.0a1 (2019-07-10)
[LANDED] Fennec ESR 68 (2019-07-15)
Testing Summary
Timeline
- bug 1554071 - Enable ETP tracking cookie restriction in Fennec 68
QA Calendar
- Feature complete -
- QA pre-merge Regression Testing - (Nighty sign-off)
- Pre release preliminary status reports -
- Pre-Release feature Sign-offs - (Beta sign-off)
Scope of testing
The testing will focus on verifying the enabling of the tracking cookie restrictions.
Environments
Testing will be performed on the following Android devices:
- Devices with various Android versions.
Specifications
- bug 1554071 - Enable ETP tracking cookie restriction in Fennec 68
- Documentation:
User stories
- We would like to enable Enhanced Tracking Protection (“ETP”) tracking cookie restrictions in Fennec 68. ETP is a marketing term that includes multiple privacy features, including tracking cookie restrictions and a new Storage Access API. But in Fennec, we will only enable the tracking cookie restrictions. ETP is shipping to some Firefox 68 desktop users and later in Fenix. Since Fennec 68 will be maintained in ESR until mid-2020, we would like to use the same Tracking Protection code and have consistent messaging for all our browsers.
- ETP blocks third-party tracking cookies, but not tracker code. Regular TP blocks both third-party tracking cookies and tracker code, but is more likely to break websites that rely on third-party code than ETP is. ETP also has heuristics to avoid blocking third-party cookies that are needed for functionality like Facebook Login and Comments.
Acceptance Criteria
- All Test cases have passed.
Testing details
Test Cases
Testing days
Date: 05-29-2019
- Created Test Plan
Date: 06-19-2019
- Created Test Cases
Date: 06-24-2019
- Sign-off requirement for ETP Test Plan
Date: 07-15-2019
- We started to test on Fennec 70 with
- Google Pixel (Android Q) and HTC 10 (Android 8.0.0)
Date: 07-18-2019
- Tested on Fennec ESR 68.1b2 with OnePlus 5T (Android 9)
Date: 07-19-2019
- Pre-Release Sign-Off sent (YELLOW)
Date: 08-02-2019
- Bug verification with OnePlus 5T (Android 9)
Date: 08-13-2019
- Bug verification with Samsung Galaxy S8 (Android 9)
Bug Work
Tracking bugs
- bugs to track the feature
- bug 1554071 - Enable ETP tracking cookie restriction in Fennec 68
ID | Priority | Summary | Status | Resolution | Whiteboard |
---|---|---|---|---|---|
1561385 | P1 | Enable ETP cookie tracking restrictions by default for all GV apps | RESOLVED | FIXED | [geckoview:fenix:m7] [fennec68.1] |
1566746 | P2 | Add Tracking Cookies details in the doorhanger | RESOLVED | INCOMPLETE | |
1566836 | P2 | Tracking cookies are not disabled from the doorhanger | VERIFIED | FIXED | [fennec68.1] |
1568521 | P1 | Tracking protection doorhanger's Enable/Disable states don't work | VERIFIED | FIXED | |
1570731 | P2 | The shield icon disappears from the address bar when the page is reloaded | RESOLVED | INCOMPLETE | [fennec68.1] |
1572139 | P1 | Enable sending UI notifications for ETP on mobile | VERIFIED | FIXED | [fennec68.1] |
6 Total; 0 Open (0%); 3 Resolved (50%); 3 Verified (50%);
Signoff
Criteria
- All Test cases have passed.
Results
Nightly testing
- Feature stable
Beta testing
- Feature stable