QA/Fennec/WebCompat GoFaster
From MozillaWiki
Overview
Purpose
The purpose of this wiki is to serve as a guide for the QA team of WebCompat GoFaster feature activity.
Ownership
Developer contact:
QA:
Overall Status
- [LANDED] Nightly 63
- [LANDED] Beta 63
Testing Summary
- The Add-on WebCompat GoFaster will require a new update targeted on Firefox browser for Fennec by October 2018. WebCompat GoFaster needs an upgrade to v 2.0.1, so acceptance testing, regression testing and stress testing are required to discover any compatibility issues.
Scope of testing
Testing will be focused on:
- Acceptance testing
- Regression and exploratory testing
- Visible performance issues
Environments
Testing will be performed on the following devices to provide a good coverage:
- Phones - Android versions:
- 5.x
- 6.x
- 7.x
- 8.x
- 9.x
- Tablets - Android versions:
- 5.x
- 8.x
- Both ARM and x86 architecture
Specifications
WebCompat GoFaster upgrade to v 2.0.1
Acceptance Criteria
Testing details
Test Cases
Testing days
Date: 08/14/2018
- Created a test plan
Date: 08/16/2018
- Investigate the feature
- Create test Cases
Date: 08/17/2018
- Execute Test Cases
Date: 08/26/2018
- Update Test Cases
- We started to run the test cases on Beta 63
Date: 10/10/2018
- Finish to execute tests on Beta 63
- Investigate bug 1480710
Date: 10/11/2018
- Sign-Off Phase: pre-Release (Fennec 63)
Bug Work
Tracking bugs
bug 1338586 - Ship the GoFaster addon 2.0.1 to Fennec
ID | Priority | Component | Assigned to | Summary | Status | Resolution | Target milestone |
---|---|---|---|---|---|---|---|
755590 | P1 | Interventions | Dennis Schubert [:denschub] | Add UA override for sites.google.com - top bar doesn't show up in Firefox for Android | VERIFIED | FIXED | --- |
1383989 | -- | Interventions | Dennis Schubert [:denschub] | Enable overrides to be targeted to either desktop or mobile | RESOLVED | FIXED | --- |
1480710 | -- | Interventions | Dennis Schubert [:denschub] | m.imgur.com - Build UA override | VERIFIED | FIXED | --- |
1484294 | -- | Interventions | 2.04% Resident Memory (android-em-4-2-x86) regression on push 18b999f1a4c141c31d83d13842de6231a774a34c (Thu Aug 16 2018) | RESOLVED | WONTFIX | --- | |
1484324 | -- | Interventions | Perma Android bustage due to duplicate files from webcompat addon when Gecko 63 merges to Beta on 2018-08-27 | VERIFIED | FIXED | --- |
5 Total; 0 Open (0%); 2 Resolved (40%); 3 Verified (60%);
Signoff
Criteria
- All test cases should be executed
- All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed
Results
Nightly testing
- Pre-Beta Sign-off sent 23rd August, 2018
Beta testing
- Pre-Beta Sign-off sent 11th October, 2018