QA/Fennec/WebCompat GoFaster

From MozillaWiki
< QA‎ | Fennec
Jump to: navigation, search

Overview

Purpose

The purpose of this wiki is to serve as a guide for the QA team of WebCompat GoFaster feature activity.

Ownership

Developer contact:

QA:

Overall Status

Feature status doc

  • [LANDED] Nightly 63
  • [LANDED] Beta 63

Testing Summary

  • The Add-on WebCompat GoFaster will require a new update targeted on Firefox browser for Fennec by October 2018. WebCompat GoFaster needs an upgrade to v 2.0.1, so acceptance testing, regression testing and stress testing are required to discover any compatibility issues.

Scope of testing

Testing will be focused on:

  • Acceptance testing
  • Regression and exploratory testing
  • Visible performance issues

Environments

Testing will be performed on the following devices to provide a good coverage:

  • Phones - Android versions:
    • 5.x
    • 6.x
    • 7.x
    • 8.x
    • 9.x
  • Tablets - Android versions:
    • 5.x
    • 8.x
  • Both ARM and x86 architecture

Specifications

WebCompat GoFaster upgrade to v 2.0.1

Acceptance Criteria

Testing details

Test Cases

Testing days

Date: 08/14/2018

  • Created a test plan

Date: 08/16/2018

  • Investigate the feature
  • Create test Cases

Date: 08/17/2018

  • Execute Test Cases

Date: 08/26/2018

  • Update Test Cases
  • We started to run the test cases on Beta 63

Date: 10/10/2018

  • Finish to execute tests on Beta 63
  • Investigate bug 1480710

Date: 10/11/2018

  • Sign-Off Phase: pre-Release (Fennec 63)

Bug Work

Tracking bugs

bug 1338586 - Ship the GoFaster addon 2.0.1 to Fennec

Full Query
ID Priority Component Assigned to Summary Status Resolution Target milestone
755590 P1 Interventions Dennis Schubert [:denschub] Add UA override for sites.google.com - top bar doesn't show up in Firefox for Android VERIFIED FIXED ---
1383989 -- Interventions Dennis Schubert [:denschub] Enable overrides to be targeted to either desktop or mobile RESOLVED FIXED ---
1480710 -- Interventions Dennis Schubert [:denschub] m.imgur.com - Build UA override VERIFIED FIXED ---
1484294 -- Interventions 2.04% Resident Memory (android-em-4-2-x86) regression on push 18b999f1a4c141c31d83d13842de6231a774a34c (Thu Aug 16 2018) RESOLVED WONTFIX ---
1484324 -- Interventions Perma Android bustage due to duplicate files from webcompat addon when Gecko 63 merges to Beta on 2018-08-27 VERIFIED FIXED ---

5 Total; 0 Open (0%); 2 Resolved (40%); 3 Verified (60%);


Signoff

Criteria

  • All test cases should be executed
  • All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed

Results

Nightly testing

  • Pre-Beta Sign-off sent 23rd August, 2018

Beta testing

  • Pre-Beta Sign-off sent 11th October, 2018

Checklist