QA/Fennec/containerless scrolling

Overview

Purpose

The purpose of this wiki is to serve as a general test plan for verifying that containerless scrolling features works correctly related to scrolling and zooming.

Ownership

Developer contact:

Botond Ballo[:botond]

QA contacts:

Laurentiu Apahidean

Catalin Suciu

Overall Status

[LANDED] : Nightly 67 in 02/15/2019

Testing Summary

Scope of testing

The testing will be focus on checking that there are no regressions on the existing behaviour related to scrolling and zooming.

Environments

Testing will be performed on following devices:

• Phones
  • [Done] OnePlus A3000 Android 6.0.1
  • [Done] Pixel 3 XL Android 9
  • [Done] Samsung Galaxy S8+ Android 8.0.0
  • [Done] Samsung Galaxy S9 Android 8.0.0

• Tablet
  • [Done][Huawei MediaPad M3 Lite 10 Android 7.0]
  • [Done][Google Pixel C Android 8.0.0]

Specifications

Trello: https://trello.com/c/KXeIT6AU/3513-containerless-scrolling

Acceptance Criteria

All Test cases have passed and all P1 bugs are fixed.

Testing details

Test Cases

• Containerless scrolling

Testing days

Date: 15-02-2019

• Created Test Plan
• Started working on TC's

Date: 18-02-2019

• Functional and exploratory testing on Nightly 67.0a1 (2019-02-18)
• Devices:
  • OnePlus A3000 Android 6.0.1 Testrail run
  • Pixel 3 XL Android 9 Testrail run
• New issues filed in Bugzilla
  • Bug 1528743 - The page 'jumps' when selecting text in a zoomed in state

Date: 20-02-2019

• Functional and exploratory testing on Nightly 67.0a1 (2019-02-20)
• Devices:
  • Samsung Galaxy S8+ Android 8.0.0 Testrail run
  • Samsung Galaxy S9 Android 8.0.0 Testrail run

• New issues filed in Bugzilla
  • none

Date: 21-02-2019

• Functional and exploratory testing on Nightly 67.0a1 (2019-02-21)
• Devices:
  • Huawei MediaPad M3 Lite 10 Android 7.0 Testrail run
  • Google Pixel C Android 8.0.0 Testrail run

• New issues filed in Bugzilla
  • none

Date: 13-03-2019

• Functional and exploratory testing on Nightly 67.0a1 (2019-03-13)
• Devices:
  • Huawei MediaPad M3 Lite 10 Android 7.0 Testrail run
  • Samsung Galaxy S8+ Android 8.0.0 Testrail run
  • Sony Xperia Z3 Android 5.1.1 Testrail run

• New issues filed in Bugzilla
  • none

Date: 20-03-2019

• Functional and exploratory testing on Beta 67.0b3
• Devices:
  • Samsung Galaxy S8+ Android 8.0.0 Testrail run
  • Google Pixel C Android 8.0.0 Testrail run
  • Sony Xperia Z5 Android 7.0.0 Testrail run

• New issues filed in Bugzilla
  • none

Date: 24-04-2019

• Functional and exploratory testing on Beta 67.0b13
• Devices:
  • Samsung Galaxy Tab A Android 7.0.0 Testrail run
  • Galaxy S9 Android 8.0.0 Testrail run
  • Pixel XL Android Q Testrail run

• New issues filed in Bugzilla
  • none

Bug Work

• Meta bug: bug 1137890 - (containerless-scrolling) Ship containerless scrolling on Android

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 403 [1] => Forbidden ) ) 1

• Meta bug: bug 1158392 - Enable containerless scrolling on Fennec on the Nightly channel

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 403 [1] => Forbidden ) ) 1

Signoff

Criteria

• All test cases should be executed
• All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed

Results

Nightly testing

• There were no blockers found while testing this feature.
• All bugs are fixed and verified

Beta testing NA