QA/Fennec/containerless scrolling

Overview

Purpose

The purpose of this wiki is to serve as a general test plan for verifying that containerless scrolling features works correctly related to scrolling and zooming.

Ownership

Developer contact:

Botond Ballo[:botond]

QA contacts:

Laurentiu Apahidean

Catalin Suciu

Overall Status

[LANDED] : Nightly 67 in 02/15/2019

Testing Summary

Scope of testing

The testing will be focus on checking that there are no regressions on the existing behaviour related to scrolling and zooming.

Environments

Testing will be performed on following devices:

• Phones
  • [Done] OnePlus A3000 Android 6.0.1
  • [Done] Pixel 3 XL Android 9
  • [Done] Samsung Galaxy S8+ Android 8.0.0
  • [Done] Samsung Galaxy S9 Android 8.0.0

• Tablet
  • [Done][Huawei MediaPad M3 Lite 10 Android 7.0]
  • [Done][Google Pixel C Android 8.0.0]

Specifications

Trello: https://trello.com/c/KXeIT6AU/3513-containerless-scrolling

Acceptance Criteria

All Test cases have passed and all P1 bugs are fixed.

Testing details

Test Cases

• Containerless scrolling

Testing days

Date: 15-02-2019

• Created Test Plan
• Started working on TC's

Date: 18-02-2019

• Functional and exploratory testing on Nightly 67.0a1 (2019-02-18)
• Devices:
  • OnePlus A3000 Android 6.0.1 Testrail run
  • Pixel 3 XL Android 9 Testrail run
• New issues filed in Bugzilla
  • Bug 1528743 - The page 'jumps' when selecting text in a zoomed in state

Date: 20-02-2019

• Functional and exploratory testing on Nightly 67.0a1 (2019-02-20)
• Devices:
  • Samsung Galaxy S8+ Android 8.0.0 Testrail run
  • Samsung Galaxy S9 Android 8.0.0 Testrail run

• New issues filed in Bugzilla
  • none

Date: 21-02-2019

• Functional and exploratory testing on Nightly 67.0a1 (2019-02-21)
• Devices:
  • Huawei MediaPad M3 Lite 10 Android 7.0 Testrail run
  • Google Pixel C Android 8.0.0 Testrail run

• New issues filed in Bugzilla
  • none

Date: 13-03-2019

• Functional and exploratory testing on Nightly 67.0a1 (2019-03-13)
• Devices:
  • Huawei MediaPad M3 Lite 10 Android 7.0 Testrail run
  • Samsung Galaxy S8+ Android 8.0.0 Testrail run
  • Sony Xperia Z3 Android 5.1.1 Testrail run

• New issues filed in Bugzilla
  • none

Date: 20-03-2019

• Functional and exploratory testing on Beta 67.0b3
• Devices:
  • Samsung Galaxy S8+ Android 8.0.0 Testrail run
  • Google Pixel C Android 8.0.0 Testrail run
  • Sony Xperia Z5 Android 7.0.0 Testrail run

• New issues filed in Bugzilla
  • none

Date: 24-04-2019

• Functional and exploratory testing on Beta 67.0b13
• Devices:
  • Samsung Galaxy Tab A Android 7.0.0 Testrail run
  • Galaxy S9 Android 8.0.0 Testrail run
  • Pixel XL Android Q Testrail run

• New issues filed in Bugzilla
  • none

Bug Work

• Meta bug: bug 1137890 - (containerless-scrolling) Ship containerless scrolling on Android

Full Query

ID	Priority	Summary	Status	Resolution	Assigned to	Whiteboard
1123921	--	Turn on containerless scrolling for root scroll frames on desktop	RESOLVED	FIXED	David Anderson [:dvander] - inactive, e-mail if emergency
1153589	--	Turn on containerless scrolling for root scroll frames on B2G	RESOLVED	FIXED
1155025	--	make the root layer on fennec have null scroll id with containerless scrolling	RESOLVED	FIXED	Timothy Nikkel (:tnikkel)
1157066	--	test_animations_omta.html fails on Android with containerless scrolling	RESOLVED	FIXED	Timothy Nikkel (:tnikkel)
1158392	P3	Enable containerless scrolling on Fennec on the Nightly channel	RESOLVED	FIXED	Botond Ballo [:botond]
1527511	P3	Fix RTL scrollbar rendering at zoom levels greater than 1	RESOLVED	FIXED	Botond Ballo [:botond]
1527675	P3	Enable containerless scrolling on GeckoView on the Nightly channel	RESOLVED	FIXED	Botond Ballo [:botond]
1533607	P3	Assert the invariant that layers carrying RCD-RSF scroll metadata are inside the async zoom container	RESOLVED	FIXED	Botond Ballo [:botond]

8 Total; 0 Open (0%); 8 Resolved (100%); 0 Verified (0%);

• Meta bug: bug 1158392 - Enable containerless scrolling on Fennec on the Nightly channel

Full Query

ID	Priority	Summary	Status	Resolution	Assigned to	Whiteboard
1459312	P3	Basic support for APZ zooming with containerless scrolling	RESOLVED	FIXED	Botond Ballo [:botond]	[gfx-noted][geckoview:p3]
1522338	P3	Get scrollbar rendering to work with zooming + containerless scrolling	RESOLVED	FIXED	Botond Ballo [:botond]
1522714	P3	Get fixed-position hit testing to work with zooming + containerless scrolling	RESOLVED	FIXED	Botond Ballo [:botond]
1526486	P3	Green up Android tests with containerless scrolling enabled (part 1)	RESOLVED	FIXED	Botond Ballo [:botond]
1527516	P3	Green up Android tests with containerless scrolling enabled (part 2)	RESOLVED	FIXED	Botond Ballo [:botond]
1528743	P2	The page 'jumps' when selecting text in a zoomed in state	VERIFIED	FIXED	Botond Ballo [:botond]
1533796	--	Android reftest failures on 1133905-1-vh.html when Gecko 67 merges to beta on 2019-03-11	VERIFIED	FIXED	Botond Ballo [:botond]
1533803	P2	Android reftest failures on poster-6.html when Gecko 67 merges to beta on 2019-03-11	VERIFIED	FIXED	Botond Ballo [:botond]

8 Total; 0 Open (0%); 5 Resolved (62.5%); 3 Verified (37.5%);

Signoff

Criteria

• All test cases should be executed
• All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed

Results

Nightly testing

• There were no blockers found while testing this feature.
• All bugs are fixed and verified

Beta testing NA