QA/Fennec/Retain display lists

From MozillaWiki
< QA‎ | Fennec
Jump to: navigation, search
Last updated: 2019/05/20

Overview

Purpose

The purpose of this wiki is to serve as a general test plan for testing Retained display lists for Android.

Scope

  • Performance feature to improve web page painting performance by avoiding redundant calculations during paint.
  • The only user-visible change this should cause is (hopefully) slightly faster painting. We want to make sure that there are no correctness or performance regressions. The main workflows that we want to make sure don't cause painting correctness regressions are interacting with pages, scrolling, tapping, zooming, etc.
  • The pref "layout.display-list.retain" will be used to control turning on/off the feature.

User stories

  • As a user, I want the pages I load to render correctly, with no visible layout problems.
  • As a user, I want the pages I load to render without glitches, interruptions.
  • As a user, I want to scroll, tap or zoom on pages without interruptions.

Ownership

Developer contact: Timothy Nikkel (slack: tnikkel)

QA: *Mirabela Lobontiu-Roman (slack: mlobontiuroman)

Overall Status

[LANDED] Nightly: 68.0a1 (under pref)

Testing Summary

Scope of testing

All Retain display lists related bugs will be covered and verified, on multiple Android devices.

Environments

Testing will be performed on the following devices:

  • Phones
    • Samsung Galaxy S8 (Android 9.0)
    • HTC 10 (Android 8.0)
    • Huawei Honor 8 (Android 7.0)
    • OnePlus Two (Android 6.0.1)
    • Google Pixel (Android Q)
  • Tablets
    • Samsung Galaxy Tab S3 (Android 8.0)
    • Nexus 9 (Android 7.1.1)

Specifications

Acceptance Criteria

  • All tests should pass.

Testing details

Test Cases

Nightly:

Testing days

Date: 2019-04-02

  • Created Test Plan
  • Created Test Cases

Date: 2019-04-08

  • Testing on Nightly 68.0a1 on Samsung Galaxy S8 (Android 9.0)
  • Testing on Nightly 68.0a1 on HTC 10 (Android 8.0)
  • Testing on Nightly 68.0a1 on Huawei Honor 8 (Android 7.0)

Date: 2019-04-10

Date: 2019-04-15

  • Testing on Nightly 68.0a1 on Google Pixel (Android Q)

Date: 2019-05-08

  • Testing on Nightly 68.0a1 (2019-05-07) on Samsung Galaxy Tab S3 (Android 8.0)

Date: 2019-05-09

  • Testing on Nightly 68.0a1 (2019-05-08) on Huawei Honor 8 (Android 7.0)

Date: 2019-05-10

  • Testing on Nightly 68.0a1 (2019-05-08) on OnePlus Two (Android 6.0.1)

Date: 2019-05-20

  • Testing on Nightly 68.0a1 on Samsung Galaxy S8 (Android 9.0)

Tracking bugs

  • Bugs to track the feature
    • bug 1413567 - Enable Retained Display Lists for Android
Full Query
ID Priority Summary Status Resolution Whiteboard
1137890 P3 Ship containerless scrolling on Android RESOLVED FIXED
1413526 -- retained display lists don't check process types consistently RESOLVED FIXED
1537667 -- allow the 'layout.display-list.retain' pref to work on android RESOLVED FIXED
1539391 -- nsSubDocumentFrame can add/remove nsDisplayZoom and nsDisplayResolution items without invalidating RESOLVED FIXED
1540908 -- layout/reftests/scrolling/fixed-opacity-2.html fails on android with RDL RESOLVED FIXED

5 Total; 0 Open (0%); 5 Resolved (100%); 0 Verified (0%);


Signoff

Criteria

  • All Test cases should pass.
  • All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed (as determined by engineering/QA).

Results

Nightly testing

Date 08-04-2019

  • Feature testing - Retain Display List - Nightly 68.0a1 on Samsung Galaxy S8 (Android 9.0)
  • Feature testing - Retain Display List - Nightly 68.0a1 on HTC 10 (Android 8.0)
  • Feature testing - Retain Display List - Nightly 68.0a1 on Huawei Honor 8 (Android 7.0)

Date 10-04-2019

  • Feature testing - Retain Display List - Nightly 68.0a1 on Samsung Galaxy Tab S3 (Android 8.0)
    • bug 1543342 - Scrolling is laggy on linkedin.com
    • bug 1429931 - Location permission prompt is automatically dismissed when loading maps.google.com
    • bug 1473486 - The games thumbnails are displayed black when scrolling on hhtp://m.twitch.tv
  • Feature testing - Retain Display List - Nightly 68.0a1 on Nexus 9 (Android 7.1.1)
    • bug 1543342 - Scrolling is laggy on linkedin.com
    • bug 1429931 - Location permission prompt is automatically dismissed when loading maps.google.com
    • bug 1473486 - The games thumbnails are displayed black when scrolling on hhtp://m.twitch.tv
  • Feature testing - Retain Display List - Nightly 68.0a1 on OnePlus Two (Android 6.0.1)
    • bug 1543342 - Scrolling is laggy on linkedin.com
    • bug 1429931 - Location permission prompt is automatically dismissed when loading maps.google.com
    • bug 1473486 - The games thumbnails are displayed black when scrolling on hhtp://m.twitch.tv

Date 15-04-2019

  • Feature testing - Retain Display List - Nightly 68.0a1 on Google Pixel (Android Q)

Date 08-05-2019

  • Feature testing - Retain Display List - Nightly 68.0a1 (2019-05-07) on Samsung Galaxy Tab S3 (Android 8.0)
    • bug 1549966 - Search bar from pinterest.com is not fixed
    • bug 1202041 - Loading BBC is slow on some devices
    • bug 1473486 - The games thumbnails are displayed black when scrolling on hhtp://m.twitch.tv

Date 09-05-2019

  • Feature testing - Retain Display List - Nightly 68.0a1 (2019-05-08) on Huawei Honor 8 (Android 7.0)
    • bug 1202041 - Loading BBC is slow on some devices
    • bug 1473486 - The games thumbnails are displayed black when scrolling on hhtp://m.twitch.tv

Date 10-05-2019

  • Feature testing - Retain Display List - Nightly 68.0a1 (2019-05-08) on OnePlus Two (Android 6.0.1)
    • bug 1473486 - The games thumbnails are displayed black when scrolling on hhtp://m.twitch.tv

Date: 2019-05-20

  • Feature testing - Retain Display List - Nightly 68.0a1 on Samsung Galaxy S8 (Android 9.0)
    • bug 1473486 - The games thumbnails are displayed black when scrolling on hhtp://m.twitch.tv

Checklist

Exit Criteria Status Notes/Details
Testing Infrastructure setup Done
Test Plan Creation Done
Test Cases Creation Done
All Defects Logged Done
Critical/Blockers Fixed and Verified N/A
QA mid-Nightly Signoff Status:
QA Nightly - Full Testing Status:
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Fennec/Retain_display_lists&oldid=1212603"