QA/Fennec/Drop Android API 15 support

From MozillaWiki
< QA‎ | Fennec
Jump to: navigation, search

Overview

Purpose

The purpose of this wiki is to serve as a general test plan for verifying that dropping the support for API 15 will not produce any regressions.

Ownership

Developer contact: QA: :ioanachiorean

Overall Status

[LANDED] Nightly 56.0a1 [LANDED] Beta 56: first landed on Beta 1

Testing Summary

Scope of testing

The testing will be focus on

  • making sure the last build recieve for API 15 OSes will be Fennec 56
  • making sure that starting with Fennec 56 API 15 OSes will no longer receive updates for Fennec and they will be notified about this.

Environments

Testing will be performed on following devices:

  • Phones
    • From Android 4.0 to 7.1
  • Tablet
    • From Android 4.0 to 7.1

Specifications

User stories

Acceptance Criteria

Testing details

Test Cases

Testing days

Date:10-07-2017

  • Test plan Creation

Date:24-07-2017

  • SuMO page to track
  • Consulted bug - bug 1220720 - Message EOL plan to Honeycomb users

Date:28-07-2017

  • Devices:
    • ZTE Grand X In - Android 4.0.4 - x86 architecture
    • HTC Sensations 4G - Android 4.0.3
  • Bugs verified:
  • Screenshot
  • Nightly
  • Nightly

Bug Work

Bug Work

  • Meta bug
ID Priority Summary Status Assigned to
1352602 -- Use ANDROID_TARGET_SDK and MOZ_ANDROID_MIN_SDK_VERSION consistently in Gradle and AndroidManifest.xml.in; add MOZ_ANDROID_COMPILE_SDK_VERSION RESOLVED Nick Alexander :nalexander
1379190 P3 Remove AndroidDecoderReader RESOLVED Jean-Yves Avenard [:jya]
1382081 -- Notify API 15 user EOL VERIFIED Max Liu [:maliu]
1384482 P1 Fennec: Make Treeherder and archive.mozilla.org broadcast the right Android API level (API-16+) NEW Johan Lorenzo [:jlorenzo]
1385346 -- Improve Error message when trying to install a new build on API 15 devices RESOLVED

5 Total; 1 Open (20%); 3 Resolved (60%); 1 Verified (20%);


Bug fixed

Signoff

Criteria

  • All test cases should be executed
  • All blockers, critical issues must be fixed and verified or have an agreed-upon timeline for being fixed


Results

Nightly testing

  • in progress

Beta testing

  • n/a