Last updated: 2019/02/27

Overview

Purpose

The purpose of this wiki is to serve as a general test plan for testing Android ARM 64 Fennec.

Ownership

Developer contact:

QA:

Overall Status

[NOT LANDED] Nightly: n/a

[NOT LANDED] Beta: n/a

Testing Summary

https://testrail.stage.mozaws.net/index.php?/reports/view/1349

Timeline

2018-11-28 -- Build debug builds of ARM64 Fennec and GV bug 1467868
2018-11-29 -- PI-request sent by CPeterson
2018-12-07 -- Testing the build
2019-01-09 -- Sign-Off
2019-02-25 -- Testing on Beta 66.0b9
2019-02-27 -- Testing on Beta 66.0b11

Scope of testing

One-time smoke test on Android ARM64 Fennec.

Environments

Testing will be performed on the following devices:

Phones
- Sony Xperia Z5 Premium (Android 7.1.1)
- Google Pixel (Android 9.0)

Specifications

bug 1334963 - [meta] Port Fennec to Android/aarch64
https://docs.google.com/document/d/1STChyPX7LUgCancBm3jKIZcQaQwVuTSKnRpJcD9US2E/edit#

User stories

In August 2019, Google will require that Android apps with native code provide 64-bit versions in addition to their 32-bit versions. We will need to publish 32-bit ARM (aka ARMv7), ARM64 (aka AArch64), x86, and x86_64 versions of every GeckoView-powered app.

Acceptance Criteria

All smoketests have passed.

Testing details

Test Cases

Nightly:

testrail1 - Sony Xperia Z5 Premium (Android 7.1.1) / Nightly (2018-12-06)
testrail2 - Google Pixel (Android 9.0) / Nightly (2018-12-06)

Beta 66:

testrail3 - Sony Xperia Z5 Premium (Android 7.1.1) / Beta 66.0b9
testrail4 - Google Pixel (Android 9) / Beta 66.0b11

Testing days

Date: 2018-12-05

Contacted the developer to obtain the build for testing
Created Test Plan
Created Test Cases

Date: 2018-12-06

Contacted the PM, cpeterson, to obtain the build
Obtained the build

Date: 2018-12-07

Smoke and exploratory testing on Sony Xperia Z5 Premium (Android 7.1.1)
Smoke and exploratory testing on Google Pixel (Android 9.0)

Date: 2019-01-09

Sign-Off on Nightly

Date: 2019-02-25

Smoke and exploratory testing on Sony Xperia Z5 Premium (Android 7.1.1) / Beta 66.0b9

Date: 2019-02-27

Smoke and exploratory testing on Google Pixel (Android 9.0) / Beta 66.0b11

Verified bugs:
- {{Bug|

Bug Work

Tracking bugs

bugs to track the feature

ex:

Full Query

ID	Summary	Priority	Status
1467868	Add AArch64 Debug builds of Fennec and GV	--	RESOLVED

1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);

Signoff

January 9th, 2019

Criteria

All Test cases have passed.

Results

Nightly testing

Issues:

New issues
- bug 1512579 - [ARM64] "Sync now" is not working
- bug 1512583 - [ARM64] "Show search suggestions" is not working

Important issues
- bug 1512579 - [ARM64] "Sync now" is not working

Known issues - reproducible on all Fennec builds
- bug 1384860 - No focus on URL bar when Welcome screen is dismissed
- bug 1511946 - Switch to tab icon and text doesn`t appear on Top Sites
- bug 1507087 - Sharing a selected word/text on Facebook is not working
- bug 807762 - Selection handles and selection disappears when choosing "Select All" from the context menu for text controls
- bug 1512409 - amazon.com when bookmarked does not display the name of the page
- bug 865185 - Download is restarted after resuming a paused download
- bug 1490011 - Extra space is displayed in Custom Tab toolbar
- bug 1505720 - crash [@ java.lang.NullPointerException: at org.mozilla.gecko.fxa.authenticator.AndroidFxAccount.renameAccountIfNecessary(AndroidFxAccount.java)]
- bug 1404260 - Top Sites are reduced to only 3 when performing sync
- bug 1374264 - Fennec Bookmark Management: Folder order incorrect if no sync/sync is performed

Beta testing