QA/Fennec/18/Release/18.0.2

From MozillaWiki
< QA‎ | Fennec
Jump to: navigation, search

«Fennec 18 RC 1 | Fennec 18.0.2 | Fennec 19 Beta 1 »

Fennec (Firefox for Android) 18.0.2 Crash-Fix Release Test Plan

Firefox for Android 18.0.2 Crash-Fix Testing & Verification

This test-plan is focused around the patch applied to mozilla-release (18), mozilla-beta (19), mozilla-aurora (20), mozilla-central (21) in bug 838603 that fixes a startup crash introduced by a an issue with the Android blocklist mechanism.

  • Steps to Reproduce the start-up crash
    • bug 838603 [comment #28] (please replace with equivalent mozilla-release builds)
    • Primarily going from Fennec 16 (Crash) →Fennec 17 (Crash) → Fennec 18 (Fixed)


Results

Bug Tester Device Build Verification Test Result
bug 824118 Aaron Train (:AaronMT) Asus Nexus 7 (Android 4.2) mozilla-beta (19) No start-up crash; layers.acceleration.force-enabled, true PASS
bug 824118 Aaron Train (:AaronMT) Samsung Galaxy Note (Android 4.0) mozilla-aurora (20) No start-up crash; layers.acceleration.force-enabled, true PASS
bug 824118 Aaron Train (:AaronMT) LGE Nexus 4 (Android 4.2) mozilla-central (21) No start-up crash; layers.acceleration.force-enabled, true PASS
bug 824118 Aaron Train (:AaronMT) Samsung Galaxy Note II (Android 4.1) mozilla-central (21) No start-up crash; layers.acceleration.force-enabled, true PASS
bug 824118 Aaron Train (:AaronMT) Samsung Galaxy Nexus (Android 4.2) mozilla-central (21) No start-up crash; layers.acceleration.force-enabled, true PASS
bug 824118 Aaron Train (:AaronMT) Samsung Galaxy SII (Android 4.0.4) mozilla-central (21) No start-up crash; layers.acceleration.force-enabled, true PASS
bug 824118 Aaron Train (:AaronMT) Asus Transformer Prime TF201 (Android 4.0) mozilla-central (21) No start-up crash; layers.acceleration.force-enabled, true PASS
bug 824118 Aaron Train (:AaronMT) HTC Status (ARMv6) (Android 2.3) mozilla-central (21) No start-up crash; layers.acceleration.force-enabled, true PASS
bug 824118 Kevin Brosnan (:kbrosnan) Asus Transformer TF101 (Android 3.2) mozilla-central (21) No start-up crash; layers.acceleration.force-enabled, true PASS
bug 824118 Ioana Chiorean (:ioanachiorean) Samsung Galaxy Nexus (Android 4.1.1) mozilla-release (21) No start-up crash; layers.acceleration.force-enabled, true PASS
bug 824118 Aaron Train (:AaronMT) Asus Nexus 7 (Android 4.2) mozilla-release (18) No start-up crash; layers.acceleration.force-enabled, true PASS
bug 824118 Aaron Train (:AaronMT) Samsung Galaxy Tab 2 (Android 4.0) mozilla-release (18) No start-up crash; layers.acceleration.force-enabled, true PASS
bug 824118 Aaron Train (:AaronMT) HTC Nexus One (Android 2.3) mozilla-release (18) No start-up crash; layers.acceleration.force-enabled, true PASS
bug 824118 Aaron Train (:AaronMT) Samsung Nexus S (Android 4.1) mozilla-release (18) No start-up crash; layers.acceleration.force-enabled, true PASS
bug 824118 Ioana Chiorean (:ioanachiorean) Samsung Galaxy Nexus (Android 4.1.1) mozilla-release (18) No start-up crash; layers.acceleration.force-enabled, true PASS
bug 824118 Adrian Tamas Motorola Droid 3 (Android 2.3) mozilla-release (18) No start-up crash; layers.acceleration.force-enabled, true PASS
bug 824118 Andreea Pod Samsung Galaxy Tab 10.1 (Android 3.1) mozilla-release (18) No start-up crash; layers.acceleration.force-enabled, true PASS
bug 824118 mozilla-release (18)

A pass can be given when there is no start-up crash [1]; and tester has verified the about:config preference [2] value

  • [1] ###!!! ABORT: OpenGL-accelerated layers are a hard requirement on this platform. Cannot continue without support for them.: file ../../../widget/xpwidgets/nsBaseWidget.cpp, line 829
  • [2] layers.acceleration.force-enabled

Negative Testing

  • On a working build; toggle layers.acceleration.force-enabled to false; what is the output?
    • Reverting the force enable; re-triggers the crash (build pointing at bad blocklist)
    • New profile (build pointing at fixed blocklist), builds work as expected

Smoketests

QA Task Person/Group How Often?
Smoketests Softvision Every point release

Light verification tests (or smoketests) will be first run when the builds are ready. Tests are available on Mozilla Moztrap under the 18.0 smoketest suite. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.

Assigned Device Completed Results
Adrian Tamas Motorola Droid 3 (Android 2.3) 2013-02-07 PASS
Paul Feher Asus Transformer TF101 (Android 4.0.3) 2013-02-07 PASS
Andreea Pod Samsung Galaxy Tab 10.1 (Android 3.1) 2013-02-07 PASS
Ioana Chiorean Acer Iconia A500 (Android 3.1) 2013-02-07 PASS

Detailed Smoketest results

AppThwack Automation

QA Task Person/Group How often?
Runs against ARMv6 and ARMv7 Ioana Alternating

Automated installation, uninstallation, and Android Monkeyrunner tests against uploaded ARM6 and ARMv7 builds; primarily useful for detecting startup crashes, incompatibilities, install-times and UI oddities

Assigned Build Completed Results
Ioana Chiorean fennec-18.0.2.multi.android-arm.apk February 7th, 2012 PASS - 1 crash/app died

Detailed AppThwack Results