« Fennec 16.0 Beta 5 | Fennec 16 Beta 6 | Fennec 16 RC 1 »

Fennec (Firefox for Android) 16.0 Beta 6 Test Plan

Release: Week of October 2nd, 2012
QA Contact: Aaron Train; Kevin Brosnan
IRC: irc://irc.mozilla.org#qa ping AaronMT; kbrosnan; ioanachiorean
Builds: Fennec (Firefox for Android) 16 Beta 6 | changeset | pushlog

Features

See the Feature Release Tracking wiki for a general overview of this release. Found below are a subset of all high-priority items

Feature	Owner	Status	Tests
Send Tab to Device	Andreea	On track	QA Feature Tracking & MozTrap References
Google Play Review Solicitation	Nicolae	On track	QA Feature Tracking & MozTrap References
Reading List & Reading Mode	Nicolae	On track	QA Feature Tracking & MozTrap References
Android Helper Applications	Kevin	On track	QA Feature Tracking & MozTrap References
Platform ARMv6 Support	All	On track	QA Feature Tracking & MozTrap References

Smoketests

QA Task	Person/Group	How Often?
Smoketests	Softvision	Every Beta

Light verification tests (or smoketests) will be first run when the builds are ready. Tests are available on Mozilla Moztrap under the 16.0 smoketest suite. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.

Assigned	Device	Completed	Results
Adrian Tamas	Samsung Galaxy R (Android 2.3.4)	September 26th, 2012	PASS
Adrian Tamas	Samsung Galaxy Tab 2 7.0 (Android 4.0.4)	September 26th, 2012	PASS
Ioana Chiorean	LG Slider (Android 2.3.4, ARMv6)	September 26th, 2012	bug 792428
Ioana Chiorean	Samsung Galaxy Tab (Android 3.1)	September 26th, 2012	PASS
Andreea Pod	Samsung Galaxy Nexus (Android 4.1.1)	September 26th, 2012	PASS
Andreea Pod	Samsung Galaxy Captivate (Android 2.2)	September 26th, 2012	PASS

Detailed Smoketest results

Android Permissions Testing

QA Task	Person/Group	How Often?
Verification	Softvision	Every Beta

Assigned	Device	Completed	Results
Adrian Tamas	Samsung Galaxy R (Android 2.3.4, ARMv7)	October 3rd, 2012	PASS
Ioana Chiorean	LG Slider (Android 2.3.4, ARMv6)	October 3rd, 2012	PASS
Ioana Chiorean	Samsung Galaxy Tab (Android.3.1)	October 3rd, 2012	PASS

Detailed Android Permissions Testing Results
Verify permissions between what is currently on the store and with this beta build candidate.
Details: Android Permissions

L10N (Localization) Spot Checks

QA Task	Person/Group	How Often?
Spot Check Verification	SoftVision	Every Beta

Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.

Assigned	Device	Completed	Results
Ioana Chiorean	Galaxy Nexus 4.1	October 3rd, 2012	PASS

Detailed L10N matrix

Branch Bug Fix Verifications

QA Task	Person/Group	How Often?
Verification	Softvision	Every Beta

Firefox for Android (16) Bugs

AppThwack Automation

QA Task	Person/Group	How often?
Runs against ARMv6 and ARMv7	Aaron	Alternating

Automated installation, uninstallation, and Android Monkeyrunner tests against uploaded ARM6 and ARMv7 builds; primarily useful for detecting startup crashes, incompatibilities, install-times and UI oddities

Assigned	Build	Completed	Results
Aaron Train	fennec-16.0b6.multi.android-arm.apk	October 3rd, 2012	PASS
Aaron Train	fennec-16.0b6.multi.android-arm-armv6.apk	October 3rd, 2012	PASS

Detailed AppThwack Results