Latest revision as of 06:30, 3 March 2015

« Fennec 36.0 build 1 | Fennec 37 Beta 1 | Fennec 37 Beta 2 »

Fennec (Firefox for Android) 37 Beta 1 (build 1) Test Plan

Release Week: February 23rd, 2014
QA Contact: Aaron Train; Kevin Brosnan
IRC: irc://irc.mozilla.org#qa ping AaronMT; kbrosnan; ioanachiorean;
Build 1: Fennec (Firefox for Android) 37 Beta 1 | changeset | pushlog

Features

See the Feature Release Tracking wiki for a general overview of this release. Found below are a subset of all high-priority items

Checklist

Pre-release

[DONE] Smoketests executed, including new features and Yahoo search default, with no blockers found
[DONE] Android permissions tested with no blockers found
[DONE] Branch bug fix verifications completed with no blockers found
[DONE] L10n spotchecks completed, including br & eo locales, with no blockers found
[DONE] AppThwack automation executed with no blockers found

Post-release

Verify release notes
Verify updates from previous Beta (no update on Gingerbread)
Verify download from the Play store
Verify download from beta.mozilla.org

Smoketests

QA Task	Person/Group	How Often?
Smoketests	Softvision	Every Beta

Light verification tests (or smoketests) will be first run when the builds are ready. Tests are available on Mozilla Moztrap under the 37.0 smoketest suite. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.

Assigned	API type	Device	Completed	Results
Ioana Chiorean	API 11	Nexus 5 (Android 5.1.0)	February 24th, 2015	PASS
Teodora Vermesan	API 11	Alcatel One Touch (Android 4.1.2)	February 24th, 2015	PASS
Flaviu Cos	API 11	Google Nexus 7 (Android 5.0.2)	February 24th, 2015	PASS
Catalin Suciu	API 11	Sony Zperia Z2 (Android 4.4.4)	February 24th, 2015	PASS
Catalin Suciu	API 11	ZTE x86 (Android 4.0.4)	February 24th, 2015	PASS
Teodora Vermesan	API 9	HTC Desire HD (Android 2.3.5)	February 25th, 2015	PASS
Catalin Suciu	API 9	Acer Iconia (Android 3.2.1) (light smoke)	February 25th, 2015	PASS

Detailed Smoketest results

Android Permissions Testing

QA Task	Person/Group	How Often?
Verification	Softvision	Every Beta

Assigned	Device	Completed	Results
Flaviu Cos	Google Nexus 7 (Android 5.0.2)	February 24th, 2015	PASS
Catalin Suciu	ZTE x86 (Android 4.0.4)	February 24th, 2015	PASS
Teodora Vermesan	Alcatel One Touch (Android 4.1.2)	February 24th, 2015	PASS

Detailed Android Permissions Testing Results
Verify permissions between what is currently on the store and with this beta build candidate.
Details: Android Permissions

Branch Bug Fix Verifications

QA Task	Person/Group	How Often?
Verification	Softvision	Every Beta

[http:// mzl.la/14TC7kg Firefox for Android (36) Bugs]

Assigned	Completed	Results
Flaviu Cos	February 24th, 2015	DONE

Detailed Bug Verification

L10N (Localization) Spot Checks

QA Task	Person/Group	How Often?
Builds Verification	SoftVision	Every Beta

Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.

Assigned	Completed	Results
Teodora Vermesan	February 24th, 2015	PASS

Detailed L10N matrix

AppThwack Automation

QA Task	Person/Group	How often?
Runs against ARMv6 and ARMv7	Ioana	Aurora SignOff, Beta 1,4,8, RC

Automated installation, uninstallation, and Android Monkeyrunner tests against uploaded ARM6 and ARMv7 builds; primarily useful for detecting startup crashes, incompatibilities, install-times and UI oddities

Assigned	Build	Completed	Results
Ioana Chiorean	Fennec API 11	February 24th, 2015	PASS

Detailed AppThwack Results

@@ Line 1: / Line 1: @@
-<small> « [[QA/Fennec/35/RC/1| Fennec 35.0 build 1]] | [[QA/Fennec/36/Beta/1| Fennec 36 Beta 1]]  | [[QA/Fennec/36/Beta/2| Fennec 36 Beta 2]]  »</small>
+<small> « [[QA/Fennec/36/RC/1| Fennec 36.0 build 1]] | [[QA/Fennec/37/Beta/1| Fennec 37 Beta 1]]  | [[QA/Fennec/37/Beta/2| Fennec 37 Beta 2]]  »</small>
-= Fennec (Firefox for Android) 36 Beta 1 (build 1) Test Plan =
+= Fennec (Firefox for Android) 37 Beta 1 (build 1) Test Plan =
 * Release Week: February 23rd, 2014
 * QA Contact: [mailto:atrain@mozilla.com Aaron Train]; [mailto:kbrosnan@mozilla.com Kevin Brosnan]
@@ Line 7: / Line 7: @@
 * Build 1: [ftp://ftp.mozilla.org/pub/mozilla.org/mobile/candidates/37.0b1-candidates/build1/ Fennec (Firefox for Android) 37 Beta 1] | [http://hg.mozilla.org/releases/mozilla-beta/rev/ changeset] | [https://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=FENNEC_36_0b10_RELEASE&tochange=FENNEC_37_0b1_RELEASE pushlog]
 === Features ===
-''See the [https://wiki.mozilla.org/Mobile/Roadmap/Tracking_Fx36 Feature Release Tracking] wiki for a general overview of this release. Found below are a subset of all high-priority items''
+''See the [https://wiki.mozilla.org/Mobile/Roadmap/Tracking_Fx37 Feature Release Tracking] wiki for a general overview of this release. Found below are a subset of all high-priority items''
 = Checklist =
 Pre-release
-* Smoketests executed, including new features and Yahoo search default, with no blockers found
+* {{mdone}} Smoketests executed, including new features and Yahoo search default, with no blockers found
-* Android permissions tested with no blockers found
+* {{mdone}} Android permissions tested with no blockers found
-* Branch bug fix verifications completed with no blockers found
+* {{mdone}} Branch bug fix verifications completed with no blockers found
-* L10n spotchecks completed, including br & eo locales, with no blockers found
+* {{mdone}} L10n spotchecks completed, including br & eo locales, with no blockers found
-* AppThwack automation executed with no blockers found
+* {{mdone}} AppThwack automation executed with no blockers found

QA/Fennec/37/Beta/1: Difference between revisions