Confirm
7,000
edits
Changes
adding testplan
<small> « [[QA/Fennec/35/Beta/8| Fennec 35 Beta 8 ]] | [[QA/Fennec/35/Beta/10| Fennec 35 Beta 10]] | [[QA/Fennec/35/RC/1| Fennec 35 RC 1]] »</small>
= Fennec (Firefox for Android) 35 Beta 10 (build 1) Test Plan =
* Release Week: January 5th, 2014
* QA Contact: [mailto:kbrosnan@mozilla.com Kevin Brosnan];
* IRC: irc://irc.mozilla.org#qa ping kbrosnan; ioanachiorean;
* Build 1: [ftp://ftp.mozilla.org/pub/mozilla.org/mobile/candidates/35.0b10-candidates/build1/ Fennec (Firefox for Android) 35 Beta 10] | [https://hg.mozilla.org/releases/mozilla-beta/rev/ changeset] | [https://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=FENNEC_35_0b8_BUILD1&tochange=FENNEC_35_0b10_BUILD1 pushlog]
= Checklist =
Pre-release
* Smoketests executed, including new features and Yahoo search default, with no blockers
* Android permissions tested with no blockers found
* Branch bug fix verifications completed with no blockers found
* L10n spotchecks completed, including br & eo locales, with no blockers found
* Run Appthwack against the ARMv7 build.
** due to {{Bug|1058160}} Appthwack runs the tests against the wrong activity - not very helpful so we decided not to run them.
Post-release
* Verify release notes
* Verify updates from previous Beta (no update on Gingerbread)
* Verify download from the Play store / Yandex/ TStore
* Verify download from beta.mozilla.org
= Smoketests =
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| Smoketests
| Softvision
| Every Beta
|}
Light verification tests (or smoketests) will be first run when the builds are ready. Tests are available on [https://moztrap.mozilla.org/manage/cases/ Mozilla Moztrap] under the [https://moztrap.mozilla.org/results/cases/?filter-run= 35.0 smoketest suite]. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.
{{:QA/Fennec/35/Beta/10/smoketests-results}}
[[QA/Fennec/35/Beta/10/smoketests-results|Detailed Smoketest results]]
= Android Permissions Testing =
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| Verification
| Softvision
| Every Beta
|}
{{:QA/Fennec/35/Beta/10/permissions-results}}
[[QA/Fennec/35/Beta/10/permissions-results|Detailed Android Permissions Testing Results]]
<br/>''' Verify permissions between what is currently on the store and with this beta build candidate'''.
<br/>Details: [[QA/Fennec/Permissions|Android Permissions]]
= Branch Bug Fix Verifications =
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| Verification
| Softvision
| Every Beta
|}
* '''[http://goo.gl/hYTII8 Firefox for Android (35) Bugs]'''
{{:QA/Fennec/35/Beta/10/BugVerification}}
[[QA/Fennec/35/Beta/10/BugVerification|Detailed Bug Verification]]
= L10N (Localization) Spot Checks =
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| Builds Verification
| SoftVision
| Every Beta
|}
Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.
{{:QA/Fennec/35/Beta/10/L10N-builds matrix}}
[[QA/Fennec/35/Beta/10/L10N-builds matrix|Detailed L10N matrix]]
= AppThwack Automation =
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|''How often?''
|-
| Runs against ARMv7
| Ioana
| Aurora SignOff, Beta 1,4,8, RC
|}
Automated installation, uninstallation, and Android Monkeyrunner tests against uploaded ARMv7 builds; primarily useful for detecting startup crashes, incompatibilities, install-times and UI oddities
{{:QA/Fennec/35/Beta/10/AppThwack Results}}
[[QA/Fennec/35/Beta/10/AppThwack Results|Detailed AppThwack Results]]
= Fennec (Firefox for Android) 35 Beta 10 (build 1) Test Plan =
* Release Week: January 5th, 2014
* QA Contact: [mailto:kbrosnan@mozilla.com Kevin Brosnan];
* IRC: irc://irc.mozilla.org#qa ping kbrosnan; ioanachiorean;
* Build 1: [ftp://ftp.mozilla.org/pub/mozilla.org/mobile/candidates/35.0b10-candidates/build1/ Fennec (Firefox for Android) 35 Beta 10] | [https://hg.mozilla.org/releases/mozilla-beta/rev/ changeset] | [https://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=FENNEC_35_0b8_BUILD1&tochange=FENNEC_35_0b10_BUILD1 pushlog]
= Checklist =
Pre-release
* Smoketests executed, including new features and Yahoo search default, with no blockers
* Android permissions tested with no blockers found
* Branch bug fix verifications completed with no blockers found
* L10n spotchecks completed, including br & eo locales, with no blockers found
* Run Appthwack against the ARMv7 build.
** due to {{Bug|1058160}} Appthwack runs the tests against the wrong activity - not very helpful so we decided not to run them.
Post-release
* Verify release notes
* Verify updates from previous Beta (no update on Gingerbread)
* Verify download from the Play store / Yandex/ TStore
* Verify download from beta.mozilla.org
= Smoketests =
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| Smoketests
| Softvision
| Every Beta
|}
Light verification tests (or smoketests) will be first run when the builds are ready. Tests are available on [https://moztrap.mozilla.org/manage/cases/ Mozilla Moztrap] under the [https://moztrap.mozilla.org/results/cases/?filter-run= 35.0 smoketest suite]. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.
{{:QA/Fennec/35/Beta/10/smoketests-results}}
[[QA/Fennec/35/Beta/10/smoketests-results|Detailed Smoketest results]]
= Android Permissions Testing =
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| Verification
| Softvision
| Every Beta
|}
{{:QA/Fennec/35/Beta/10/permissions-results}}
[[QA/Fennec/35/Beta/10/permissions-results|Detailed Android Permissions Testing Results]]
<br/>''' Verify permissions between what is currently on the store and with this beta build candidate'''.
<br/>Details: [[QA/Fennec/Permissions|Android Permissions]]
= Branch Bug Fix Verifications =
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| Verification
| Softvision
| Every Beta
|}
* '''[http://goo.gl/hYTII8 Firefox for Android (35) Bugs]'''
{{:QA/Fennec/35/Beta/10/BugVerification}}
[[QA/Fennec/35/Beta/10/BugVerification|Detailed Bug Verification]]
= L10N (Localization) Spot Checks =
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| Builds Verification
| SoftVision
| Every Beta
|}
Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.
{{:QA/Fennec/35/Beta/10/L10N-builds matrix}}
[[QA/Fennec/35/Beta/10/L10N-builds matrix|Detailed L10N matrix]]
= AppThwack Automation =
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|''How often?''
|-
| Runs against ARMv7
| Ioana
| Aurora SignOff, Beta 1,4,8, RC
|}
Automated installation, uninstallation, and Android Monkeyrunner tests against uploaded ARMv7 builds; primarily useful for detecting startup crashes, incompatibilities, install-times and UI oddities
{{:QA/Fennec/35/Beta/10/AppThwack Results}}
[[QA/Fennec/35/Beta/10/AppThwack Results|Detailed AppThwack Results]]
