352
edits
QA/Mobile/FocusAndroidTestPlan: Difference between revisions
Jump to navigation
Jump to search
Test strategy added
(personnel defined) |
(Test strategy added) |
||
| Line 29: | Line 29: | ||
* NOTE: Focus for Android bugs are maintained in [https://github.com/mozilla-mobile/focus-android/issues Github] | * NOTE: Focus for Android bugs are maintained in [https://github.com/mozilla-mobile/focus-android/issues Github] | ||
([https://github.com/mozilla-mobile/focus-android/issues?utf8=%E2%9C%93&q=is%3Aissue%20label%3Av1.0%20is%3Aissue%20label%3Afeature%20 List of complete P1 features]) | * ([https://github.com/mozilla-mobile/focus-android/issues?utf8=%E2%9C%93&q=is%3Aissue%20label%3Av1.0%20is%3Aissue%20label%3Afeature%20 List of complete P1 features]) | ||
= Schedule = | = Schedule = | ||
| Line 47: | Line 47: | ||
= Resource Plan = | = Resource Plan = | ||
* Each QA person will have 40% allocation to this project | |||
= Test Strategy = | = Test Strategy = | ||
== Manual Tests == | == Manual Tests == | ||
UI Test suite for Focus for Android will be located in TestRail (Insert Link). As a minimum, each of the P1 features will have their corresponding test cases | |||
== Automated Tests == | == Automated Tests == | ||
Automation tests will be mainly used for quick regression check of key UI features. Overall, automation tests will be added to the same Github repo, and executed on [https://dashboard.buddybuild.com/apps/584f67f6f3d6eb01000842d6 BuddyBuild CI system]. While the unit tests will be run for each commit, UI Tests (in Espresso framework) will be executed in master branch only. The test result will be inspected for new failures, and github issue will be raised for tracking. | |||
Following automation test cases will be added by end of the May: | |||
* Accessing badly formed URL | |||
* Accessing each of pull-down menu items | |||
* Accessing simple webpages | |||
* Changing search engine | |||
* Checking for overall appearance | |||
* Deleting browsing history | |||
* Quick check of URL autocompletion | |||
* Quick check of webview data deletion | |||
* Quick check of Onboarding dialog (Pending) | |||
* Custom tabs (Pending) | |||
* Check notification while browsing session is active (Pending) | |||
In addition to regularly run automated tests, QA will also generate screenshots for [https://l10n.mozilla-community.org/webstatus/?product=focus-android l10n verification]. | |||
== Code Analysis == | == Code Analysis == | ||
[https://codecov.io/gh/mozilla-mobile/focus-android/branch/master Codecov] is added to the github repo, and will display increase/decrease of unit test code coverage | |||
== Outside Scope == | |||
Following tests are outside the scope of the QA: | |||
* Unit Tests | |||
* Performance Tests | |||
* Localization Tests | |||
== Test Deliverables == | == Test Deliverables == | ||