QA/Mobile/FocusAndroidTestPlan: Difference between revisions

Jump to navigation Jump to search
v2.0 change
(v2.0 change)
Line 3: Line 3:
= Intro/Summary/Notes =
= Intro/Summary/Notes =
== Intro and Summary ==
== Intro and Summary ==
* This wiki outlines the test requirements for Focus for Android V1.
* This wiki outlines the test requirements for Focus for Android releases.
* Use this generalized Test Plan as a starting point for creating Plans, Suites, and Cases
* Use this generalized Test Plan as a starting point for creating Plans, Suites, and Cases


Line 10: Line 10:


== Feature Lists ==
== Feature Lists ==
* "Must" P1 features (as of May 2017 and subject to change):
For the list of features and its status, please refer to [https://github.com/mozilla-mobile/focus-android/projects/3 here].
** Provide tracking-free browsing experience
'Aqua' label refers to the issues that are slated for the next upcoming release
** Erase browsing history
** Enable/Disable blocking of different types of trackers
** Onboarding, we will highlight features that we believe will bring retention
** Per session blocking
** Custom tabs (scoped down)
** Show notification while browsing session is active
** Create localized completion list
** Setting to allow screenshots
** Support app shortcuts API


* P2 (if time permits, in order of priority)
* NOTE: Focus for Android bugs are maintained in [https://github.com/mozilla-mobile/focus-android/issues Github]
** Show number of ads/trackers blocked (4)
** Locale switcher for Android (5)
** Allow saving images in a website (4)
** Add "search" action into text selection of third-party apps (3)


* NOTE: Focus for Android bugs are maintained in [https://github.com/mozilla-mobile/focus-android/issues Github]
* ([https://github.com/mozilla-mobile/focus-android/issues?utf8=%E2%9C%93&q=is%3Aissue%20label%3Av1.0%20is%3Aissue%20label%3Afeature%20 List of complete P1 features in Github])


= Schedule =
= Schedule =
* All features for V1 should be completed by June 9th, 2017 to begin acceptance testing
* All features for 2.0 should be completed by Aug 4th, 2017 to begin acceptance testing
* Testing, including acceptance testing, should be completed by June 14th, 2017.
* Testing, including acceptance testing, should be completed by Aug 10th, 2017.
* Focus for Android is currently scheduled to be released June 20th, 2017.
* Focus for Android 2.0 is currently scheduled to be released Aug 17th, 2017.


= Personnel =
= Personnel =
Line 46: Line 31:
== QA Team ==
== QA Team ==
* [https://phonebook.mozilla.org/?search/No-Jun%20Park No-Jun Park]
* [https://phonebook.mozilla.org/?search/No-Jun%20Park No-Jun Park]
* [https://phonebook.mozilla.org/?search/Aaron%20Train Aaron Train]


= Resource Plan =
= Resource Plan =
Line 53: Line 37:
= Test Strategy =
= Test Strategy =
== Manual Tests ==
== Manual Tests ==
UI Test suite for Focus for Android will be located in [https://testrail.stage.mozaws.net/index.php?/suites/overview/48 TestRail]. As a minimum, each of the P1 features will have corresponding test cases. We will use Focus for iOS as a base.
UI Test suite for Focus for Android will be located in [https://testrail.stage.mozaws.net/index.php?/suites/overview/48 TestRail]. As a minimum, each of the P1 features will have corresponding test cases. The test suite will be executed by Softvision for the acceptance testing.


== Automated Tests ==
== Automated Tests ==
Automation tests will be mainly used for quick regression check of key UI features. Overall, automation tests will be added to the same Github repo, and executed on [https://dashboard.buddybuild.com/apps/584f67f6f3d6eb01000842d6 BuddyBuild CI system]. While the unit tests will be run for each commit, UI Tests (in Espresso framework) will be executed in master branch only.  The test result will be inspected for new failures, and github issue will be raised for tracking.
Automation tests will be mainly used for quick regression check of key UI features. Overall, automation tests will be added to the same Github repo, and executed on [https://dashboard.buddybuild.com/apps/584f67f6f3d6eb01000842d6 BuddyBuild CI system]. While the unit tests will be run for each commit, UI Tests (in Espresso framework) will be executed in master branch only.  The test result will be inspected for new failures, and github issue will be raised for tracking.
Following automation test cases will be added by end of the May:
* Accessing badly formed URL
* Accessing each of pull-down menu items
* Accessing simple webpages
* Changing search engine
* Checking for overall appearance
* Deleting browsing history
* Quick check of URL autocompletion
* Quick check of webview data deletion
* Quick check of Onboarding dialog (Pending)
* Custom tabs (Pending)
* Check notification while browsing session is active (Pending)


Automation tests are located [https://github.com/mozilla-mobile/focus-android/tree/master/app/src/androidTest here].
Automation tests are located [https://github.com/mozilla-mobile/focus-android/tree/master/app/src/androidTest here].
Line 87: Line 58:


== Test Deliverables ==
== Test Deliverables ==
* Completed TestRail Test suite which covers all P1 features with UI aspects  
* Completed TestRail Test suite which covers all features with UI aspects  
* Automated Test suite in master branch, running on every checkin
* Automated Test suite in master branch, running on every checkin
* Github issues for every issue found
* Github issues for every issue found
Line 126: Line 97:


= Signoff/Exit Criteria =
= Signoff/Exit Criteria =
* No open v1.0 bugs, which impacts the security and key operations of the app
* No critical or major UI bugs
* No critical or major UI bugs
* No easily reproducible crashes
* No easily reproducible crashes
352

edits

Navigation menu