MozillaWiki

QA/Mobile/FirefoxTVTestPlan: Difference between revisions

Page Discussion

QA/Mobile/FirefoxTVTestPlan (view source)

Revision as of 15:13, 15 March 2018

6,473 bytes removed ,  15 March 2018
m
no edit summary
mNo edit summary
mNo edit summary
Line 44: Line 44:


== Manual Tests ==
== Manual Tests ==
UI Test suite for Focus for Android will be located in [https://testrail.stage.mozaws.net/index.php?/suites/overview/48 TestRail]. As a minimum, each of the P1 UI features will have corresponding test cases. The test suite will be executed by Softvision for the acceptance testing.
UI Test suite for Focus for Android will be located in [https://testrail.stage.mozaws.net/index.php?/dashboard]. As a minimum, each of the P1 UI features will have corresponding test cases. The test suite will be executed by Aaron for the time being for acceptance testing.


== Automated Tests ==
== Automated Tests ==
Line 72: Line 72:


== Testing Days ==
== Testing Days ==
===='''June 14th 2017:'''====
*Ran Functional test suites on both Android phone (Samsung Galaxy S6 EDGE - Android 7.0) and tablet (Nexus 9 - Android 6.0.1)
**[https://testrail.stage.mozaws.net/index.php?/runs/view/4682&group_by=cases:section_id&group_order=asc&group_id=3479 Test rail suite for Nexus 9 Android 6.0.1 ] <br>
**[https://testrail.stage.mozaws.net/index.php?/runs/view/4681&group_by=cases:section_id&group_order=asc&group_id=3479 Test rail suite for Samsung Galaxy S6 EDGE Android 7.0 ]
* 2 New issues added to the mozilla-mobile/focus-android github section
** [https://github.com/mozilla-mobile/focus-android/issues/775 Screenshot block notification not present on tablet devices] - this one is a little bit confusing for the user<br>
** [https://github.com/mozilla-mobile/focus-android/issues/774 Focus Crashes if you erase history from android bar while site loading] - this one, IMO should be resolved ASAP since it crashes the App pretty easily<br>
===='''July 14th, 2017 (Ioana Chiorean):'''====
* Ran [https://testrail.stage.mozaws.net/index.php?/runs/view/5094&group_by=cases:section_id&group_order=asc&group_id=3481 Functional test suite] on:
** Nexus 7 - Android 5.1.2
** Pixel - Android 7.1.2
** Nexus 6P - Android 8.0
* New issues added to the mozilla-mobile/focus-android github section
** [https://github.com/mozilla-mobile/focus-android/issues/924 Thumbnail in Recent Apps shows settings menu #924]
** [https://github.com/mozilla-mobile/focus-android/issues/925 White screen while playing Vimeo videos #925]
** [https://github.com/mozilla-mobile/focus-android/issues/926 Vimeo.com displayed blank on Nexus 7 ( 5.1.2) #926]
* Issues investigated/commented the mozilla-mobile/focus-android github section
** [https://github.com/mozilla-mobile/focus-android/issues/894 Filter out Focus in the BottomSheet when "Open with..." is clicked #894]
===='''July 14th, 2017 (Oana Horvath):'''====
* Ran [https://testrail.stage.mozaws.net/index.php?/runs/view/5095 Functional test suite] on: Huawei Honor 8 (Android 6.0)
* New issues added to the mozilla-mobile/focus-android github section
**[https://github.com/mozilla-mobile/focus-android/issues/928 Focus 1.1. Beta Build #2202 - always prompts that there is an update available, opens #2196]
**[https://github.com/mozilla-mobile/focus-android/issues/927 Invalid icons of share buttons on Nytimes video section]
===='''August 24th/25th, 2017 (Ioana Chiorean):'''====
* Ran [https://testrail.stage.mozaws.net/index.php?/runs/view/5825&group_by=cases:section_id&group_order=asc&group_id=5746 Functional test suite] on Pixel with Android 8.0
* New issues:
** [https://github.com/mozilla-mobile/focus-android/issues/1207 Unable to open comments page on reddit ( with some workaround)]
** [https://github.com/mozilla-mobile/focus-android/issues/1208 Tapping URL bar after search should highlight the searched terms]
* Chrome webstore
** When you have tracking off on https://blockads.fivefilters.org/ you get a suggestion from chrome webstore - Is our UA not recognized?
* TC Not Clear
** [https://testrail.stage.mozaws.net/index.php?/tests/view/209311 Search on URL bar]
*** Step 2 - URL bar displays the search URL
** [https://testrail.stage.mozaws.net/index.php?/tests/view/209308 Open a link in Focus from another app]
*** Step 2 - If focus was open before with something else, that page is displayed
** [https://testrail.stage.mozaws.net/index.php?/tests/view/209303 Enable/Disable Trackers]
*** Step 3 - If the trackers i soff, there is a - display and not 0
** [https://testrail.stage.mozaws.net/index.php?/tests/view/209300 Enable/Disable Stealth Mode]
*** Step 2 - If the stealth mode is disabled by default and we do not ask the user to enable it you are able to take the screenshot.
* Still reproducing:
** [https://github.com/mozilla-mobile/focus-android/issues/926 Vimeo.com displayed blank on Nexus 7 ( 5.1.2) #926]
** [https://github.com/mozilla-mobile/focus-android/issues/928 Focus 1.1. Beta Build #2202 - always prompts that there is an update available, opens #2196]
===='''September 9th, 2017 (Ioana Chiorean):'''====
* Ran [https://testrail.stage.mozaws.net/index.php?/runs/view/6080&group_by=cases:section_id&group_order=asc&group_id=5974 Functional test suite] on Pixel with Android 8.0
* New logged issues:
** [https://github.com/mozilla-mobile/focus-android/issues/1298 Open with Firefox (Nightly etc) not present for strava.com #1298]
** [https://github.com/mozilla-mobile/focus-android/issues/1299 about:rights not localized #1299]
** [https://github.com/mozilla-mobile/focus-android/issues/1300 Mozilla menu not localized #1300]
* TC Not Clear
** [https://testrail.stage.mozaws.net/index.php?/tests/view/209300 Enable/Disable Stealth Mode]
*** Step 2 - If the stealth mode is disabled by default and we do not ask the user to enable it you are able to take the screenshot.
** [https://testrail.stage.mozaws.net/index.php?/tests/view/225396 Open New Tab from Other Apps]
*** Step 3 - if we close and restart the Focus app - old tabs are not displayed.
** [https://testrail.stage.mozaws.net/index.php?/tests/view/225384 Erase from Notification Drop-Down]
***  tap 'Erase browsing history' is  now "Erase and Open" so the browser will be open & present in recent app list
* Message changed:
** "Your Browsing History has been Deleted" - "Your browsing history has been erased"
* Commented:
** [https://github.com/mozilla-mobile/focus-android/issues/928 Focus 1.1. Beta Build #2202 - always prompts that there is an update available, opens #2196]
===='''December 6th, 2017 (Sorina Florean):'''====
* Ran [https://testrail.stage.mozaws.net/index.php?/runs/view/7433&group_by=cases:section_id&group_order=asc&group_id=3479 Functional test suite] on Nexus 5 with Android 6.0.1
* New logged issues:
** [https://github.com/mozilla-mobile/focus-android/issues/1926 Video exit full screen mode when device orientation is changed #1926]
** [https://github.com/mozilla-mobile/focus-android/issues/1917 Trash can icon active when no search engine are selected #1917]
** [https://github.com/mozilla-mobile/focus-android/issues/1920 Inconsistency when closing pages from Your Rights #1920]
** [https://github.com/mozilla-mobile/focus-android/issues/1922 Settings Menu not displayed properly #1922]
* Issues still reproducible:
** [https://github.com/mozilla-mobile/focus-android/issues/1883 Lastpass is not filtering the autofill suggestion / only shows first few sites #1883]


= Dependencies/Risks =  
= Dependencies/Risks =  
AaronMT
canmove, Confirmed users
2,398

edits

Retrieved from "https://wiki.mozilla.org/Special:MobileDiff/1190450"