QA/FindToolbarTesting: Difference between revisions

← Older edit

QA/FindToolbarTesting (view source)

Revision as of 15:06, 14 November 2016

698 bytes added , 14 November 2016

→‎References

Brindusa.tot

533

edits

@@ Line 89: / Line 89: @@
 | 2 || Find Toolbar Functionality || The objective of these test suites is to verify that all requirements related to the Find Toolbar functionality are met and that they are functioning as expected || All the elements of the Find Toolbar are working according with the requirements|| Manual || Eng Team
 |-
-| 3 || Find Toolbar Usability ||The objective of these test suites is to verify that the application is user friendly|| || Manual||Eng Team
+| 3 || Find Toolbar Usability ||The objective of these test suites is to verify that the application is user friendly|| The Find Toolbar is easy and straight forward to understand. The user has no difficulty in understanding any of the offered functionality.|| Manual||Eng Team
 |-
-| 4 || Find Toolbar Accessibility || || || ||
+| 4 || Find Toolbar Accessibility || Find Toolbar is visible and usable from accessibility point of view || The accessibility scenarios are successful ||Manual || Eng Team
 |-
-| 5 || Browser Performance while find toolbar is opened || || || ||
+| 5 || Browser Performance while find toolbar is opened || TBD || TBD || TBD || TBD
 |-
 | 6 || 	Regression testing on the existing logged and fixed Bugzilla bugs || Verify marked as fixed bugs against the Nightly Builds || || ||
@@ Line 156: / Line 156: @@
 = Status =
 == Overview ==
-  First releases to Nightly: 06.10.2015 [http://archive.mozilla.org/pub/firefox/nightly/2016/06/2016-06-10-07-36-07-mozilla-central/ Nighltly Build]
+  First releases to Nightly 50.0a1: 06.10.2015 [http://archive.mozilla.org/pub/firefox/nightly/2016/06/2016-06-10-07-36-07-mozilla-central/ Nighltly Build]
-  Track the dates and build number where feature was merged to Aurora
+  At merge with Aurora, feature was not sign-off to Aurora due to large number of bugs opened on this feature. Feature remains disabled on Aurora 50 and enabled on Nightly 51
-  Track the dates and build number where feature was merged to Release/Beta
+ Continue testing on Nightly 51.0a1  - mostly focus on bug fixing.
+  At merge with Aurora 51, feature was not sign-off to Aurora due to large number of bugs opened on this feature. Feature remains disabled on Aurora 51 and enabled on Nightly 52
+ Continue testing on Nightly 52.0a1
+/14/2016 - at merge to Aurora 52, feature remains enabled only on Nightly
-== Risk analysis ==
- Identify the high-risk assumptions
- Identify existing bugs on the feature with high risk
- Identify if other areas are affected by the fix
 = References =
 * Meta bug [https://bugzilla.mozilla.org/show_bug.cgi?id=384458 384458]
+* New Meta bug - starting with Nightly 51: bug [https://bugzilla.mozilla.org/show_bug.cgi?id=1291278 1291278]
 * Useful info related to this feature can be found at following [https://public.etherpad-mozilla.org/p/Find_Toolbar_-_QA_Kick-off_meeting etherpad]
 = Testcases =
 Testcases can be found at [https://docs.google.com/spreadsheets/d/1b6_dcsme2zE44vRB6V14qM_YvZmlAtoeLNCSaG9EDEc/edit#gid=0 link]
+Testrail link for full testcases at [https://testrail.stage.mozaws.net/index.php?/suites/view/204&group_by=cases:section_id&group_order=asc link]
 == Test Areas ==
@@ Line 356: / Line 356: @@
 Check list
 * All test cases should be executed
-* Has sufficient automated test coverage (as measured by code coverage tools) - coordinate with RelMan
 * All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed (as determined by engineering/RelMan/QA)
@@ Line 364: / Line 363: @@
 List of OSes that will be covered by testing<br />
 *Link for the tests run
-** Daily Smoke, use template from [https://docs.google.com/spreadsheets/d/1ch0OubyOWn1W-_JLF-38nvSvVB76Wmo1hkLccEtU5hk/edit?usp=sharing link]
+** Full Test suite, run on Nighlty 50.0a1 [https://docs.google.com/spreadsheets/d/1b6_dcsme2zE44vRB6V14qM_YvZmlAtoeLNCSaG9EDEc/edit#gid=0 link]
-** Full Test suite, use template from [https://docs.google.com/spreadsheets/d/1ch0OubyOWn1W-_JLF-38nvSvVB76Wmo1hkLccEtU5hk/edit?usp=sharing link]
+** Full Test suite, run on Nighlty 52.0a1 [https://testrail.stage.mozaws.net/index.php?/plans/view/886 link]
-** Regression Test suite, if needed/available
 '''Merge to Aurora Sign-off'''
@@ Line 379: / Line 378: @@
 |-
 |  Testing Prerequisites (specs, use cases)
-| style="text-align:center;" |
+| style="text-align:center;" |  {{mdone|}}
 | style="text-align:center;" |
 |-
 |  Testing Infrastructure setup
-|style="text-align:center;" |   ||
+|style="text-align:center;" | {{mdone|}}  ||
 |-
 |  Test Plan Creation
-| style="text-align:center;" |   ||
+| style="text-align:center;" | {{mdone|}} ||
 |-
 |  Test Cases Creation
-|style="text-align:center;" |   ||
+|style="text-align:center;" | {{mdone|}}  ||
 |-
 |  Full Functional Tests Execution
-|style="text-align:center;" |
+|style="text-align:center;" |  {{mdone|}}
 |style="text-align:center;" |
 |-
-|  Automation Coverage ||
+|  Automation Coverage
-|style="text-align:center;" |
+|style="text-align:center;" | TBD ||
 |-
 |  Performance Testing
-|style="text-align:center;" |  ||
+|style="text-align:center;" | TBD ||
 |-
-|  All Defects Logged || ||
+|  All Defects Logged
+|style="text-align:center;" |  {{mdone|}}
+|style="text-align:center;" |
 |-
-|  Critical/Blockers Fixed and Verified || ||
+|  Critical/Blockers Fixed and Verified
-|-
+|style="text-align:center;" |  {{mdone|}}
-|  Daily Status Report (email/etherpad statuses/ gdoc with results) || ||
+|style="text-align:center;" |
 |-
 |  Metrics/Telemetry||