QA/Turning On Search Suggestions: Difference between revisions

 
(7 intermediate revisions by the same user not shown)
Line 101: Line 101:
| 1 || Search suggestions hint || Search suggestions hint is displayed for the users that do not have the search suggestions blocked || The hint informing users that search suggestions are enabled is displayed in the Awesome bar drop down just under the URL || Manual || RAC-1, RAC-2, RAC-3 || Eng Team
| 1 || Search suggestions hint || Search suggestions hint is displayed for the users that do not have the search suggestions blocked || The hint informing users that search suggestions are enabled is displayed in the Awesome bar drop down just under the URL || Manual || RAC-1, RAC-2, RAC-3 || Eng Team
|-
|-
| 2 || Search suggestions disabling || Search suggestions in the Awesome Bar can be disabled || Clicking on Change Settings in the search suggestions hint takes you to the about:preferences#general from where search suggestions can be disabled || Manual  || || Eng Team
| 2 || Search suggestions disabling || Search suggestions in the Awesome Bar can be disabled || Clicking on Change Settings in the search suggestions hint takes you to the about:preferences#general from where search suggestions can be disabled || Manual  || RAC-1, RAC-2, RAC-3 || Eng Team
|-
|-
| 3 || Accessibility || Search suggestions and the hint announcing them being enabled are visible and usable from accessibility point of view|| Testing for accessibility includes: <br />
| 3 || Accessibility || Search suggestions and the hint announcing them being enabled are visible and usable from accessibility point of view|| Testing for accessibility includes: <br />
Line 107: Line 107:
- Screen Reader validation<br />
- Screen Reader validation<br />
- Keyboard-only   
- Keyboard-only   
|| Manual || || Eng Team
|| Manual || RAC-1, RAC-2, RAC-3 || Eng Team
|-
|-
| 4 || Upgrade-Downgrade || The search suggestions hint behavior at FF Upgrade/Downgrade || One-Off searches Awesomebar buttons are not lost during FF upgrade/downgrade || Manual || || Eng Team
| 4 || Upgrade-Downgrade || The search suggestions hint behavior at FF Upgrade/Downgrade || One-Off searches Awesomebar buttons are not lost during FF upgrade/downgrade || Manual || RAC-1, RAC-2, RAC-3, RAC-4 || Eng Team
|}
|}


Line 226: Line 226:
|-
|-
| Support documents planned(written)   
| Support documents planned(written)   
|style="text-align:center;" | ? || Make sure support documents are written and are correct.
|style="text-align:center;" | No || Make sure support documents are written and are correct.


|-
|-
Line 268: Line 268:
|-
|-
| Temporary or permanent telemetry monitoring   
| Temporary or permanent telemetry monitoring   
|style="text-align:center;" | ? || List of error conditions to monitor
|style="text-align:center;" | No || List of error conditions to monitor
|-
|-
| Telemetry correctness testing   
| Telemetry correctness testing   
Line 336: Line 336:


== Test suite ==
== Test suite ==
  Full Test suite - Link to test rail - testcases should be added under Firefox Desktop project [https://testrail.stage.mozaws.net/index.php?/suites/view/813&group_by=cases:section_id&group_order=asc link]
  Full Test suite - [https://testrail.stage.mozaws.net/index.php?/suites/view/813&group_by=cases:section_id&group_order=asc TestRail Link] - [https://wiki.mozilla.org/images/c/c6/Turning_on_Search_Suggestions_-EngQA-_-_TestRail.pdf PDF doc]


= Bug Work =
= Bug Work =
Line 379: Line 379:


== Results ==
== Results ==
'''Nightly testing'''<br />
'''Mid Nightly testing'''<br />


List of OSes that will be covered by testing<br />
- was missed due to the fact the feature landed after the Mid Nightly sign off.
*Link for the tests run
** Full Test suite, link to TestRail - Tests Runs and Results [https://testrail.stage.mozaws.net/index.php?/runs/overview/17 link]
** Daily Smoke, if needed/available
** Regression Test suite, if needed/available
<br />


'''Merge to Beta Sign-off'''<br />
'''Pre Beta testing'''<br />
List of OSes that will be covered by testing<br />
List of OSes that will be covered by testing<br />
*Link for the tests run
*Link for the tests run - [https://testrail.stage.mozaws.net/index.php?/plans/view/4371 TestRail link] [https://wiki.mozilla.org/images/5/56/Manual_Testing_Summary_Turning_on_Search_Suggestions_%28Fx55%29_-_Pre-Beta_feature_sign_off_%282017-06-06%29_-_TestRail.pdf PDF doc]
** Full Test suite


== Checklist ==
== Checklist ==
Line 412: Line 406:
|-
|-
|  Automation Coverage
|  Automation Coverage
|style="text-align:center;" |  TBD
|style="text-align:center;" |  N/A
|style="text-align:center;" |   
|style="text-align:center;" |   
|-
|-
|  Performance Testing  
|  Performance Testing  
|style="text-align:center;" | TBD  ||  
|style="text-align:center;" | N/A||  
|-
|-
|  All Defects Logged  
|  All Defects Logged  
Line 427: Line 421:
|-
|-
|  Metrics/Telemetry
|  Metrics/Telemetry
|style="text-align:center;" | TBD
|style="text-align:center;" | N/A
|style="text-align:center;" |  
|style="text-align:center;" |  
|-
|-
|  Basic/Core functionality Nightly testing
|  QA mid-Nightly Signoff
|style="text-align:center;" | 
|style="text-align:center;" | {{missed|}}
|style="text-align:center;" | 
|style="text-align:center;" |
|-
|  QA mid-Nightly Signoff||
|style="text-align:center;" | Email to be sent
|-
| QA Nightly - Full Testing
|style="text-align:center;" |  ||  
|-
|-
|  QA pre-Beta Signoff||  
|  QA pre-Beta Signoff
|style="text-align:center;"| Email to be sent  
|style="text-align:center;" | {{done|}}
|style="text-align:center;" | [[https://wiki.mozilla.org/images/6/61/-desktop-_-feature-_Turning_on_Search_Suggestions_-_pre-Beta_sign_off_%28YELLOW%29.pdf  Email sent in 6/06/2017]]
|-
|-
|  QA Beta - Full Testing
|  QA Beta - Full Testing
Confirmed users
1,333

edits