QA/Search refactoring: Difference between revisions

Updated based on the new test plan template
No edit summary
(Updated based on the new test plan template)
Line 9: Line 9:
=== Ownership ===
=== Ownership ===


Developer contacts: Florian Queze
Developer contacts: Florian Queze<br />
QA:
QA:
[mailto:brindusa.tot@softvisioninc.eu Brindusa Tot] - leading QA efforts  
[mailto:brindusa.tot@softvisioninc.eu Brindusa Tot] - leading QA efforts  
Line 20: Line 20:
== Status ==
== Status ==
=== Overview ===
=== Overview ===
<small>'''<font color="green">[LANDED]</font>'''</small> Nightly 45: first landed - 10.29.2015
<small>'''<font color="green">[LANDED]</font>'''</small> Nightly 45: first landed on - '''10.29.2015'''


=== Risk analysis===
=== References ===
- No Risks found at the moment


== References ==
Meta: [https://bugzilla.mozilla.org/show_bug.cgi?id=1203167 Bug 1203167]
Meta: [https://bugzilla.mozilla.org/show_bug.cgi?id=1203167 Bug 1203167]
== Requirements for testing ==
=== Environments ===
Testing will be performed on following OSes:
* Windows 7
* Windows 8
* Windows 10
* Windows XP
* Windows Vista
* Ubuntu 14.04
== Test Types ==
* Manual testing - will be performed by QA Engineering Team
* Automation - ???
* Metrics/Telemetry - ???




== Test cases ==
== Test cases ==
=== Overview ===
* Perform search from the Search Bar – using different terms
* Perform search from the Search Bar – using different terms
* Perform search from all the available search fields
* Perform search from all the available search fields
* Add/Update search engine and validate search results is given by the new engine
* Add/Update search engine and validate search results is given by the new engine
* Search with search suggestion on/off
* Change search settings (select/deselect engine, remove/restore engine, reorder engines) and validate search results is given by the new engine
* Change search settings (select/deselect engine, remove/restore engine, reorder engines)
* Verify if custom search engine settings (new engines added, reordered engines) are preserved after update
* Validate user profile is not updated after search fix is deployed
* Verify if custom search engine settings(new engines added) are preserved after update
* Verify that after update, search engines settings can be updates
* Verify that after update, search engines settings can be updates
* Install external softwares that automatically change the search engine for installed browsers and verify if the default search engine or users custom search engine is altered
* Install external software's that automatically change the search engine for installed browsers and verify that the default search engine or users custom search engine is not altered
 
=== Overview ===
=== Test suites ===
Draft test suites:
  Full Test Suites: [https://docs.google.com/spreadsheets/d/1xd31SYxmMfr5s-7C0AVS0v4oGDrxvripqgyIAK6Qae0/edit?usp=sharing 1]
  Test Suites: [https://docs.google.com/spreadsheets/d/1xd31SYxmMfr5s-7C0AVS0v4oGDrxvripqgyIAK6Qae0/edit?usp=sharing 1]
 
== Bugs Work ==
Tracking bug: Meta bug [https://bugzilla.mozilla.org/show_bug.cgi?id=1203167 Bug 1203167]
 
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto">
 
====== Bug fix verification ======
<div class="mw-collapsible-content">
 
</div>
 
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto">
 
====== Logged bugs ======
<div class="mw-collapsible-content">
[https://bugzilla.mozilla.org/show_bug.cgi?id=1157144 Bug 1157144] - No action for right/scroll click commands on the "Learn more" link from add-on install doorhanger<br/>
</div>
</div>


== Sign off  ==
== Sign off  ==
=== Criteria ===
=== Criteria ===
All the test cases must be executed.
* All test cases should be executed
All the blocker, critical, major bugs have been fixed.
* Has sufficient automated test coverage (as measured by code coverage tools) - coordinate with RelMan
 
* All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed (as determined by engineering/RelMan/QA)


=== Results ===
=== Results ===
Test results should be added (must specify the OS covered)
Full Test suite results [[https://docs.google.com/spreadsheets/d/1xd31SYxmMfr5s-7C0AVS0v4oGDrxvripqgyIAK6Qae0/edit?usp=sharing 1]]
Manual testing covered Windows 7, Windows 10, Windows XP, Ubuntu 14.04 and Mac OS X 10.
Manual testing covered Windows 7, Windows 10, Ubuntu 14.04 and Mac OS X 10.
533

edits