Add-ons/Webextensions Cutover/Testplan - Revision history

Santa: Added links for TestRail, Google docs

2017-09-20T17:09:43Z

Added links for TestRail, Google docs

← Older revision		Revision as of 17:09, 20 September 2017
Line 239:		Line 239:
	\| Test plan creation \|\| Mozilla wiki		\| Test plan creation \|\| Mozilla wiki
	\|-		\|-
	\| Test case creation \|\| TestRail / Google docs / [https://public.etherpad-mozilla.org/p/webextensions-cutover etherpad]		\| Test case creation \|\| [https://testrail.stage.mozaws.net/index.php?/suites/view/1489&group_by=cases:section_id&group_order=asc TestRail] / [https://docs.google.com/spreadsheets/d/1aqP3lBVXwwmuXBE44Vwdanwf1DKgDrQ2FWc-3zLtTHk/edit#gid=1 Google docs] / [https://public.etherpad-mozilla.org/p/webextensions-cutover etherpad]
	\|-		\|-
	\| Test case execution \|\| TestRail		\| Test case execution \|\| [https://testrail.stage.mozaws.net/index.php?/runs/view/6276 TestRail]
	\|-		\|-
	\| Bugs management \|\| Bugzilla / Github		\| Bugs management \|\| Bugzilla / Github
Line 317:		Line 317:
	== Test suite ==		== Test suite ==
	* Link for the [https://public.etherpad-mozilla.org/p/webextensions-cutover Initial test planning]		* Link for the [https://public.etherpad-mozilla.org/p/webextensions-cutover Initial test planning]
	* Link for the Google doc tests		* Link for the [https://docs.google.com/spreadsheets/d/1aqP3lBVXwwmuXBE44Vwdanwf1DKgDrQ2FWc-3zLtTHk/edit#gid=1 Google doc tests]
	* Link for the TestRail tests		* Link for the [https://testrail.stage.mozaws.net/index.php?/suites/view/1489&group_by=cases:section_id&group_order=asc TestRail tests]

	= Bug Work =		= Bug Work =

Vasilica.mihasca: /* Test Execution Schedule */

2017-09-20T14:30:22Z

Test Execution Schedule

← Older revision		Revision as of 14:30, 20 September 2017
Line 223:		Line 223:
	\| QA - Nightly Testing		\| QA - Nightly Testing
	\|style="text-align:center;" \|14-06-2017 \|\|		\|style="text-align:center;" \|14-06-2017 \|\|
	\|-
	~~\| QA - Aurora Testing~~
	~~\|style="text-align:center;" \| \|\|~~
	\|-		\|-
	\| QA - Beta Testing		\| QA - Beta Testing

Vasilica.mihasca: /* Builds */

2017-09-20T14:28:36Z

Builds

← Older revision		Revision as of 14:28, 20 September 2017
Line 191:		Line 191:
	== Builds ==		== Builds ==
	This section should contain links for builds with the feature -		This section should contain links for builds with the feature -
	* [http://archive.mozilla.org/pub/firefox/nightly/latest-mozilla-central/ ~~Link] for~~ Nightly builds		* [http://archive.mozilla.org/pub/firefox/nightly/latest-mozilla-central/ Nightly builds]
	* [https://archive.mozilla.org/pub/firefox/candidates/ ~~Link] for~~ Beta builds		* [https://archive.mozilla.org/pub/firefox/candidates/ Beta builds]
	* Beta Unbranded builds:		* Beta Unbranded builds:
	** [https://archive.mozilla.org/pub/firefox/tinderbox-builds/mozilla-beta-win64-add-on-devel/ Windows Link]		** [https://archive.mozilla.org/pub/firefox/tinderbox-builds/mozilla-beta-win64-add-on-devel/ Windows Link]
	** [https://archive.mozilla.org/pub/firefox/tinderbox-builds/mozilla-beta-linux64-add-on-devel/ Linux Link]		** [https://archive.mozilla.org/pub/firefox/tinderbox-builds/mozilla-beta-linux64-add-on-devel/ Linux Link]
	** [https://archive.mozilla.org/pub/firefox/tinderbox-builds/mozilla-beta-macosx64-add-on-devel/ Mac Link]		** [https://archive.mozilla.org/pub/firefox/tinderbox-builds/mozilla-beta-macosx64-add-on-devel/ Mac Link]
	* [https://archive.mozilla.org/pub/firefox/releases/ ~~Link] for~~ Release builds		* [https://archive.mozilla.org/pub/firefox/releases/ Release builds]
	* Release Unbranded builds:		* Release Unbranded builds:
	** [https://archive.mozilla.org/pub/firefox/tinderbox-builds/mozilla-release-win64-add-on-devel/ Windows Link]		** [https://archive.mozilla.org/pub/firefox/tinderbox-builds/mozilla-release-win64-add-on-devel/ Windows Link]

Vasilica.mihasca: /* Builds */

2017-09-20T14:26:19Z

Builds

← Older revision		Revision as of 14:26, 20 September 2017
Line 193:		Line 193:
	* [http://archive.mozilla.org/pub/firefox/nightly/latest-mozilla-central/ Link] for Nightly builds		* [http://archive.mozilla.org/pub/firefox/nightly/latest-mozilla-central/ Link] for Nightly builds
	* [https://archive.mozilla.org/pub/firefox/candidates/ Link] for Beta builds		* [https://archive.mozilla.org/pub/firefox/candidates/ Link] for Beta builds
	* Beta Unbranded builds		* Beta Unbranded builds:
	** [https://archive.mozilla.org/pub/firefox/tinderbox-builds/mozilla-beta-win64-add-on-devel/ Windows Link]		** [https://archive.mozilla.org/pub/firefox/tinderbox-builds/mozilla-beta-win64-add-on-devel/ Windows Link]
	** [https://archive.mozilla.org/pub/firefox/tinderbox-builds/mozilla-beta-linux64-add-on-devel/ Linux Link]		** [https://archive.mozilla.org/pub/firefox/tinderbox-builds/mozilla-beta-linux64-add-on-devel/ Linux Link]
	** [https://archive.mozilla.org/pub/firefox/tinderbox-builds/mozilla-beta-macosx64-add-on-devel/ Mac Link]		** [https://archive.mozilla.org/pub/firefox/tinderbox-builds/mozilla-beta-macosx64-add-on-devel/ Mac Link]
	* [https://archive.mozilla.org/pub/firefox/releases/ Link] for Release builds		* [https://archive.mozilla.org/pub/firefox/releases/ Link] for Release builds
	* Release Unbranded builds		* Release Unbranded builds:
	** [https://archive.mozilla.org/pub/firefox/tinderbox-builds/mozilla-release-win64-add-on-devel/ Windows Link]		** [https://archive.mozilla.org/pub/firefox/tinderbox-builds/mozilla-release-win64-add-on-devel/ Windows Link]
	** [https://archive.mozilla.org/pub/firefox/tinderbox-builds/mozilla-release-linux64-add-on-devel/ Linux Link]		** [https://archive.mozilla.org/pub/firefox/tinderbox-builds/mozilla-release-linux64-add-on-devel/ Linux Link]

Vasilica.mihasca: /* Builds */

2017-09-20T14:25:54Z

Builds

← Older revision		Revision as of 14:25, 20 September 2017
Line 197:		Line 197:
	** [https://archive.mozilla.org/pub/firefox/tinderbox-builds/mozilla-beta-linux64-add-on-devel/ Linux Link]		** [https://archive.mozilla.org/pub/firefox/tinderbox-builds/mozilla-beta-linux64-add-on-devel/ Linux Link]
	** [https://archive.mozilla.org/pub/firefox/tinderbox-builds/mozilla-beta-macosx64-add-on-devel/ Mac Link]		** [https://archive.mozilla.org/pub/firefox/tinderbox-builds/mozilla-beta-macosx64-add-on-devel/ Mac Link]
			* [https://archive.mozilla.org/pub/firefox/releases/ Link] for Release builds
			* Release Unbranded builds
			** [https://archive.mozilla.org/pub/firefox/tinderbox-builds/mozilla-release-win64-add-on-devel/ Windows Link]
			** [https://archive.mozilla.org/pub/firefox/tinderbox-builds/mozilla-release-linux64-add-on-devel/ Linux Link]
			** [https://archive.mozilla.org/pub/firefox/tinderbox-builds/mozilla-release-macosx64-add-on-devel/ Mac Link]

	== Test Execution Schedule ==		== Test Execution Schedule ==

Vasilica.mihasca: /* Test Objectives */

2017-08-17T15:53:05Z

Test Objectives

← Older revision		Revision as of 15:53, 17 August 2017
Line 170:		Line 170:
	! Ref !! Function !! Test Objective !! Test Type !! Owners		! Ref !! Function !! Test Objective !! Test Type !! Owners
	\|-		\|-
	\| TO-1 \|\| Installing from AMO \|\| To verify that legacy add-ons ~~are~~ successfully blocked \|\| Manual \|\| Add-ons QA Team		\| TO-1 \|\| Installing from AMO \|\| To verify that legacy add-ons installation is successfully blocked \|\| Manual \|\| Add-ons QA Team
	\|-		\|-
	\| TO-2 \|\| Installing from Discopane \|\| To verify that legacy add-ons ~~are~~ successfully blocked \|\| Manual \|\| Add-ons QA Team		\| TO-2 \|\| Installing from Discopane \|\| To verify that legacy add-ons installation is successfully blocked \|\| Manual \|\| Add-ons QA Team
	\|-		\|-
	\| TO-3 \|\| Installing from Add-ons manager \|\| To verify that legacy add-ons ~~are~~ successfully blocked \|\| Manual \|\| Add-ons QA Team		\| TO-3 \|\| Installing from Add-ons manager \|\| To verify that legacy add-ons installation is successfully blocked \|\| Manual \|\| Add-ons QA Team
	\|-		\|-
	\| TO-4 \|\| Installing via sideloading \|\| To verify that legacy add-ons ~~are~~ successfully blocked \|\| Manual \|\| Add-ons QA Team		\| TO-4 \|\| Installing via sideloading \|\| To verify that legacy add-ons installation is successfully blocked \|\| Manual \|\| Add-ons QA Team
	\|-		\|-
	\| TO-5 \|\| Installing from local files\|\| To verify that legacy add-ons ~~are~~ successfully blocked \|\| Manual \|\| Add-ons QA Team		\| TO-5 \|\| Installing from local files\|\| To verify that legacy add-ons installation is successfully blocked \|\| Manual \|\| Add-ons QA Team
	\|-		\|-
	\| TO-6 \|\| Installing from thirdparty \|\| To verify that legacy add-ons ~~are~~ successfully blocked \|\| Manual \|\| Add-ons QA Team		\| TO-6 \|\| Installing from thirdparty \|\| To verify that legacy add-ons installation is successfully blocked \|\| Manual \|\| Add-ons QA Team
	\|-		\|-
	\| TO-7 \|\| Add-on updates \|\| To verify that legacy add-on is successfully updated to a webextension version \|\| Manual \|\| Add-ons QA Team		\| TO-7 \|\| Add-on updates \|\| To verify that legacy add-on is successfully updated to a webextension version \|\| Manual \|\| Add-ons QA Team

Vasilica.mihasca: /* Test Objectives */

2017-08-17T15:52:10Z

Test Objectives

← Older revision		Revision as of 15:52, 17 August 2017
Line 170:		Line 170:
	! Ref !! Function !! Test Objective !! Test Type !! Owners		! Ref !! Function !! Test Objective !! Test Type !! Owners
	\|-		\|-
	\| TO-1 \|\| ~~Validation during~~ AMO \|\| To verify that ~~linter raise the proper error messages~~ \|\| Manual \|\| Add-ons QA Team		\| TO-1 \|\| Installing from AMO \|\| To verify that legacy add-ons are successfully blocked \|\| Manual \|\| Add-ons QA Team
	\|-		\|-
	\| TO-2 \|\| ~~AMO public pages~~ \|\| To verify that ~~permissions~~ are ~~correctly displayed~~ \|\| Manual \|\| Add-ons QA Team		\| TO-2 \|\| Installing from Discopane \|\| To verify that legacy add-ons are successfully blocked \|\| Manual \|\| Add-ons QA Team
	\|-		\|-
	\| TO-3 \|\| Installing from ~~AMO~~ \|\| To verify that ~~the permissions flow is fully respected~~ \|\| Manual \|\| Add-ons QA Team		\| TO-3 \|\| Installing from Add-ons manager \|\| To verify that legacy add-ons are successfully blocked \|\| Manual \|\| Add-ons QA Team
	\|-		\|-
	\| TO-4 \|\| Installing ~~from Discopane~~ \|\| To verify that ~~the permissions flow is fully respected~~ \|\| Manual \|\| Add-ons QA Team		\| TO-4 \|\| Installing via sideloading \|\| To verify that legacy add-ons are successfully blocked \|\| Manual \|\| Add-ons QA Team
	\|-		\|-
	\| TO-5 \|\| Installing from ~~Add-ons manager~~ \|\| To verify that ~~the permissions flow is fully respected~~ \|\| Manual \|\| Add-ons QA Team		\| TO-5 \|\| Installing from local files\|\| To verify that legacy add-ons are successfully blocked \|\| Manual \|\| Add-ons QA Team
	\|-		\|-
	\| TO-6 \|\| Installing ~~via sideloading~~ \|\| To verify that ~~the permissions flow is fully respected~~ \|\| Manual \|\| Add-ons QA Team		\| TO-6 \|\| Installing from thirdparty \|\| To verify that legacy add-ons are successfully blocked \|\| Manual \|\| Add-ons QA Team
	\|-		\|-
	\| TO-7 \|\| ~~Installing from local files~~\|\| To verify that ~~the permissions flow~~ is ~~fully respected~~ \|\| Manual \|\| Add-ons QA Team		\| TO-7 \|\| Add-on updates \|\| To verify that legacy add-on is successfully updated to a webextension version \|\| Manual \|\| Add-ons QA Team
	\|-		\|-
	\| TO-8 \|\| ~~Installing from thirdparty~~ \|\| To verify that ~~the permissions flow is fully respected~~ \|\| Manual \|\| Add-ons QA Team		\| TO-8 \|\| Browser upgrade \|\| To verify that legacy add-on are successfully disabled and displayed in Legacy Extensions tab \|\| Manual \|\| Add-ons QA Team
	\|-		\|-
	\| TO-9 \|\| ~~Add-on updates~~ \|\| To verify that ~~the permissions flow is fully respected~~ \|\| Manual \|\| Add-ons QA Team		\| TO-9 \|\| Browser downgrade \|\| To verify that legacy add-on are successfully enabled and functional \|\| Manual \|\| Add-ons QA Team
	\|}		\|}

Vasilica.mihasca at 15:42, 17 August 2017

2017-08-17T15:42:38Z

← Older revision		Revision as of 15:42, 17 August 2017
Line 6:		Line 6:
	\|-		\|-
	\| 05/01/2017 \|\| 1.0 \|\| Krupa Raj \|\| Created first draft		\| 05/01/2017 \|\| 1.0 \|\| Krupa Raj \|\| Created first draft
			\|-
			\| 08/17/2017 \|\| 1.1 \|\| Vasilica Mihasca \|\| Updates
	\|-		\|-
	\|}		\|}

Vasilica.mihasca at 15:39, 17 August 2017

2017-08-17T15:39:10Z

← Older revision		Revision as of 15:39, 17 August 2017
Line 320:		Line 320:

	<div class="toccolours mw-collapsible mw-collapsed" style="width:auto">		<div class="toccolours mw-collapsible mw-collapsed" style="width:auto">

	====== Bug fix verification ======		====== Bug fix verification ======
	<div class="mw-collapsible-content">		<div class="mw-collapsible-content">
			<font color="green">'''[Verified]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1308309 Bug 1308309] - Display permissions prompt for webextensions installed using mozAddonManager
			:↳ <small>'''2017-01-10'''</small>: verified fixed on 53.0a1 across platforms
			<font color="green">'''[Verified]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1308295 Bug 1308295] - Prompt users with permissions for third-party webextensions installs
			:↳ <small>'''2015-04-21'''</small>: verified fixed on 53.0a1 across platforms
			</div></div>

	<div class="toccolours mw-collapsible mw-collapsed" style="width:auto">		<div class="toccolours mw-collapsible mw-collapsed" style="width:auto">
Line 329:		Line 332:
	====== Logged bugs ======		====== Logged bugs ======
	<div class="mw-collapsible-content">		<div class="mw-collapsible-content">
	<br/>		[https://bugzilla.mozilla.org/show_bug.cgi?id=1329942 Bug 1329942] - Misaligned icon and webextension name in permissions doorhanger<br/>

	</div>		</div>

Vasilica.mihasca: /* Bug Work */

2017-08-17T15:36:21Z

Bug Work

← Older revision		Revision as of 15:36, 17 August 2017
Line 317:		Line 317:

	= Bug Work =		= Bug Work =
	Tracking bug - [https://bugzilla.mozilla.org/show_bug.cgi?id=~~1308292~~ bug ~~1308292~~]		Tracking bug - [https://bugzilla.mozilla.org/show_bug.cgi?id=1360777 bug 1360777]

	<div class="toccolours mw-collapsible mw-collapsed" style="width:auto">		<div class="toccolours mw-collapsible mw-collapsed" style="width:auto">
Line 323:		Line 323:
	====== Bug fix verification ======		====== Bug fix verification ======
	<div class="mw-collapsible-content">		<div class="mw-collapsible-content">
	~~<font color="green">'''[Verified]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1308309 Bug 1308309] - Display permissions prompt for webextensions installed using mozAddonManager~~
	~~:↳ <small>'''2017-01-10'''</small>: verified fixed on 53.0a1 across platforms~~
	~~<font color="green">'''[Verified]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1308295 Bug 1308295] - Prompt users with permissions for third-party webextensions installs~~
	~~:↳ <small>'''2015-04-21'''</small>: verified fixed on 53.0a1 across platforms~~
	~~</div></div>~~

	<div class="toccolours mw-collapsible mw-collapsed" style="width:auto">		<div class="toccolours mw-collapsible mw-collapsed" style="width:auto">
Line 333:		Line 329:
	====== Logged bugs ======		====== Logged bugs ======
	<div class="mw-collapsible-content">		<div class="mw-collapsible-content">
	~~[https://bugzilla.mozilla.org/show_bug.cgi?id=1329942 Bug 1329942] - Misaligned icon and webextension name in permissions doorhanger~~<br/>		<br/>

	</div>		</div>