QA/Client Crash Id - Revision history

Petruta: /* Checklist */

2017-07-17T15:29:07Z

Checklist

← Older revision		Revision as of 15:29, 17 July 2017
Line 268:		Line 268:
	\|style="text-align:center;"\|		\|style="text-align:center;"\|
	\|-		\|-
	\| QA Beta - Full Testing		\| QA Beta - Full Testing \|\| {{mdone\|}}
	\|style="text-align:center;" \| \|\|		\|style="text-align:center;" \|
	\|-		\|-
	\| QA Signoff - Beta Release \|\|		\| QA Signoff - Beta Release \|\| {{mdone\|}}
	\|style="text-align:center;" \|		\|style="text-align:center;" \|
	\|}		\|}

Petruta: /* Checklist */

2017-05-30T10:13:38Z

Checklist

← Older revision		Revision as of 10:13, 30 May 2017
Line 265:		Line 265:
	\|style="text-align:center;" \|		\|style="text-align:center;" \|
	\|-		\|-
	\| QA Signoff - Nightly Release \|\|		\| QA Signoff - Nightly Release \|\| {{mdone\|}}
	\|style="text-align:center;"\|		\|style="text-align:center;"\|
	\|-		\|-

Petruta: /* Checklist */

2017-05-11T10:26:30Z

Checklist

← Older revision		Revision as of 10:26, 11 May 2017
Line 262:		Line 262:
	\|style="text-align:center;" \|		\|style="text-align:center;" \|
	\|-		\|-
	\| QA Signoff - mid-Nightly \|\|		\| QA Signoff - mid-Nightly \|\| {{mdone\|}}
	\|style="text-align:center;" \| ~~{{mdone\|}}~~		\|style="text-align:center;" \|
	\|-		\|-
	\| QA Signoff - Nightly Release \|\|		\| QA Signoff - Nightly Release \|\|

Petruta: /* Checklist */

2017-05-11T10:25:37Z

Checklist

← Older revision		Revision as of 10:25, 11 May 2017
Line 263:		Line 263:
	\|-		\|-
	\| QA Signoff - mid-Nightly \|\|		\| QA Signoff - mid-Nightly \|\|
	\|style="text-align:center;" \|		\|style="text-align:center;" \| {{mdone\|}}
	\|-		\|-
	\| QA Signoff - Nightly Release \|\|		\| QA Signoff - Nightly Release \|\|

Petruta at 11:49, 3 May 2017

2017-05-03T11:49:09Z

← Older revision		Revision as of 11:49, 3 May 2017
Line 11:		Line 11:
	\| 02/27/2017 \|\| 1.0 \|\| Abe Masresha \|\| Created first draft		\| 02/27/2017 \|\| 1.0 \|\| Abe Masresha \|\| Created first draft
	\|-		\|-
	\|- \|\| \|\| \|\|		\| 05/03/2017 \|\| 1.0 \|\| Petruta Rasa \|\| Added tests and results
	\|-		\|-
	\|}		\|}
Line 47:		Line 47:
	[mailto:gwimberly@softvision.com Grover Wimberly IV - Tester]<br />		[mailto:gwimberly@softvision.com Grover Wimberly IV - Tester]<br />
	[mailto:kkumari@softvision.com Kanchan Kumari - Tester]<br />		[mailto:kkumari@softvision.com Kanchan Kumari - Tester]<br />
			[mailto:petruta.rasa@softvision.com Petruta Rasa - Tester]<br />

	= Testing summary =		= Testing summary =
	== Scope of Testing ==		== Scope of Testing ==
	=== In Scope ===		=== In Scope ===
	This feature will be tested manually on Windows, Mac, Linux operating system ~~and Android devices~~.		This feature will be tested manually on Windows, Mac and Linux operating system.

	=== Out of Scope ===		=== Out of Scope ===
Line 68:		Line 69:

	=== Build ===		=== Build ===
	Firefox Nightly 54.0a1		Firefox Nightly 55.0a1

	= Test Strategy =		= Test Strategy =
Line 114:		Line 115:
	\| Test case creation \|\| [https://docs.google.com/a/mozilla.com/spreadsheets/d/1O9cf70gxWkmmHTW3FIY_u8C-tc8LuAwDU0ai2TSdm64/edit?usp=sharing Test Cases GDoc]		\| Test case creation \|\| [https://docs.google.com/a/mozilla.com/spreadsheets/d/1O9cf70gxWkmmHTW3FIY_u8C-tc8LuAwDU0ai2TSdm64/edit?usp=sharing Test Cases GDoc]
	\|-		\|-
	\| Test case execution \|\| [~~Test Cases TestRail~~]		\| Test case execution \|\| [https://testrail.stage.mozaws.net/index.php?/suites/view/925&group_by=cases:section_id&group_order=asc]
	\|-		\|-
	\| Bugs management \|\| Bugzilla		\| Bugs management \|\| Bugzilla
Line 123:		Line 124:
	== Overview ==		== Overview ==
	= References =		= References =
	Test cases: [ TestRail] or [https://docs.google.com/a/mozilla.com/spreadsheets/d/1O9cf70gxWkmmHTW3FIY_u8C-tc8LuAwDU0ai2TSdm64/edit?usp=sharing Test Cases GDoc]		Test cases: [https://testrail.stage.mozaws.net/index.php?/suites/view/925&group_by=cases:section_id&group_order=asc Test Cases TestRail] or [https://docs.google.com/a/mozilla.com/spreadsheets/d/1O9cf70gxWkmmHTW3FIY_u8C-tc8LuAwDU0ai2TSdm64/edit?usp=sharing Test Cases GDoc]

	Bugs: [https://bugzilla.mozilla.org/show_bug.cgi?id=1322611 Bug 1322611]<br />		Bugs: [https://bugzilla.mozilla.org/show_bug.cgi?id=1322611 Bug 1322611]<br />
Line 187:		Line 188:

	== Test suite ==		== Test suite ==
	Full Test suite - [ Test Cases TestRail]/ [https://docs.google.com/a/mozilla.com/spreadsheets/d/1O9cf70gxWkmmHTW3FIY_u8C-tc8LuAwDU0ai2TSdm64/edit?usp=sharing Test Cases GDoc]<br />		Full Test suite - [https://testrail.stage.mozaws.net/index.php?/suites/view/925&group_by=cases:section_id&group_order=asc Test Cases TestRail]/ [https://docs.google.com/a/mozilla.com/spreadsheets/d/1O9cf70gxWkmmHTW3FIY_u8C-tc8LuAwDU0ai2TSdm64/edit?usp=sharing Test Cases GDoc]<br />

	= Bug Work =		= Bug Work =
	Tracking bugs – [https://bugzilla.mozilla.org/show_bug.cgi?id=~~1310703~~ bug]<br />		Tracking bugs – [https://bugzilla.mozilla.org/show_bug.cgi?id=1322611 bug]<br />

	====== Bugs ======		====== Bugs ======
			<!--
	{\| class="wikitable" style="width:50%"		{\| class="wikitable" style="width:50%"
	\|-		\|-
Line 203:		Line 205:

	\|}		\|}
			-->

	= Sign off =		= Sign off =
Line 227:		Line 230:
	\|-		\|-
	\| Testing Infrastructure setup		\| Testing Infrastructure setup
	\|style="text-align:center;" \| {{~~Inprogress~~\|}}		\|style="text-align:center;" \| {{mdone\|}}
	\|		\|
	\|-		\|-
	\| Test Plan Creation		\| Test Plan Creation
	\| style="text-align:center;" \| {{~~Inprogress~~\|}}		\| style="text-align:center;" \| {{mdone\|}}
	\|		\|
	\|-		\|-
	\| Test Cases Creation		\| Test Cases Creation
	\|style="text-align:center;" \| {{~~Inprogress~~\|}}		\|style="text-align:center;" \| {{mdone\|}}

	\|style="text-align:center;" \| [Test Cases TestRail]/ [https://docs.google.com/a/mozilla.com/spreadsheets/d/1O9cf70gxWkmmHTW3FIY_u8C-tc8LuAwDU0ai2TSdm64/edit?usp=sharing Test Cases GDoc]		\|style="text-align:center;" \| [https://testrail.stage.mozaws.net/index.php?/suites/view/925&group_by=cases:section_id&group_order=asc Test Cases TestRail]/ [https://docs.google.com/a/mozilla.com/spreadsheets/d/1O9cf70gxWkmmHTW3FIY_u8C-tc8LuAwDU0ai2TSdm64/edit?usp=sharing Test Cases GDoc]
	\|-		\|-
	\| Full Functional Tests Execution		\| Full Functional Tests Execution
Line 259:		Line 262:
	\|style="text-align:center;" \|		\|style="text-align:center;" \|
	\|-		\|-
	\| QA Signoff - Nightly ~~Release~~\|\|		\| QA Signoff - mid-Nightly \|\|
	\|style="text-align:center;" \|		\|style="text-align:center;" \|
	\|-		\|-
	~~\| QA Aurora - Full Testing~~		\| QA Signoff - Nightly Release \|\|
	~~\|style="text-align:center;" \| \|\|~~
	\|-
	\| QA Signoff - ~~Aurora~~ Release \|\|
	\|style="text-align:center;"\|		\|style="text-align:center;"\|
	\|-		\|-

Amasresha: /* Checklist */

2017-03-01T21:59:53Z

Checklist

← Older revision		Revision as of 21:59, 1 March 2017
Line 236:		Line 236:
	\| Test Cases Creation		\| Test Cases Creation
	\|style="text-align:center;" \| {{Inprogress\|}}		\|style="text-align:center;" \| {{Inprogress\|}}

	\|style="text-align:center;" \| [Test Cases TestRail]/ [https://docs.google.com/a/mozilla.com/spreadsheets/d/1O9cf70gxWkmmHTW3FIY_u8C-tc8LuAwDU0ai2TSdm64/edit?usp=sharing Test Cases GDoc]		\|style="text-align:center;" \| [Test Cases TestRail]/ [https://docs.google.com/a/mozilla.com/spreadsheets/d/1O9cf70gxWkmmHTW3FIY_u8C-tc8LuAwDU0ai2TSdm64/edit?usp=sharing Test Cases GDoc]
	\|-		\|-
Line 247:		Line 248:
	\| Performance Testing \|\|		\| Performance Testing \|\|
	\|style="text-align:center;" \| Will be covered by developer if needed		\|style="text-align:center;" \| Will be covered by developer if needed
			\|-
	\| Load Testing \|\|		\| Load Testing \|\|
	\|style="text-align:center;" \| Will be covered by developer if needed		\|style="text-align:center;" \| Will be covered by developer if needed

Amasresha: /* Checklist */

2017-03-01T21:59:02Z

Checklist

← Older revision		Revision as of 21:59, 1 March 2017
Line 243:		Line 243:
	\|-		\|-
	\| Automation Coverage \|\|		\| Automation Coverage \|\|
	\|style="text-align:center;" \| ~~will~~ covered by developer if needed		\|style="text-align:center;" \| Will be covered by developer if needed
	\|-		\|-
	\| Performance Testing \|\|		\| Performance Testing \|\|
	\|style="text-align:center;" \| ~~will~~ covered by developer if needed		\|style="text-align:center;" \| Will be covered by developer if needed
	\|-
	\| Load Testing \|\|		\| Load Testing \|\|
	\|style="text-align:center;" \| ~~will~~ covered by developer if needed		\|style="text-align:center;" \| Will be covered by developer if needed
	\|-		\|-
	\| All Defects Logged \|\| \|\|		\| All Defects Logged \|\| \|\|

Amasresha: /* Test Areas */

2017-03-01T21:58:35Z

Test Areas

← Older revision		Revision as of 21:58, 1 March 2017
Line 158:		Line 158:
	\|-		\|-
	\| Server integration testing		\| Server integration testing
	\|style="text-align:center;" \| Yes \|\| ~~feature~~ will send data to a telemetry server and this functionality will be tested		\|style="text-align:center;" \| Yes \|\| Feature will send data to a telemetry server and this functionality will be tested
	\|-		\|-
	\| Offline and server failure testing		\| Offline and server failure testing
Line 180:		Line 180:
	\|-		\|-
	\| Common protocol/data format with other software: specification available. Interop testing with other common clients or servers.		\| Common protocol/data format with other software: specification available. Interop testing with other common clients or servers.
	\|style="text-align:center;" \| Yes \|\| ~~hashed~~ minidump file and restart ping contents will be compared		\|style="text-align:center;" \| Yes \|\| Hashed minidump file and restart ping contents will be compared
	\|-		\|-
	\| Interaction of this feature with other browser features		\| Interaction of this feature with other browser features

Amasresha: /* Scope */

2017-02-28T18:38:39Z

Scope

← Older revision		Revision as of 18:38, 28 February 2017
Line 22:		Line 22:
	* Testing will focus on:		* Testing will focus on:

			::: Stability of the browser with this work.
	::: Functionality and stability of Crash Reporter Client.		::: Functionality and stability of Crash Reporter Client.
	::: Comparing contents of pings from ping sender and restart.		::: Comparing contents of pings from ping sender and restart.
Line 27:		Line 28:
	::: Comparing SHA256 hash of the minidump file and value of minidumpSha256Hash from one of the crash pings.		::: Comparing SHA256 hash of the minidump file and value of minidumpSha256Hash from one of the crash pings.
	::: Comparing SHA256 hash of the minidump file and value of minidumpSha256Hash from the Content crash ping.		::: Comparing SHA256 hash of the minidump file and value of minidumpSha256Hash from the Content crash ping.
	~~::: Stability of the browser with this work.~~

	* How testing will be performed:		* How testing will be performed:

Amasresha: /* Test Objectives */

2017-02-28T18:35:21Z

Test Objectives

← Older revision		Revision as of 18:35, 28 February 2017
Line 78:		Line 78:
	Verify SHA256 hash of the minidump file and the value of minidumpSha256Hash in crash ping are identical.<br />		Verify SHA256 hash of the minidump file and the value of minidumpSha256Hash in crash ping are identical.<br />
	Verify content crash has only one ping<br/>		Verify content crash has only one ping<br/>
	Verify ~~values~~ of minidumpSha256Hash of the content crash is identical to the hash of the minidump file<br>		Verify value of minidumpSha256Hash of the content crash is identical to the hash of the minidump file<br>
	Verify Firefox restarts successfully after crash<br>		Verify Firefox restarts successfully after crash<br>
	Verify crash reporter client is responsive and functional after or before the first ping<br>		Verify crash reporter client is responsive and functional after or before the first ping<br>

← Older revision		Revision as of 21:59, 1 March 2017
Line 236:		Line 236:
	\| Test Cases Creation		\| Test Cases Creation
	\|style="text-align:center;" \| {{Inprogress\|}}		\|style="text-align:center;" \| {{Inprogress\|}}

	\|style="text-align:center;" \| [Test Cases TestRail]/ [https://docs.google.com/a/mozilla.com/spreadsheets/d/1O9cf70gxWkmmHTW3FIY_u8C-tc8LuAwDU0ai2TSdm64/edit?usp=sharing Test Cases GDoc]		\|style="text-align:center;" \| [Test Cases TestRail]/ [https://docs.google.com/a/mozilla.com/spreadsheets/d/1O9cf70gxWkmmHTW3FIY_u8C-tc8LuAwDU0ai2TSdm64/edit?usp=sharing Test Cases GDoc]
	\|-		\|-
Line 247:		Line 248:
	\| Performance Testing \|\|		\| Performance Testing \|\|
	\|style="text-align:center;" \| Will be covered by developer if needed		\|style="text-align:center;" \| Will be covered by developer if needed
			\|-
	\| Load Testing \|\|		\| Load Testing \|\|
	\|style="text-align:center;" \| Will be covered by developer if needed		\|style="text-align:center;" \| Will be covered by developer if needed

← Older revision		Revision as of 21:59, 1 March 2017
Line 243:		Line 243:
	\|-		\|-
	\| Automation Coverage \|\|		\| Automation Coverage \|\|
	\|style="text-align:center;" \| ~~will~~ covered by developer if needed		\|style="text-align:center;" \| Will be covered by developer if needed
	\|-		\|-
	\| Performance Testing \|\|		\| Performance Testing \|\|
	\|style="text-align:center;" \| ~~will~~ covered by developer if needed		\|style="text-align:center;" \| Will be covered by developer if needed
	\|-
	\| Load Testing \|\|		\| Load Testing \|\|
	\|style="text-align:center;" \| ~~will~~ covered by developer if needed		\|style="text-align:center;" \| Will be covered by developer if needed
	\|-		\|-
	\| All Defects Logged \|\| \|\|		\| All Defects Logged \|\| \|\|