Smoke tests amo.preview

Date	Run	Test Case	Issue	Resolution / Comment
10/31/10	1852 - 1855			GREEN
10/31/10	1851	test suite not run	http status code 500
10/24/10 - 10/31/10	1794 - 1850			GREEN
10/24/10	1793	test suite not run	http status code 500
10/22/10 - 10/24/10	1781 - 1792			GREEN
10/22/10	1780	AMO page header & footer contents	test case failed to run	test case commit didn't include all necessary class updates.
10/22/10	1778 - 1779	various search test cases	search failed to return results	search service not available.
10/20/10 - 10/22/10	1760 - 1777			GREEN
10/19/10 - 10/20/10	1754 - 1759	add-on category landing layout	add-on category landing page not available.
10/19/10	1750- 1753			GREEN
10/19/10	1748 - 1749	suite not run	http status 500
10/19/10	1747			GREEN
10/18/10	1746	search for add-ons by name	search returned no results for known add-ons	issues did not occur in next run
		add-ons search results' sorts	categpry browse page has no add-ons
		Search API 1.2 via apps	expected element missing
10/18/10	1742 - 1745			GREEN
10/17/10 - 10/18/10	1732 - 1741	suite not run	svn unknown host error
10/17/10	1729 - 1731			GREEN
10/17/10	1728	search for add-ons by name	http status 500
10/16/10 - 10/17/10	1726 - 1727			GREEN
10/16/10	1721 - 1725	suite not run	http status 500
10/16/10	1720			GREEN
10/16/10	1719	search for add-ons by name	http status 500
10/15/10	1716 - 1718			GREEN
10/15/10	1715	search for add-ons by name	http status 500
10/15/10	1714			GREEN
10/15/10	1713	. add-on search by name . add-on search results sorts	search returned no results for known add-ons	not seen in following run
10/14/10 - 10/15/10	1707 - 1712			GREEN
10/14/10	1706	test suite not run	http error 500
10/14/10	1705	various test cases	Message returned "Service Unavailable The service is temporarily unavailable"
10/14/10	1703 - 1704			GREEN
10/13/10	1702	search for add-ons by name	http error 500
10/12/10 - 10/13/10	1691 - 1701			GREEN
10/12/10	1689 - 1690	suite not run	http status code 500
10/8/10 - 10/12/10	1658 - 1688			GREEN
10/8/10	1657	persona landing page layout	page not found	could not recreate manually
10/8/10	1656			GREEN
10/8/10	1655	suite not run	http status code 500
10/5/10 - 10/8/10	1632 - 1654			GREEN
10/5/10	1631	suite not run	http status code: 500
10/4/10 - 10/5/10	1626 - 1630			GREEN
10/4/10	1624 - 1625	various test cases	Disclaimer paragraph removed from AMO page footer as per bug 593510	Shared function updated to check for absence.
10/4/10	1623			GREEN
10/4/10	1622	suite not run	http status code: 500
10/3/10	1619 - 1621			GREEN
10/3/10	1617 - 1618	suite not run	http status code: 500
10/1/10 - 10/3/10	1596 - 1616			GREEN

Smoke tests amo.next

run during code freeze only

Date	Run	Test Case	Issue	Resolution / Comment
10/19/10 - 10/20/10	658 - 664	add-on category landing page layout	add-on category page not available.
10/19/10	656 - 657			GREEN
10/19/10	655	add-on category landing layout	Three "top" lists missing	issue not in next run
		category search results' sorts	. Search returned no results. . Category browse page had no add-ons
		various test cases	http status 500
10/18/10 - 10/19/10	650 - 654			GREEN
10/18/10	649	suite issue	job aborted after 1 hour. normally run 10 minutes
10/17/10 - 10/18/10	642 - 648	suite not run	svn unknown host error
10/17/10	639- 641			GREEN
10/17/10	638	search for add-on by name	http status 500
10/16/10 - 10/17/10	635 - 637			GREEN
10/16/10	633 - 634	suite not run	http status 500
10/16/10	632	search for add-on by name	http status 500
10/16/10	631			GREEN
10/16/10	630	search for add-ons by name	http status 500
10/15/10 - 10/16/10	627 - 629			GREEN
10/15/10	626	search for add-ons by name	http status 500
10/15/10	625			GREEN
10/15/10	624	search for add-ons by name	http status 500
10/14/10 - 10/15/10	618 - 623			GREEN
10/14/10	617	search for add-ons by name	http status 500
10/13/10 - 10/14/10	613 - 616			GREEN
10/13/10	612	search for add-ons by name	http status 500
10/12/10 - 10/13/10	602 - 611			GREEN
10/12/10	601	test suite not run	http status 500
10/5/10 - 10/12/10	545 - 600			GREEN
10/4/10 - 10/5/10	537 - 544	various test cases	side effect of updating TCs to handle change in Preview. See comment re: AMO page footer in Preview smoketests
10/1/10 - 10/4/10	507 - 536			GREEN

Smoke tests amo.prod

Date	Run	Test Case	Issue	Resolution / Comment
10/27/10 - 10/31/10	110 - 114			GREEN
10/27/10	109	search for collection by name	subscribers count different on browse page and search results by 1
10/27/10	108			GREEN
10/27/10	107	search for collection by name	subscribers, vote counts different on browse page and search results by 1
10/25/10 - 10/26/10	105 - 106			GREEN
10/23/10 - 10/24/10	103 - 104	search for collection by name	subscribers, vote counts different on browse page and search results by 1 or 2.
10/21/10 - 10/22/10	101 - 102			GREEN
10/21/10	99 - 100	search for collection by name	subscribers, vote counts different on browse page and search results by 1.	no difference when pages were manually checked.
10/19/10 - 10/20/10	97- 98			GREEN
10/18/10	96	suite not run	svn unknown host error
10/17/10	95	search for personas by name	known persona not found	persona URL in browse page had /z/. need to review code
10/8/10 - 10/16/10	86 - 94			GREEN
10/8/10	85	search for persona by name	persona browse page has /en-us/ instead of /en-US/ in persona URLs	as per bug 598717 case in URL doesn't matter. Will update test case.
10/4/10 - 10/7/10	80 - 84			GREEN
10/4/10	78 - 79	search for persona by name	persona browse page has /z/ in persona URLs	occurs occasionally, see bug 590652. Workaround in test case difficult to verify since problem is intermittent.
10/1/10 - 10/4/10	74 - 77			GREEN
10/1/10	73	search for persona by name	persona browse page has /z/ in persona URLs	occurs occasionally, see bug 590652.

Other amo.preview

BFT

Date	Run	Test Case	Issue	Resolution / Comment
10/29/10 - 10/31/10	114 - 116			GREEN
10/29/10	113	Searching API 1.2 via category	page timeout	manual run okay
		Add tags	element missing	manual run okay
10/25/10 - 10/28/10	109 - 112			GREEN
10/24/10	108	various test cases	search not available; log in failed, page load timeout
10/23/10	107			GREEN
10/22/10	106	search for add-ons by name	searches return no results
10/22/10	105	add-on detail page layout	reviews not found	locator for reviews need to be updated
10/20/10 - 10/21/10	103 - 104			GREEN
10/20/10	102	category browse page test cases	category browse page not available.
10/19/10	100 - 101	various test cases	http status 500
10/18/10	99	test suite not run	svn host not found error
10/16/10 - 10/17/10	97 - 98			GREEN
10/15/10	96	themes home page layout	Message returned "Service Unavailable The service is temporarily unavailable."
		themes home page Created sort	login failed
10/15/10	95	add-on detail page layout	searching for "meet the developer" text failed incorrectly.	revise test case
10/14/10	94			GREEN
10/13/10	93	search for add-ons by name	search failed. returned "Not Found The requested URL /z/en-US/firefox/search/ was not found on this server."	not seen in manual search
10/8/10 - 10/13/10	87 - 93	test add/remove/edit collections	expected element or text not present
10/7/10 - 10/8/10	85 - 86			GREEN
10/7/10	84	test add/remove/edit collections	expected element not present
10/7/10	83	suite not run	error in adding new test case to suite
10/4/10 - 10/6/10	79 - 82			GREEN
10/3/10	78	test add/remove/edit collections	expected element not present
10/2/10	77	add-on category browse page	page timeout
10/1/10	76	test add/remove/edit collections	expected text not present

FFT

FFT suite discontinued 10/10/10. Replaced by Sort and Layout suites

Date	Run	Test Case	Issue	Resolution / Comment
10/19/10	163	suite not run	http status 500
10/18/10	162	suite not run	svn unknown host error
10/17/10	161			GREEN
10/16/10	160	search for personas by name	elements missing from page	issue not in next run
10/13/10 - 10/15/10	157 - 159			GREEN
10/13/101	156	search for personas by name	error 404
10/12/10	155			GREEN
10/12/10	154	search for persona by name	elements missing from page	site intermittently returned http status 500
10/12/10	153	suite not run	http status code 500
10/12/10	152	search personas by name	elements missing from page.	not seen manually.
10/8/10- 10/11/10	148 - 151			GREEN
10/8/10	147	search for persona by name	search returned no results. returning to browse page displayed no personas	could not create manually.
10/5/10 - 10/7/10	144 - 146			GREEN
10/5/10	143	search for personas by name	XHR ERROR: 500 Error_Message = Internal Server Error
		sort options on on search results	Expected category not found.
10/4/10	142	various test cases	Disclaimer paragraph removed from AMO page footer as per bug 593510
10/4/10	141	search for persona by name	Search failed. Service Unavailable The service is temporarily unavailable.
10/1/10- 10/3/10	138 - 140			GREEN

Search suite

Date	Run	Test Case	Issue	Resolution / Comment
10/31/10	170	persona search by name	"The service is temporarily unavailable" message returned when opening category landing page.
10/19/10 - 10/29/10	157 - 169			GREEN
10/18/10	156	search for personas by name	page load timeout	network slow at the time.
10/18/10	155	suite not run	svn unknown host error
10/17/10	154			GREEN
10/16/10	153	suite not run	http status 500
10/14/10 - 10/15/10	151 - 152			GREEN
10/14/10	150	suite not run	http status code 500
10/12/10 - 10/13/10	148 - 149			GREEN
10/12/10	147	suite not run	http status code 500
10/7/10 - 10/11/10	142 - 146			GREEN
10/7/10	141	various test cases	. http status code 500 . page timeouts
10/7/10	140	search for themes by name	test case crashed due to bad parameter in suite.
10/7/10	139	test suite not run	error in addition of new test case
10/5/10 - 10/6/10	137 - 138			GREEN
10/5/10	136	test suite not run	http status code: 500
10/1/10 - 10/4/10	132 - 135			GREEN
10/1/10	131	search for persona by name	search failed. returned "Service Unavailable The service is temporarily unavailable."

Sort suite

Date	Run	Test Case	Issue	Resolution / Comment
10/25/10 - 10/31/10	8-14			GREEN
10/24/10	7	suite not run	http status code 500
10/20/10 - 10/23/10	3-6			GREEN
10/20/10	2	various test cases	add-on category browse page not available
10/19/10	1	add-on category browse page sorts	elements missing from page	http status 500 seen in other suites
		add-on category browse page sorts	name sort not descending	known bug in name sort. test case updated to skip additional add-ons.

Layout suite

Date	Run	Test Case	Issue	Resolution / Comment
10/22/10 - 10/31/10	9-19			GREEN
10/22/10	7	add-ons detail page layout	seamonkey and sunbird add-ons contain /thunderbird/ links' URL	suspend running test case on seamonkey and sunbird, temporarily.
10/22/10	7-8	add-ons detail page layout	contribute element found on browse page, not detail page	update contribute element locator to include alternate format of element.
10/22/10	6	add-ons detail page layout	reviews not found	locator for reviews need to be updated
10/21/10	5			GREEN
10/21/10	4	collections directory layout	error: unexpected URL on sharing db-url attribute	actual problem: logic error in test case when handling collections with a blank name
10/20/10	1-3	collections directory layout	collections with null names	known issue already resolved. test case skips exception if not FF and "not recent" (on lower half of page).
10/20/10	1	themes landing layout	error on themes not rated	test cases did not handle themes with 'no rated yet' message. test case updated to check for both ratings and 'not rated' message.

TestEngineering/Web/Automation/AMO Hudson Logs Summary October 2010

Contents

Smoke tests amo.preview

Smoke tests amo.next

Smoke tests amo.prod

Other amo.preview

BFT

FFT

Search suite

Sort suite

Layout suite

Navigation menu