TestEngineering/Web/Automation/AMO Hudson Logs Summary September 2010
< TestEngineering | Web | Automation(Redirected from QA/Execution/Web Testing/Automation/AMO Hudson Logs Summary September 2010)
Smoke tests amo.preview
| Date | Time | Run | Test Case | Issue | Resolution / Comment |
|---|---|---|---|---|---|
| 9/30/10 | 1594 - 1595 | GREEN | |||
| 9/30/10 | 3:00 pm | 1593 | various test cases | http status code 500 | |
| 9/27/10 - 9/30/10 | 1567 - 1592 | GREEN | |||
| 9/27/10 | 1566 | search for collections by name | collection "this is a test" was not found in search results. | collection appeared to be in transition from one author to another, which affects the URL. error did not occur in next run. | |
| 9/24/10 - 9/27/10 | 1542 - 1564 | GREEN | |||
| 9/24/10 | 1541 | test suite did not launch. | http code 500 returned. False positive. | ||
| 9/23/10 - 9/24/10 |
1534 - 1540 |
. Verify user logout . Verify iser login |
Element in header not found following logout or login |
In manual testing, issues seen intermittently with login and logout elements in page header. Update: Login & Logout test cases disabled until issue with Login/Logout elements is resolved. | |
| 9/21/10 - 9/23/10 | 1518 - 1533 | GREEN | |||
| 9/21/10 | 1514 - 1517 | add-on search results sort options | "Name" sorting option replaced with "Updated" option. Bug 594125 | Test case and supporting files updated. | |
| 9/19/10 - 9/21/10 | 1500 - 1513 | GREEN | |||
| 9/19/10 |
1497 - 1499 |
test suite failed to start |
SVN and Hudson errors |
||
| 9/19/10 | 1496 | search for add-ons by name | test case fails to find add-on in results | issue with /z/ occasionally appearing in add-on URL in browse page. similar to bug 590652 | |
| 9/17/10 - 9/19/10 | 1483 - 1495 | GREEN | |||
| 9/17/10 |
4:00 pm |
1482 |
test suite did not launch |
False positive. http code 500 returned |
|
| 9/16/10 - 9/17/10 |
1476 - 1481 |
GREEN | |||
| 9/16/10 |
6:01 pm |
1475 |
search for collection by name |
search returned no results |
collection: testCollection_52500. Collection cannot be found manually. Failure in run in FF on Mac, not seen in run in FF on Win 7. Speculate that collection was deleted or renamed during test case run. |
| 9/16/10 | 1474 | GREEN | |||
| 9/16/10 | 1472 - 1473 | collection directory page layout | Share widget not found on collection | Share widget locator was changed. Update: test case revised for new locator. | |
| 9/16/10 | 1471 | GREEN | |||
| 9/16/10 | 1470 | test suite not run | False positive. http code 500 returned | ||
| 9/15/10 - 9/16/10 | 1465 - 1469 | GREEN | |||
| 9/14/10 - 9/15/10 | 1457 - 1464 |
search for add-on by name | no results returned for an existing add-on. | add-on search - recreated manually. bug 594494 Update: test case updated to suppress exception for add-ons related to the bug. | |
| 9/14/10 | 12:01 pm | 1456 | various |
. http code 500 . log in failed |
|
| 9/13/10 - 9/14/10 | 1448 - 1455 | GREEN | |||
| 9/13/10 |
9:01 am |
1447 |
search API for version |
Error: Could not retrieve a new session |
|
| 9/11/10 - 9/13/10 |
1434 - 1446 |
GREEN | |||
| 9/11/10 |
1431 - 1433 |
suite failed to start |
False positives. Suite failed to start due to http 500 error. |
||
| 9/8/10 - 9/11/10 | 1409 - 1430 | GREEN | |||
| 9/8/10 |
1407 - 1408 |
Suite failed to start |
False positives. Suite failed to start due to http 500 error. |
||
| 9/7/10 - 9/8/10 | 1403 - 1406 | persona landing page layout | scrolling element missing from featured panel | ||
| 9/7/10 |
1402 |
Searching API 1.2 via platform |
expected search results no returned |
needs investigation | |
| 9/6/10 - 9/7/10 | 1399 - 1401 | GREEN | |||
| 9/4/10 - 9/6/10 |
1378 - 1398 |
AMO home page layout | exception reported for collection without a name. |
Test is disabled until staging data is refreshed. | |
| Collections directory layout | ditto | Test limited to options that doesn't have collection with no name | |||
| 9/3/10 | 1376 - 1377 | GREEN | |||
| 9/3/10 | Updating and revising test cases following new web page updated. | RED & GREEN from manually launched suites | |||
| 9/2/10 |
9:00 pm |
1364 |
various test cases |
. Error 500 - internal server error . Service unavailable errors |
|
| 9/1/10 | GREEN |
go to Smoke tests preview | next | production Other amo.preview BFT | FFT | Search subset
Smoke tests amo.next
| Date | Time | Run | Test Case | Issue | Resolution / Comment |
|---|---|---|---|---|---|
| 9/30/10 | 504 - 506 | GREEN | |||
| 9/30/10 | 1:01 pm | 503 | various test cases | http status code 503: service unavailable | |
| 9/29/10 - 9/30/10 |
494 - 502 |
GREEN | |||
| 9/29/10 |
491 - 493 |
suite not run |
http status code: 500 |
||
| 9/28/10 - 9/29/10 | 488 - 490 |
GREEN | |||
| 9/28/10 |
487 |
Search for collections by name |
Known collection name returned no results. |
Collection: testCollection_817972_renamed. Not listed in collection browse pages. Might collection getting changed by manual testing when suite was running. | |
| 9/28/10 |
486 |
AMO home page layout |
add-on with an empty name |
Might be known issue described in bug 567250 | |
| 9/24/10 - 9/27/10 | 454 - 485 | GREEN | |||
| 9/24/10 | 453 | . Verify user logout . Verify iser login |
Element in header not found following logout or login |
In manual testing, issues seen intermittently with login and logout elements in page header. Update: Login & Logout test cases disabled until issue with Login/Logout elements is resolved. | |
| 9/24/10 |
449; 451 - 452 |
suite not launched |
http code 500. False positive |
||
| 9/23/10, 9/24/10 |
447, 448, 450 |
various test cases |
http code 500 |
||
| 9/19/10 - 9/23/10 | 414 - 446 | suite not launched | http code 500. False positive. | ||
| 9/19/10 | 1:01 pm | 413 | suite not launched | SVN error | |
| 9/17/10 - 9/19/10 | 398 - 412 | suite not launched |
http code 500. False positive | ||
| 9/17/10 | 397 | various test cases | internal server error | ||
| 9/14/10 - 9/17/10 |
372 - 396 |
suite not launched | http code 500. False positive | ||
| 9/14/10 |
369 - 371 |
GREEN | |||
| 9/13/10 |
10:01 pm |
368 |
search for collection by name |
search for known collection returned no results. Collection: kughjgfhj] | collection is found in manual search. presumably was found in later test runs. |
| 9/12/10 - 9/13/10 | 358 - 367 | GREEN | |||
| 9/12/10 | 357 | various test cases | error 503 - service unavailable | ||
| 9/9/10 - 9/12/10 |
330 - 356 |
GREEN | |||
| 9/9/10 |
1:31 am |
329 |
suite not launched | http code 500. False positive | |
| 9/8/10 |
326 - 328 |
GREEN | |||
| 9/8/10 |
2:00 pm |
325 |
search API for platform |
timeout erorr at page open |
|
| 9/6/10 - 9/8/10 | 315 - 324 | GREEN | |||
| 9/4/10 - 9/6/10 |
294 - 314 |
AMO home page layout | exception reported for collection without a name. |
Test is disabled until staging data is refreshed. | |
| Collections directory layout | ditto | Test limited to options that doesn't have collection with no name | |||
| 9/3/10 - 9/4/10 | 291 - 293 | GREEN | |||
| 9/3/10 | Updating and revising test cases following new web page updated. | RED & GREEN from manually launched suites | |||
| 9/1/10 - 9/2/10 | 275 - 278 | GREEN | |||
| 9/1/10 | 7:01 pm | 274 | various test cases | error 503 - service unavailable | |
| 9/1/10 | 268 - 273 | GREEN |
go to Smoke tests preview | next | production Other amo.preview BFT | FFT | Search subset
Smoke tests amo.prod
| Date | Time | Run | Test Case | Issue | Resolution / Comment |
|---|---|---|---|---|---|
| 9/28/10 - 9/30/10 |
68 - 70 | GREEN | |||
| 9/28/10 |
67 |
search for add-ons by name |
Install box text is different on browse page and search results. |
Add-on: Web History Repository. Not seen when TC is run locally or next Hudson run. | |
| 9/22/10 - 9/27/10 |
61 - 66 | GREEN | |||
| 9/22/10 |
59 - 60 |
search for personas by name |
Known personas not found in results. Browse page sometimes uses /en-Us/ instead of /en-US/ in URL to detail page. |
Intermittent issue. Filed bug 598717. Will create workaround in test cases. | |
| 9/22/10 | 58 | add-on search results sort options | Update to test case not compatible with production pages | "Updated" sort option not run, temporarily, until staging page is pushed to production. | |
| 9/21/10 | 10:58 am | 57 | search for add-ons by name | Descriptions different on browse page and search results. | Add-on: Personas Plus. Browse page contains text "60,000". Search results contains text "180,000". |
| 9/21/10 | 56 |
. search for add-ons by name . search for personas by name |
Known add-ons or personas not found in results. | Issue not seen in manual searches or running test cases locally. Did not recurr in following run. Seems not related to bug 590652. | |
| 9/17/10 - 9/20/10 | 52 - 55 |
GREEN | |||
| 9/17/10 |
51 |
collections directory page layout |
test case failed to find Share widget. |
change in staging caused test case to fail on production. test case will be disabled in prod smoketests until change is pushed to production. | |
| 9/16/10 | 50 | GREEN | |||
| 9/8/10 - 9/15/10 |
42 - 49 |
add-on search by name |
no results returned for an existing add-on. |
add-on search - recreated manually. bug 594494 Update: test case updated to suppress exception for add-ons related to the bug. | |
| 9/11/10 |
45 |
add-on search by name |
recurring issue |
||
| persona search by name |
test case fails to find persona in results |
issue with /z/ occasionally appearing in persona URL in browse page. bug 590652 | |||
| 9/8/10 | 41 |
. persona search by name . add-on search by name |
expected item not found in search results |
, persona search - could not recreate manually. . add-on search - recreated manually. filed bug 594494 | |
| 9/6/10 |
40 |
collection directory layout |
collection with no name. |
to be investigated | |
| 9/3/10 - 9/5/10 |
37 - 39 |
GREEN | |||
| 9/3/10 |
36 |
add-on search by name |
search term (add-on name) contained non-ASCII character. |
Test case needs to skip searches with non-ASCII chars. | |
| 9/3/10 | 35 |
AMO home page layout | could not found a page element | Web pages updated. Updated test cases need to be committed. | |
| 9/1/10 - 9/2/10 | GREEN |
go to Smoke tests preview | next | production Other amo.preview BFT | FFT | Search subset
Other amo.preview
BFT
| Date | Time | Run | Test Case | Issue | Resolution / Comment |
|---|---|---|---|---|---|
| 9/24/10 - 9/30/10 | 69 - 75 | GREEN | |||
| 9/24/10 | 67 - 68 | various test cases | Login failed - 'log out' element not found after login attempt. | There has been is a known issue with JavaScript not executing correctly. Update: test suites to run test cases without logging in, until issue is resolved. | |
| add-on detail layout |
. Review posting box is missing. . 'Login' & 'Register' links appear when not expected. |
||||
| 9/22/10 - 9/23/10 | 65 - 66 |
GREEN | |||
| 9/16/10 - 9/21/10 |
59 - 64 |
. collection directory layout . add-on detail layout |
collections without a name. | bug filed 594137 | |
| 9/15/10 | 58 |
search for add-on by name | no results returned for an existing add-on. | add-on search - recreated manually. bug 594494. Update: test case updated to suppress exception for add-ons related to the bug. | |
|
. collection directory layout . add-on detail layout |
collections without a name. | bug filed 594137 | |||
| 9/14/10 | 57 | GREEN | |||
| 9/13/10 | 56 | various test cases | error 500 - Internal server error; service unavailable. | ||
| 9/11/10 - 9/12/10 | 54 - 55 | GREEN | |||
| 9/9/10 - 9/10/10 | 52 - 53 | add-on detail layout | verification on tag URL fails when tag contains "?". |
artifact of testing in since the same tags are not seen in production. test case will be updated to skip tags with "?". related bug 594199 regarding failed search on a tag with "?". | |
| collections directory layout | test collections with no name | known data issue in staging due to bug | |||
| 9/9/10 | 51 | add-on search by name | search did not include expected add-on | add-on: Amazon Search | |
| various test cases |
. error 500 - service unavailable . timeout errors |
||||
| 9/8/10 | 12:19 pm | 50 | add-on search by name | search did not include expected add-on | add-on: Amazon Search |
| add-on detail layout | regex match function fails when add-on tag has "???" |
. test case logic needs revising. . identified error in search tags with "???". Bug 594199 filed | |||
| collections directory layout | test collections with no name | known data issue in staging due to bug | |||
| 9/8/10 | 12:31 am |
49 | various test cases |
. missing elements in featured items panel . tags missing from add-ons page |
some issues due to bug in JS related elements. fix committed. |
| 9/7/10 |
48 |
Searching API 1.2 via platform |
expected search results no returned |
needs investigation | |
| 9/4/10 - 9/6/10 | 44 - 46 | various test cases | various | more test cased need to be updated | |
| 9/2/10 - 9/3/10 | 41 - 43 | add-on detail layout; add-on browse page sorts | add-on date no longer on browse page, unless sort is by date | test cases need to be updated. | |
| 9/1/10 | 10:29 am | 40 | add-on detail page layout | 'Service unavailable' error when accessing add-on browse page |
go to Smoke tests preview | next | production Other amo.preview BFT | FFT | Search subset
FFT
| Date | Time | Run | Test Case | Issue | Resolution / Comment |
|---|---|---|---|---|---|
| 9/25/10 - 9/30/10 | 132 - 137 | GREEN | |||
| 9/24/10 | 131 | various test cases | Login failed - 'log out' element not found after login attempt. | There has been is a known issue with JavaScript not executing correctly. Update: test suites to run test cases without logging in, until issue is resolved. | |
| 9/18/10 - 9/23/10 | 125 - 130 | GREEN | |||
| 9/17/10 | 124 | search for personas by name | error returned by search: Internal server error | ||
| 9/17/10 |
123 |
search for personas by name |
. "popular" sort option not found after it had previously been present. . unexcepted # of personas on the browse page. |
. missing sort option being investigated. . unexpected persona count due to test case logic error. Test has been fixed and comitted. | |
| 9/16/10 |
120, 122 |
search for add-ons using by category and sort options |
. elements in search results missing . "Service unavailable" error returned from search |
||
| search for personas by name | http 500 error - Internal server error | ||||
| 9/15/10 | 119 | search for persona by name | known persona not found in search results | search for persona "Whiteness" returns 1000 results. Persona might not be included in truncated results. Test case needs to be updated to skip. | |
| 9/14/10 | 118 | GREEN | |||
| 9/13/10 |
117 |
search for persona by name |
timeout error |
||
| 9/8/10 - 9/12/10 | GREEN | ||||
| 9/8/10 |
4:31 am |
110 |
various test cases |
http error 500 - service unavailable. |
|
| 9/1/10 - 9/7/10 | GREEN |
go to Smoke tests preview | next | production Other amo.preview BFT | FFT | Search subset
Search subset
| Date | Time | Run | Test Case | Issue | Resolution / Comment |
|---|---|---|---|---|---|
| 9/24/10 - 9/30/10 |
124 - 130 |
GREEN | |||
| 9/23/10 | 123 | search for add-ons by name | message returned: Search is temporarily unavailable. | ||
| 9/16/10 - 9/22/10 |
116 - 122 | GREEN | |||
| 9/15/10 |
115 |
search for category and sort options |
search returned message "The requested URL /z/en-US/firefox/search/ was not found on this server" |
not seen when run locally or manual searches. bug 596695 | |
| 9/12/10 - 9/14/10 | 112 - 114 | GREEN | |||
| 9/11/10 | 111 | various test cases |
. error 500 - Internal server failure . error: service is temporarily unavailable |
||
| 9/9/10 - 9/10/10 | 109 - 110 | GREEN | |||
| 9/8/10 |
108 |
False positive reported. Suite not started due to http status code 500. |
|||
| 9/7/10 |
107 |
Search panel Pagination option. Exception regarding # of items returned. |
|||
| 9/3/10 - 9/6/10 | 101 - 106 | multiple test cases | Test suite and test cases need to be updated for new web pages. | ||
| 9/2/10 |
add-on search using Last Updated criteria |
add-on date missing from search results |
|||
| 9/1/10 | GREEN |
go to Smoke tests preview | next | production Other amo.preview BFT | FFT | Search subset