Confirmed users
129
edits
Firefox OS/DeviceQA/Gaia-UI-Tests-On-Jenkins: Difference between revisions
Jump to navigation
Jump to search
Firefox OS/DeviceQA/Gaia-UI-Tests-On-Jenkins (view source)
Revision as of 08:28, 27 January 2015
, 27 January 2015→How to Read Build Report
Hermescheng (talk | contribs) |
Hermescheng (talk | contribs) |
||
| Line 14: | Line 14: | ||
** In project view (Jenkins>>Project), we can see a figure like below and quickly find out if the failed test number increases. | ** In project view (Jenkins>>Project), we can see a figure like below and quickly find out if the failed test number increases. | ||
** Blue: number of passed cases, Red: number of fail cases, Yellow: number of skipped cases | ** Blue: number of passed cases, Red: number of fail cases, Yellow: number of skipped cases | ||
[[File:Test Result Trend Graph.jpg|thumbnail|none|Test Result Trend]] | [[File:Test Result Trend Graph.jpg|thumbnail|none|500px|Test Result Trend]] | ||
* Test Result Overview of a Build | * Test Result Overview of a Build | ||
| Line 21: | Line 21: | ||
*** If Fail=1 && diff=+1, we need to figure out the reason: <big>'''if it resulted from a bug'''</big>. | *** If Fail=1 && diff=+1, we need to figure out the reason: <big>'''if it resulted from a bug'''</big>. | ||
*** If Pass=1 && diff=+1, the issue in last build might be resolved. | *** If Pass=1 && diff=+1, the issue in last build might be resolved. | ||
[[File:Jenkins Project build test results.jpg|thumbnail|none|Test Result Overview]] | [[File:Jenkins Project build test results.jpg|thumbnail|none|500px|Test Result Overview]] | ||
* Test Result Details | * Test Result Details | ||
** In Jenkins>>Project>>Build>>index.html, we can see test result details, including build information, logs and screenshot of failed cases. | ** In Jenkins>>Project>>Build>>index.html, we can see test result details, including build information, logs and screenshot of failed cases. | ||
[[File:How to locate Index.heml.jpg|thumbnail|none|Where to click index.html]] | [[File:How to locate Index.heml.jpg|thumbnail|none|500px|Where to click index.html]] | ||
[[File:Failed Case Screenshot.jpeg|thumbnail|none|Failed Case Details]] | [[File:Failed Case Screenshot.jpeg|thumbnail|none|500px|Failed Case Details]] | ||
** How to verify if a failed case resulted from a bug | ** How to verify if a failed case resulted from a bug | ||