Confirmed users
129
edits
Firefox OS/DeviceQA/Gaia-UI-Tests-On-Jenkins: Difference between revisions
Jump to navigation
Jump to search
Firefox OS/DeviceQA/Gaia-UI-Tests-On-Jenkins (view source)
Revision as of 08:20, 27 January 2015
, 27 January 2015→How to read build report
Hermescheng (talk | contribs) No edit summary |
Hermescheng (talk | contribs) |
||
| Line 10: | Line 10: | ||
** Sample file | ** Sample file | ||
== How to | == How to Read Build Report == | ||
* | * Test Result Trend of a Project (e.g.: B2G.master.pvt.flame.gaiatest.smoketest) | ||
** In project view (Jenkins>>Project), we can see a figure like below and quickly find out if the failed test number increases. | ** In project view (Jenkins>>Project), we can see a figure like below and quickly find out if the failed test number increases. | ||
[[File:Test Result Trend Graph.jpg|thumbnail|none|Test Result Trend]] | [[File:Test Result Trend Graph.jpg|thumbnail|none|Test Result Trend]] | ||
* | |||
** In | * Test Result Overview of a Build | ||
** If it | ** In Jenikns>>Project>>Build>>Test Result, we can quickly know which cases failed, and its status of the previous test run. | ||
*** If Fail=1 && diff="", it is usually a known issue. | |||
*** If Fail=1 && diff=+1, we need to figure out the reason: <big>'''if there is a bug or not'''</big>. | |||
*** If Pass=1 && diff=+1, the previous issue might be resolved. | |||
[[File:Jenkins Project build test results.jpg|thumbnail|none|Test Result Overview]] | [[File:Jenkins Project build test results.jpg|thumbnail|none|Test Result Overview]] | ||
* index.html | |||
* Test Result Details | |||
** In Jenkins>>Project>>Build>>index.html, we can see test result details, including build information, logs and screenshot of failed cases. | |||
[[File:How to locate Index.heml.jpg|thumbnail|none|Where to click index.html]] | |||
[[File:Failed Case Screenshot.jpeg|thumbnail|none|Failed Case Details]] | |||
** How to verify if a failed case resulted from a bug | ** How to verify if a failed case resulted from a bug | ||
** Common non-bug errors | ** Common non-bug errors | ||