Confirmed users
129
edits
Firefox OS/DeviceQA/Gaia-UI-Tests-On-Jenkins: Difference between revisions
Jump to navigation
Jump to search
Firefox OS/DeviceQA/Gaia-UI-Tests-On-Jenkins (view source)
Revision as of 08:45, 27 January 2015
, 27 January 2015→How to Read Build Report
Hermescheng (talk | contribs) |
Hermescheng (talk | contribs) |
||
| Line 11: | Line 11: | ||
== How to Read Build Report == | == How to Read Build Report == | ||
* Test Result Trend of a Project (e.g.: B2G.master.pvt.flame.gaiatest.smoketest) | * <big><big>'''Test Result Trend of a Project'''</big></big> (e.g.: B2G.master.pvt.flame.gaiatest.smoketest) | ||
** In project view (Jenkins>>Project), we can see a figure like below and quickly find out if the failed test number increases. | ** In project view (Jenkins>>Project), we can see a figure like below and quickly find out if the failed test number increases. | ||
** Blue: number of passed cases, Red: number of fail cases, Yellow: number of skipped cases | ** Blue: number of passed cases, Red: number of fail cases, Yellow: number of skipped cases | ||
[[File:Test Result Trend Graph.jpg|thumbnail|none|500px|Test Result Trend]] | [[File:Test Result Trend Graph.jpg|thumbnail|none|500px|Test Result Trend]] | ||
* Test Result Overview of a Build | * <big><big>'''Test Result Overview of a Build'''</big></big> | ||
** In Jenikns>>Project>>Build>>Test Result, we can quickly know which cases failed and if it is failed last last time. | ** In Jenikns>>Project>>Build>>Test Result, we can quickly know which cases failed and if it is failed last last time. | ||
*** If Fail=1 && diff="", it is usually a known issue. | *** If Fail=1 && diff="", it is usually a known issue. | ||
| Line 24: | Line 24: | ||
[[File:Jenkins Project build test results.jpg|thumbnail|none|1000px|Test Result Overview]] | [[File:Jenkins Project build test results.jpg|thumbnail|none|1000px|Test Result Overview]] | ||
* Test Result Details | * <big><big>'''Test Result Details'''</big></big> | ||
** We can find index.html at Jenkins>>Project>>Build>>index.html, just like the red rectangle in below figure. | ** We can find index.html at Jenkins>>Project>>Build>>index.html, just like the red rectangle in below figure. | ||
[[File:How to locate Index.heml.jpg|thumbnail|none|800px|Where to click index.html]] | [[File:How to locate Index.heml.jpg|thumbnail|none|800px|Where to click index.html]] | ||
** It includes test result details, especially build information, logs and screenshot of failed cases. | ** It includes test result details, especially build information, logs and screenshot of failed cases. | ||
*** | *** From log, we usually can determine if it is a common non-bug error. Otherwise, we need to rerun test script locally or rerun test manually. | ||
[[File:Failed Case Screenshot.jpeg|thumbnail|none|1800px|Failed Case Details]] | [[File:Failed Case Screenshot.jpeg|thumbnail|none|1800px|Failed Case Details]] | ||