Confirmed users
1,051
edits
Firefox OS/DeviceQA/Gaia-UI-Tests-On-Jenkins: Difference between revisions
Jump to navigation
Jump to search
Firefox OS/DeviceQA/Gaia-UI-Tests-On-Jenkins (view source)
Revision as of 08:12, 9 February 2015
, 9 February 2015→How to Read Build Report
m (Lakrits moved page FirefoxOS/DeviceQA/Gaia-UI-Tests-On-Jenkins to Firefox OS/DeviceQA/Gaia-UI-Tests-On-Jenkins: The official spelling of "Firefox OS" leaves a space between the two parts of the name. It's easier to find a page if the spelling o...) |
|||
| Line 16: | Line 16: | ||
== How to Read Build Report == | == How to Read Build Report == | ||
* <big><big>'''Test Result Trend of a Project'''</big></big> (e.g.: B2G. | * <big><big>'''Test Result Trend of a Project'''</big></big> (e.g.: B2G.v2.2.pvt.flame.gaiatest.smoketest) | ||
** In project view (Jenkins>>Project), we can see a figure like below and quickly find out if the failed test number increases. | ** In project view (Jenkins>>Project), we can see a figure like below and quickly find out if the failed test number increases. | ||
** Blue: number of passed cases, Red: number of fail cases, Yellow: number of skipped cases | ** Blue: number of passed cases, Red: number of fail cases, Yellow: number of skipped cases | ||
| Line 32: | Line 32: | ||
** We can find index.html at Jenkins>>Project>>Build>>index.html, just like the red rectangle in below figure. | ** We can find index.html at Jenkins>>Project>>Build>>index.html, just like the red rectangle in below figure. | ||
[[File:How to locate Index.heml.jpg|thumbnail|none|800px|Where to click index.html]] | [[File:How to locate Index.heml.jpg|thumbnail|none|800px|Where to click index.html]] | ||
* It includes test result details, especially build information, logs and screenshot of failed cases. | |||
** From log, we usually can determine if it is a common non-bug error. Otherwise, we need to rerun test script locally or rerun test manually. | |||
[[File:Failed Case Screenshot.jpeg|thumbnail|none|1800px|Failed Case Details]] | [[File:Failed Case Screenshot.jpeg|thumbnail|none|1800px|Failed Case Details]] | ||
* <big><big>'''How to Verify a Failed Case'''</big></big> | * <big><big>'''How to Verify a Failed Case'''</big></big> | ||
** If you see "error" or "failure" of a test case, try to search related information on Bugzilla or previous reports, it might be existed in other branch. | |||
** Common non-bug errors | ** Common non-bug errors | ||
*** Timeout | *** Timeout | ||
[[File:Common Error - Timeout.jpg|thumbnail|none|1800px|Unable to locate element]] | [[File:Common Error - Timeout.jpg|thumbnail|none|1800px|Unable to locate element]] | ||
* Unable to locate element | |||
[[File:Failed Case Screenshot.jpeg|thumbnail|none|1800px|Unable to locate element]] | [[File:Failed Case Screenshot.jpeg|thumbnail|none|1800px|Unable to locate element]] | ||
* ...? | |||
== How to write daily report == | == How to write daily report == | ||