Confirmed users
82
edits
Firefox OS/DeviceQA/Gaia-UI-Tests-On-Jenkins: Difference between revisions
Jump to navigation
Jump to search
Firefox OS/DeviceQA/Gaia-UI-Tests-On-Jenkins (view source)
Revision as of 06:56, 29 January 2015
, 29 January 2015→How to write daily report
No edit summary |
|||
| Line 41: | Line 41: | ||
== How to write daily report == | == How to write daily report == | ||
* | * Summary | ||
* | '''Summary:''' | ||
* build | '''Smoketests:''' | ||
45 tests ran in 3697 seconds. | |||
43 passed, 132 skipped, 0 failed, 2 errors. | |||
0 expected failures, 0 unexpected passes. | |||
'''Non-smoketests:''' | |||
135 tests ran in 9441 seconds. | |||
132 passed, 55 skipped, 1 failed, 2 errors. | |||
0 expected failures, 0 unexpected passes. | |||
* Failed cases & failed reason | |||
** List all failures and Expected failures cases for both Smoketest and Non-smoketest. Please also write down the result of failure survey. | |||
<big>'''Smoketests:''' </big> | |||
Test failures - 0 replicable manually: | |||
[Not reproduced] test_sms_with_attachments.py - Cannot reproduce locally. | |||
[Not reproduced] test_settings_wifi.py - Cannot reproduce locally. | |||
Expected failures / disabled tests: | |||
[Disabled] test_setup_and_send_active_sync_email.py - Bug 1028192 - Problems with ActiveSync accounts | |||
[Disabled] test_receive_active_sync_email.py - Bug 1028192 - Problems with ActiveSync accounts | |||
[Disabled] test_cost_control_data_alert_mobile.py - Bug 1061698 - Need ability to work in the shadow root/shadow DOM | |||
[Disabled] test_call_log_all_calls.py - Bug 1096385 - Investigate failure in test_call_log_all_calls.py, call log is displayed erroneously | |||
<big>'''Non-smoketests:'''</big> | |||
Test failures - 0 replicable manually: | |||
[Not reproduced] test_import_gmail_no_network.py - Cannot reproduce locally. | |||
[Not reproduced manually] test_call_log_groups.py - Bug 1117804 - [v2.2] Investigate test_call_log_groups failure | |||
[Not reproduced manually] test_dialer_set_up_conference_call.py -Bug 1117813 - Make PlivoUtil use a valid 'answer_url' with a valid Plivo XML | |||
Expected failures / disabled tests: | |||
[Disabled] test_ftu_skip_tour_desktopb2g.py - Test runs only on desktop | |||
[Disabled] test_settings_sim_manager.py - Test requires device with 2 sims | |||
[Disabled] test_fmradio_find_stations.py - Bug 1000863 - Investigate test_fmradio_find_stations.py failure | |||
* Build info | |||
'''<big>Build under test:</big>''' | |||
Device firmware (base) L1TC000118D0 | |||
Device firmware (date) 28 Jan 2015 16:59:20 | |||
Device firmware (incremental) eng.cltbld.20150128.035910 | |||
Device firmware (release) 4.4.2 | |||
Device identifier flame | |||
Gaia date 28 Jan 2015 08:05:23 | |||
Gaia revision cd42b034fd28 | |||
Gecko build 20150128002506 | |||
Gecko revision d824c65a6a2b | |||
Gecko version 37.0a2 | |||
== Others == | == Others == | ||
* If 2 error records for one test case (It seems race condition with the logging, [https://bugzilla.mozilla.org/show_bug.cgi?id=1050170 Bug 1050170] tracks this issue), please do not double counting the same fail case. | * If 2 error records for one test case (It seems race condition with the logging, [https://bugzilla.mozilla.org/show_bug.cgi?id=1050170 Bug 1050170] tracks this issue), please do not double counting the same fail case. | ||
[[File:Double_counting_error.png|thumbnail|none|1000px|Double counting error]] | [[File:Double_counting_error.png|thumbnail|none|1000px|Double counting error]] | ||