Changes

Jump to: navigation, search

User:Standard8/Thunderbird Automated Tests Planning

10,052 bytes removed, 18:46, 18 August 2009
Intermittent MozMill Failures
=== Intermittent MozMill Failures ===
I'm using this here just to get an initial idea of the sort Note: asuth killed most of these failures we. We're getting. ve only one or two left now, I'll update it once or twice a day with the status from the period before. At some stage this will move into bugzilla, but let's get an idea of what is happening first. Note: Only tracking 1.9.1 initially due to regressions on trunk. ==== 1.9.1 ==== From: 2009/07/28 09:41:01<br>To: 2009/08/06 00:15:12 Total Runs: 87<br>Total Green Runs: 67 ==== Trunk ==== From: 2009/07/29 20:46:01<br>To: 2009/08/06 00:15:12 Total Runs: 54<br>Total Green Runs: 34 ==== Failure Mode 2 ==== Seen: 7 times (both)<br>Result: 142/2<br>Short output:  TEST-UNEXPECTED-FAIL | test_summarization_goes_away TEST-UNEXPECTED-FAIL | (runtestlist.py) | Exited with code 1 during directory run make: *** [mozmill] Error 1 Unknown Error: command finished with exit code: 2 Log: http://tinderbox.mozilla.org/showlog.cgi?log=ThunderbirdTest/1248832277.1248833470.13976.gz ==== Failure Mode 3 ==== Seen: 10 times (both)<br>Result: 137/2<br>Short output:  TEST-UNEXPECTED-FAIL | test_selection_persists_through_folder_tab_changes TEST-UNEXPECTED-FAIL | (runtestlist.py) | Exited with code 1 during directory run make: *** [mozmill] Error 1 Unknown Error: command finished with exit code: 2 Log: http://tinderbox.mozilla.org/showlog.cgi?log=ThunderbirdTest/1248858591.1248859690.12695.gz Variant:TEST-UNEXPECTED-FAIL | test_selection_persists_through_folder_tab_changesTEST-UNEXPECTED-FAIL | test_summarization_goes_awayTEST-UNEXPECTED-FAIL | (runtestlist.py) | Exited with code 1 during directory runmake: *** [mozmill] Error 1Unknown Error: command finished with exit code: 2 http://tinderbox.mozilla.org/showlog.cgi?log=ThunderbirdTest/1248897144.1248898327.7485.gz ==== Failure Mode 5 ==== Seen: 5 times (both)<br>Result: 136/3<br>Short output:  TEST-UNEXPECTED-FAIL | test_open_multiple_search_results_in_new_tabs TEST-UNEXPECTED-FAIL | test_verify_saved_search TEST-UNEXPECTED-FAIL | (runtestlist.py) | Exited with code 1 during directory run make: *** [mozmill] Error 1 Unknown Error: command finished with exit code: 2 Log: http://tinderbox.mozilla.org/showlog.cgi?log=ThunderbirdTest/1248863757.1248864851.4038.gz ==== Failure Mode 6 ==== Seen: twice (both)<br>Result: 137/2<br>Short output:  TEST-UNEXPECTED-FAIL | test_middle_click_with_nothing_selected_background TEST-UNEXPECTED-FAIL | (runtestlist.py) | Exited with code 1 during directory run make: *** [mozmill] Error 1 Unknown Error: command finished with exit code: 2 Log: http://tinderbox.mozilla.org/showlog.cgi?log=ThunderbirdTest/1248973101.1248975523.32543.gz Variant:  TEST-UNEXPECTED-FAIL | test_middle_click_with_nothing_selected_background TEST-UNEXPECTED-FAIL | test_middle_click_with_nothing_selected_foreground TEST-UNEXPECTED-FAIL | test_middle_click_with_one_thing_selected_background TEST-UNEXPECTED-FAIL | test_middle_click_with_one_thing_selected_foreground TEST-UNEXPECTED-FAIL | test_middle_click_with_many_things_selected_background TEST-UNEXPECTED-FAIL | test_middle_click_with_many_things_selected_foreground TEST-UNEXPECTED-FAIL | test_middle_click_on_existing_single_selection_background TEST-UNEXPECTED-FAIL | test_middle_click_on_existing_single_selection_foreground TEST-UNEXPECTED-FAIL | (runtestlist.py) | Exited with code 1 during directory run make: *** [mozmill] Error 1 Unknown Error: command finished with exit code: 2  ==== Failure Mode 7 ==== Seen: twice (1.9.1)<br>Result: 129/10<br>Short output:  TEST-UNEXPECTED-FAIL | test_middle_click_with_nothing_selected_foreground TEST-UNEXPECTED-FAIL | test_middle_click_with_one_thing_selected_background TEST-UNEXPECTED-FAIL | test_middle_click_with_one_thing_selected_foreground TEST-UNEXPECTED-FAIL | test_middle_click_with_many_things_selected_background TEST-UNEXPECTED-FAIL | test_middle_click_with_many_things_selected_foreground TEST-UNEXPECTED-FAIL | test_middle_click_on_existing_single_selection_background TEST-UNEXPECTED-FAIL | test_middle_click_on_existing_single_selection_foreground TEST-UNEXPECTED-FAIL | test_middle_click_on_existing_multi_selection_background TEST-UNEXPECTED-FAIL | test_middle_click_on_existing_multi_selection_foreground TEST-UNEXPECTED-FAIL | (runtestlist.py) | Exited with code 1 during directory run make: *** [mozmill] Error 1 Unknown Error: command finished with exit code: 2 Log: http://tinderbox.mozilla.org/showlog.cgi?log=ThunderbirdTest/1248948288.1248949412.20456.gz Variant:  TEST-UNEXPECTED-FAIL | test_middle_click_with_nothing_selected_foreground TEST-UNEXPECTED-FAIL | (runtestlist.py) | Exited with code 1 during directory run make: *** [mozmill] Error 1 Unknown Error: command finished with exit code: 2  ==== Failure Mode 8 ==== Seen: once (1.9.1)<br>Result: 137/2<br>Short output:  TEST-UNEXPECTED-FAIL | test_summarization_thread_detection TEST-UNEXPECTED-FAIL | (runtestlist.py) | Exited with code 1 during directory run make: *** [mozmill] Error 1 Unknown Error: command finished with exit code: 2 Log: http://tinderbox.mozilla.org/showbuilds.cgi?tree=ThunderbirdTest&maxdate=1248988081&hours=24&legend=0&norules=1 ==== Failure Mode 9 ==== Seen: twice (both)<br>Result: 137/2<br>Short output:  TEST-UNEXPECTED-FAIL | test_middle_click_with_one_thing_selected_background TEST-UNEXPECTED-FAIL | (runtestlist.py) | Exited with code 1 during directory run make: *** [mozmill] Error 1 Unknown Error: command finished with exit code: 2 Log: http://tinderbox.mozilla.org/showlog.cgi?log=ThunderbirdTest/1249413274.1249414653.1071.gz Variant:  TEST-UNEXPECTED-FAIL | test_middle_click_with_one_thing_selected_background TEST-UNEXPECTED-FAIL | test_middle_click_with_one_thing_selected_foreground TEST-UNEXPECTED-FAIL | test_middle_click_with_many_things_selected_background TEST-UNEXPECTED-FAIL | test_middle_click_with_many_things_selected_foreground TEST-UNEXPECTED-FAIL | test_middle_click_on_existing_single_selection_background TEST-UNEXPECTED-FAIL | test_middle_click_on_existing_single_selection_foreground TEST-UNEXPECTED-FAIL | (runtestlist.py) | Exited with code 1 during directory run TEST-UNEXPECTED-FAIL | test_open_multiple_search_results_in_new_tabs TEST-UNEXPECTED-FAIL | test_verify_saved_search TEST-UNEXPECTED-FAIL | (runtestlist.py) | Exited with code 1 during directory run make: *** [mozmill] Error 1 Unknown Error: command finished with exit code: 2  ==== Failure Mode 10 ==== Seen: 3 times (both)<br>Result:<br>Short output:  TEST-UNEXPECTED-FAIL | test_delete_one_after_message_in_message_tab TEST-UNEXPECTED-FAIL | test_collapsed_message_pane_does_not_break_message_tab TEST-UNEXPECTED-FAIL | test_message_pane_is_sticky TEST-UNEXPECTED-FAIL | test_message_pane_persistence_generally_works TEST-UNEXPECTED-FAIL | test_open_message_in_existing_window TEST-UNEXPECTED-FAIL | test_middle_click_folder_with_nothing_selected_background TEST-UNEXPECTED-FAIL | test_right_click_with_one_thing_selected TEST-UNEXPECTED-FAIL | test_right_click_on_existing_single_selection TEST-UNEXPECTED-FAIL | test_right_click_deletion_one_other_thing_selected TEST-UNEXPECTED-FAIL | test_middle_click_with_one_thing_selected_background TEST-UNEXPECTED-FAIL | test_middle_click_with_one_thing_selected_foreground TEST-UNEXPECTED-FAIL | test_middle_click_on_existing_single_selection_background TEST-UNEXPECTED-FAIL | test_middle_click_on_existing_single_selection_foreground TEST-UNEXPECTED-FAIL | test_selection_extension TEST-UNEXPECTED-FAIL | test_selection_last_message_deleted TEST-UNEXPECTED-FAIL | test_selection_persists_through_threading_changes TEST-UNEXPECTED-FAIL | test_selection_persists_through_folder_tab_changes TEST-UNEXPECTED-FAIL | test_folder_tabs_update_correctly TEST-UNEXPECTED-FAIL | test_message_tabs_update_correctly TEST-UNEXPECTED-FAIL | test_new_thread_that_was_not_summarized_expands TEST-UNEXPECTED-FAIL | test_switch_to_tab_folder_b TEST-UNEXPECTED-FAIL | test_tabs_are_still_happy TEST-UNEXPECTED-FAIL | test_close_message_b TEST-UNEXPECTED-FAIL | test_close_folder_b TEST-UNEXPECTED-FAIL | (runtestlist.py) | Exited with code 1 during directory run make: *** [mozmill] Error 1 Unknown Error: command finished with exit code: 2 Log: http://tinderbox.mozilla.org/showlog.cgi?log=ThunderbirdTest/1249500069.1249501434.1515.gz ==== Failure Mode 11 ==== Seen: once (1.9.1)Result: 137/2Short output:  TEST-UNEXPECTED-FAIL | test_right_click_deletion_nothing_selected TEST-UNEXPECTED-FAIL | (runtestlist.py) | Exited with code 1 during directory run make: *** [mozmill] Error 1 Unknown Error: command finished with exit code: 2 Log: http://tinderbox.mozilla.org/showlog.cgi?log=ThunderbirdTest/1249541515.1249542881.29732.gz ==== Failure Mode 12 ==== Seen: 3 times (trunk)Result: 135/4Short output:  TEST-UNEXPECTED-FAIL | test_open_multiple_messages_in_tabs TEST-UNEXPECTED-FAIL | test_open_message_in_new_window TEST-UNEXPECTED-FAIL | test_open_message_in_existing_window TEST-UNEXPECTED-FAIL | (runtestlist.py) | Exited with code 1 during directory run make: *** [mozmill] Error 1 Unknown Error: command finished with exit code: 2 Log: http://tinderbox.mozilla.org/showlog.cgi?log=ThunderbirdTest/1249359958.1249360982.5912.gz ==== Failure Mode 13 ==== Seen: once (trunk)Result: 137/2Short output:  TEST-UNEXPECTED-FAIL | test_middle_click_on_existing_multi_selection_foreground TEST-UNEXPECTED-FAIL | (runtestlist.py) | Exited with code 1 during directory run make: *** [mozmill] Error 1 Unknown Error: command finished with exit code: 2 Log: http://tinderbox.mozilla.org/showlog.cgi?log=ThunderbirdTest/1249362917.1249363892.5422.gz ==== Failure Mode 14 ==== Seen: once (trunk)Result: 137/2Short output:  TEST-UNEXPECTED-FAIL | test_open_message_in_existing_window TEST-UNEXPECTED-FAIL | (runtestlist.py) | Exited with code 1 during directory run make: *** [mozmill] Error 1 Unknown Error: command finished with exit code: 2 Log: http://tinderbox.mozilla.org/showlog.cgi?log=ThunderbirdTest/1249514110.1249515879.31302next time we see them.gz
Canmove, confirm, emeritus
3,627
edits

Navigation menu