User:Standard8/Thunderbird Automated Tests Planning: Difference between revisions

Jump to navigation Jump to search

User:Standard8/Thunderbird Automated Tests Planning (view source)

Revision as of 08:05, 6 August 2009

3,862 bytes added ,  6 August 2009
→‎Intermittent MozMill Failures
Line 58: Line 58:


From: 2009/07/28 09:41:01
From: 2009/07/28 09:41:01
<br>To: 2009/08/03 02:08:02
<br>To: 2009/08/06 00:15:12


Total Runs: 63
Total Runs: 87
<br>Total Green Runs: 49
<br>Total Green Runs: 67


==== Trunk ====
==== Trunk ====


From: 2009/07/29 20:46:01
From: 2009/07/29 20:46:01
<br>To: 2009/07/30 00:42:05
<br>To: 2009/08/06 00:15:12


Total Runs: 5
Total Runs: 54
<br>Total Green Runs: 5
<br>Total Green Runs: 34
 
(Note, bug 506615 "fixes" the trunk failures).


==== Failure Mode 2 ====
==== Failure Mode 2 ====


Seen: 2 times (1.9.1)
Seen: 7 times (both)
<br>Result: 142/2
<br>Result: 142/2
<br>Short output:
<br>Short output:
Line 88: Line 86:
==== Failure Mode 3 ====
==== Failure Mode 3 ====


Seen: 5 times (1.9.1)
Seen: 10 times (both)
<br>Result: 137/2
<br>Result: 137/2
<br>Short output:
<br>Short output:
Line 110: Line 108:
==== Failure Mode 5 ====
==== Failure Mode 5 ====


Seen: twice (1.9.1)
Seen: 5 times (both)
<br>Result: 136/3
<br>Result: 136/3
<br>Short output:
<br>Short output:
Line 124: Line 122:
==== Failure Mode 6 ====
==== Failure Mode 6 ====


Seen: once (1.9.1)
Seen: twice (both)
<br>Result: 137/2
<br>Result: 137/2
<br>Short output:
<br>Short output:
Line 134: Line 132:


Log: http://tinderbox.mozilla.org/showlog.cgi?log=ThunderbirdTest/1248973101.1248975523.32543.gz
Log: http://tinderbox.mozilla.org/showlog.cgi?log=ThunderbirdTest/1248973101.1248975523.32543.gz
Variant:
TEST-UNEXPECTED-FAIL |  test_middle_click_with_nothing_selected_background
TEST-UNEXPECTED-FAIL |  test_middle_click_with_nothing_selected_foreground
TEST-UNEXPECTED-FAIL |  test_middle_click_with_one_thing_selected_background
TEST-UNEXPECTED-FAIL |  test_middle_click_with_one_thing_selected_foreground
TEST-UNEXPECTED-FAIL |  test_middle_click_with_many_things_selected_background
TEST-UNEXPECTED-FAIL |  test_middle_click_with_many_things_selected_foreground
TEST-UNEXPECTED-FAIL |  test_middle_click_on_existing_single_selection_background
TEST-UNEXPECTED-FAIL |  test_middle_click_on_existing_single_selection_foreground
TEST-UNEXPECTED-FAIL | (runtestlist.py) | Exited with code 1 during directory run
make: *** [mozmill] Error 1
Unknown Error: command finished with exit code: 2


==== Failure Mode 7 ====
==== Failure Mode 7 ====


Seen: once (1.9.1)
Seen: twice (1.9.1)
<br>Result: 129/10
<br>Result: 129/10
<br>Short output:
<br>Short output:
Line 155: Line 168:


Log: http://tinderbox.mozilla.org/showlog.cgi?log=ThunderbirdTest/1248948288.1248949412.20456.gz
Log: http://tinderbox.mozilla.org/showlog.cgi?log=ThunderbirdTest/1248948288.1248949412.20456.gz
Variant:
TEST-UNEXPECTED-FAIL |  test_middle_click_with_nothing_selected_foreground
TEST-UNEXPECTED-FAIL | (runtestlist.py) | Exited with code 1 during directory run
make: *** [mozmill] Error 1
Unknown Error: command finished with exit code: 2


==== Failure Mode 8 ====
==== Failure Mode 8 ====
Line 169: Line 190:
Log: http://tinderbox.mozilla.org/showbuilds.cgi?tree=ThunderbirdTest&maxdate=1248988081&hours=24&legend=0&norules=1
Log: http://tinderbox.mozilla.org/showbuilds.cgi?tree=ThunderbirdTest&maxdate=1248988081&hours=24&legend=0&norules=1


<!-- Old failures not seen any more -->
==== Failure Mode 9 ====
<!--
===== Failure Mode 1 =====


Seen: once
Seen: twice (both)
<br>Result: 137/8
<br>Result: 137/2
<br>Possible Fix: http://hg.mozilla.org/comm-central/rev/ff945c5683e9
<br>Short output:
<br>Short output:


TEST-UNEXPECTED-FAIL |  test_middle_click_with_one_thing_selected_background
TEST-UNEXPECTED-FAIL | (runtestlist.py) | Exited with code 1 during directory run
make: *** [mozmill] Error 1
Unknown Error: command finished with exit code: 2
Log: http://tinderbox.mozilla.org/showlog.cgi?log=ThunderbirdTest/1249413274.1249414653.1071.gz
Variant:
TEST-UNEXPECTED-FAIL |  test_middle_click_with_one_thing_selected_background
TEST-UNEXPECTED-FAIL |  test_middle_click_with_one_thing_selected_foreground
TEST-UNEXPECTED-FAIL |  test_middle_click_with_many_things_selected_background
  TEST-UNEXPECTED-FAIL |  test_middle_click_with_many_things_selected_foreground
  TEST-UNEXPECTED-FAIL |  test_middle_click_with_many_things_selected_foreground
  TEST-UNEXPECTED-FAIL |  test_middle_click_on_existing_single_selection_background
  TEST-UNEXPECTED-FAIL |  test_middle_click_on_existing_single_selection_background
  TEST-UNEXPECTED-FAIL |  test_middle_click_on_existing_single_selection_foreground
  TEST-UNEXPECTED-FAIL |  test_middle_click_on_existing_single_selection_foreground
TEST-UNEXPECTED-FAIL |  test_middle_click_on_existing_multi_selection_foreground
  TEST-UNEXPECTED-FAIL | (runtestlist.py) | Exited with code 1 during directory run
  TEST-UNEXPECTED-FAIL | (runtestlist.py) | Exited with code 1 during directory run
  TEST-UNEXPECTED-FAIL |  test_open_multiple_search_results_in_new_tabs
  TEST-UNEXPECTED-FAIL |  test_open_multiple_search_results_in_new_tabs
Line 189: Line 218:
  Unknown Error: command finished with exit code: 2
  Unknown Error: command finished with exit code: 2


Log: http://tinderbox.mozilla.org/showlog.cgi?log=ThunderbirdTest/1248799261.1248800444.11281.gz


===== Failure Mode 4 =====
==== Failure Mode 10 ====


Seen: once
Seen: 3 times (both)
<br>Result: 129/10
<br>Result:
<br>Possible Fix: http://hg.mozilla.org/comm-central/rev/ff945c5683e9
<br>Short output:
<br>Short output:


  TEST-UNEXPECTED-FAIL |  test_middle_click_with_nothing_selected_foreground
  TEST-UNEXPECTED-FAIL |  test_delete_one_after_message_in_message_tab
TEST-UNEXPECTED-FAIL |  test_collapsed_message_pane_does_not_break_message_tab
TEST-UNEXPECTED-FAIL |  test_message_pane_is_sticky
TEST-UNEXPECTED-FAIL |  test_message_pane_persistence_generally_works
TEST-UNEXPECTED-FAIL |  test_open_message_in_existing_window
TEST-UNEXPECTED-FAIL |  test_middle_click_folder_with_nothing_selected_background
TEST-UNEXPECTED-FAIL |  test_right_click_with_one_thing_selected
TEST-UNEXPECTED-FAIL |  test_right_click_on_existing_single_selection
TEST-UNEXPECTED-FAIL |  test_right_click_deletion_one_other_thing_selected
  TEST-UNEXPECTED-FAIL |  test_middle_click_with_one_thing_selected_background
  TEST-UNEXPECTED-FAIL |  test_middle_click_with_one_thing_selected_background
  TEST-UNEXPECTED-FAIL |  test_middle_click_with_one_thing_selected_foreground
  TEST-UNEXPECTED-FAIL |  test_middle_click_with_one_thing_selected_foreground
TEST-UNEXPECTED-FAIL |  test_middle_click_with_many_things_selected_background
TEST-UNEXPECTED-FAIL |  test_middle_click_with_many_things_selected_foreground
  TEST-UNEXPECTED-FAIL |  test_middle_click_on_existing_single_selection_background
  TEST-UNEXPECTED-FAIL |  test_middle_click_on_existing_single_selection_background
  TEST-UNEXPECTED-FAIL |  test_middle_click_on_existing_single_selection_foreground
  TEST-UNEXPECTED-FAIL |  test_middle_click_on_existing_single_selection_foreground
  TEST-UNEXPECTED-FAIL |  test_middle_click_on_existing_multi_selection_background
  TEST-UNEXPECTED-FAIL |  test_selection_extension
TEST-UNEXPECTED-FAIL |  test_selection_last_message_deleted
TEST-UNEXPECTED-FAIL |  test_selection_persists_through_threading_changes
TEST-UNEXPECTED-FAIL |  test_selection_persists_through_folder_tab_changes
TEST-UNEXPECTED-FAIL |  test_folder_tabs_update_correctly
TEST-UNEXPECTED-FAIL |  test_message_tabs_update_correctly
TEST-UNEXPECTED-FAIL |  test_new_thread_that_was_not_summarized_expands
TEST-UNEXPECTED-FAIL |  test_switch_to_tab_folder_b
TEST-UNEXPECTED-FAIL |  test_tabs_are_still_happy
TEST-UNEXPECTED-FAIL |  test_close_message_b
TEST-UNEXPECTED-FAIL |  test_close_folder_b
TEST-UNEXPECTED-FAIL | (runtestlist.py) | Exited with code 1 during directory run
make: *** [mozmill] Error 1
Unknown Error: command finished with exit code: 2
 
Log: http://tinderbox.mozilla.org/showlog.cgi?log=ThunderbirdTest/1249500069.1249501434.1515.gz
 
==== Failure Mode 11 ====
 
Seen: once (1.9.1)
Result: 137/2
Short output:
 
TEST-UNEXPECTED-FAIL |  test_right_click_deletion_nothing_selected
TEST-UNEXPECTED-FAIL | (runtestlist.py) | Exited with code 1 during directory run
make: *** [mozmill] Error 1
Unknown Error: command finished with exit code: 2
 
Log: http://tinderbox.mozilla.org/showlog.cgi?log=ThunderbirdTest/1249541515.1249542881.29732.gz
 
==== Failure Mode 12 ====
 
Seen: 3 times (trunk)
Result: 135/4
Short output:
 
TEST-UNEXPECTED-FAIL |  test_open_multiple_messages_in_tabs
TEST-UNEXPECTED-FAIL |  test_open_message_in_new_window
TEST-UNEXPECTED-FAIL |  test_open_message_in_existing_window
TEST-UNEXPECTED-FAIL | (runtestlist.py) | Exited with code 1 during directory run
make: *** [mozmill] Error 1
Unknown Error: command finished with exit code: 2
 
Log: http://tinderbox.mozilla.org/showlog.cgi?log=ThunderbirdTest/1249359958.1249360982.5912.gz
 
==== Failure Mode 13 ====
 
Seen: once (trunk)
Result: 137/2
Short output:
 
  TEST-UNEXPECTED-FAIL |  test_middle_click_on_existing_multi_selection_foreground
  TEST-UNEXPECTED-FAIL |  test_middle_click_on_existing_multi_selection_foreground
  TEST-UNEXPECTED-FAIL | (runtestlist.py) | Exited with code 1 during directory run
  TEST-UNEXPECTED-FAIL | (runtestlist.py) | Exited with code 1 during directory run
Line 211: Line 294:
  Unknown Error: command finished with exit code: 2
  Unknown Error: command finished with exit code: 2


Log: http://tinderbox.mozilla.org/showlog.cgi?log=ThunderbirdTest/1248860685.1248861787.2794.gz
Log: http://tinderbox.mozilla.org/showlog.cgi?log=ThunderbirdTest/1249362917.1249363892.5422.gz
-->
 
==== Failure Mode 14 ====
 
Seen: once (trunk)
Result: 137/2
Short output:
 
TEST-UNEXPECTED-FAIL |  test_open_message_in_existing_window
TEST-UNEXPECTED-FAIL | (runtestlist.py) | Exited with code 1 during directory run
make: *** [mozmill] Error 1
Unknown Error: command finished with exit code: 2
 
Log: http://tinderbox.mozilla.org/showlog.cgi?log=ThunderbirdTest/1249514110.1249515879.31302.gz
Standard8
canmove, Confirmed users, Bureaucrats and Sysops emeriti
3,628

edits

Retrieved from "https://wiki.mozilla.org/Special:MobileDiff/160305"

Navigation menu