ReleaseEngineering:Sheriffing:Notes:2009-03-23

Sunday 22nd (Monday NZ time)

• linux mozilla-central nightly bombed out in embedding/browser/gtk/src/gtkmozembed2.cpp - this has been around for a while so filed bug 484708, triggered a new nightly
• windows m-1.9.1 nightly bombed out because rmDirRecursive is not cutting it (bug 475276), fixed up moz2-win32-slave06 and triggered another nightly. Backed out purge_builds.py change

Monday 23rd

• moz2-linux64-slave01 became unresponsive with nagios sending alerts. Could not get a ssh prompt but was able to restart with VNC via VI console. Slow to reboot, slow to clobber (15 minutes vs 6 earlier in the day).

Wednesday 24th

• more storage issues started in IT's maintenance window. Apparently a disk died in the eql array, lots of IT bustage and a couple of our ESX hosts had issues. bug 485123