Buildbot/OutageReports/20071111-01

On 2007-11-11 at 0704, qm-winxp01 and qm-win2k3 experienced a service outage for >1d.

What was affected:

windows unittest machines, firefox tinderbox tree closed

What was the cause of the outage:

Build/Firefox crash caused some files to be held onto preventing a build and causing test failures after a normal clobber was completed. The source tree was corrupted.

Has this type of outage happened before?

Yes bug 393852

What was done to repair:

Buildbot taken offline, full contents of the slave's builder directory removed, buildbot restarted.

What will be done to prevent this in the future:

Another plea to have buildbot on windows remove processes properly.