Buildbot/OutageReports/20080128-01
From MozillaWiki
< Buildbot | OutageReports
Outage Template
On January 28th at 17:30, talos and unittest buildbot slaves experienced a service outage for about 10 minutes.
What was affected:
The Firefox trunk Tinderbox page.
What was the cause of the outage:
Disk full
Has this type of outage happened before?
No
What was done to repair:
Cleanup log directories under buildbot masters.
E.g., in /build/master/trunk/ find . -ctime +7 -exec rm \{\} \;
What will be done to prevent this in the future:
Monitor disk activity more closely, install nagios or some other monitoring tool.
