Confirmed users
1,989
edits
CIDuty/How To/High Pending Counts: Difference between revisions
CIDuty/How To/High Pending Counts (view source)
Revision as of 15:08, 1 December 2015
, 1 December 2015→Is there an an unusual amount of buildbot lag?
| Line 153: | Line 153: | ||
In this case, we needed to hard restart the master because the buildbot process was hung. SIGTERM didn't work so had to kill -9 the buildbot process. It would also be a good idea to disable this master in slavealloc as soon as the problem appeared so jobs could be allocated to other masters. | In this case, we needed to hard restart the master because the buildbot process was hung. SIGTERM didn't work so had to kill -9 the buildbot process. It would also be a good idea to disable this master in slavealloc as soon as the problem appeared so jobs could be allocated to other masters. | ||
== Is there an an unusual amount of buildbot lag? == | === Is there an an unusual amount of buildbot lag? === | ||
Look at the graph for buildbot lag {{bug|1220191}} | Look at the graph for buildbot lag {{bug|1220191}} | ||
=== Was the increase in pending jobs sudden and after a reconfig? === | |||
This may have been due to bogus scheduling jobs added. See {{bug|1223042}} as an example of how to fix this issue. | |||
== What code/systems have changed? == | == What code/systems have changed? == | ||