canmove, Confirmed users
2,850
edits
ReleaseEngineering/How To/Unstick a Stuck Slave From A Master: Difference between revisions
ReleaseEngineering/How To/Unstick a Stuck Slave From A Master (view source)
Revision as of 19:41, 28 October 2011
, 28 October 2011→The Hard Way
No edit summary |
ChrisCooper (talk | contribs) |
||
| Line 5: | Line 5: | ||
= The Hard Way = | = The Hard Way = | ||
First, use lsof to figure out what file descriptor the socket it on: | First you'll need to find slaves that may be stuck. Check the list of slaves on the master you're trying to reconfig using the no_builders=1 pragma, e.g.: | ||
http://buildbot-master11.build.scl1.mozilla.com:8201/buildslaves?no_builders=1 | |||
If any slaves have a "Last heard from" time of more than a few hours, those are likely stuck. | |||
Then, on the master, use lsof to figure out what file descriptor the socket it on for that slave: | |||
$ /usr/sbin/lsof -p $master_pid | grep linux-ix-slave05 | $ /usr/sbin/lsof -p $master_pid | grep linux-ix-slave05 | ||
buildbot 2788 cltbld 16u IPv4 471638980 TCP staging-master.build.mozilla.org:9012->linux-ix-slave05.build.mozilla.org:54714 (ESTABLISHED) | buildbot 2788 cltbld 16u IPv4 471638980 TCP staging-master.build.mozilla.org:9012->linux-ix-slave05.build.mozilla.org:54714 (ESTABLISHED) | ||