[Buildbot-devel] slave getting stuck

[Neal Norwitz]

http://www.python.org/dev/buildbot/

svn is stuck on 3 machines out of 5 for the build starting at 18:54:30
on 19 Feb.

Build 167  	Build 170  	Build 161  	Build 173  	Build 121

I tried pinging and interrupting one machine (x86 gentoo trunk).  That
didn't do any good.  There are still 3 pending requests to be
serviced, but not going anywhere.

Here's the log from the slave machine I pinged/interrupted.  Master's
log is attached.  Any ideas what's the problem or how to fix?

Both master and slave are buildbot-0.7.1.

n
--
2006/02/19 13:48 EST [-] sending app-level keepalive
2006/02/19 13:55 EST [Broker,client] SlaveBuilder.remote_print(x86
gentoo trunk): message from master: ping
2006/02/19 13:55 EST [Broker,client]
SlaveBuilder.remote_ping(<SlaveBuilder 'x86 gentoo trunk'>)
2006/02/19 13:55 EST [Broker,client] <SlaveBuilder 'x86 gentoo
trunk'>.startBuild
2006/02/19 13:55 EST [Broker,client]  startCommand:svn [id 1158]
2006/02/19 13:55 EST [Broker,client] ShellCommand._startCommand
2006/02/19 13:55 EST [Broker,client]  svn update --revision 42501
2006/02/19 13:55 EST [Broker,client]   in dir
/home/buildslave/python-trunk/trunk.4/build (timeout 1200 secs)
2006/02/19 13:55 EST [Broker,client]   argv: ['svn', 'update',
'--revision', '42501']
2006/02/19 13:55 EST [Broker,client]   environment: {'LESS': '-R',
'LESSOPEN': '|lesspipe.sh %s', 'CVS_RSH': 'ssh', 'LOGNAME':
'buildslave', 'USER': 'buildslave', 'INPUTRC': '/etc/inputrc', 'PATH':
'/bin:/usr/bin:/usr/local/bin:/usr/local/bin:/opt/bin:/usr/i386-pc-linux-gnu/gcc-bin/3.3:/usr/X11R6/bin',
'HOME': '/home/buildslave', 'PS1': '\\[\\033[01;32m\\]\\u@\\h
\\[\\033[01;34m\\]\\W \\$ \\[\\033[00m\\]', 'MAKEFLAGS': '',
'GLIBC_SSP_CHECKED': '1', 'INFOPATH':
'/usr/share/info:/usr/share/gcc-data/i386-pc-linux-gnu/3.3/info',
'TERM': 'xterm', 'SHELL': '/bin/sh', 'SHLVL': '1',
'CONFIG_PROTECT_MASK': '/etc/terminfo', 'EDITOR': '/usr/bin/vi',
'MANPATH': '/usr/share/man:/usr/local/share/man:/usr/share/gcc-data/i386-pc-linux-gnu/3.3/man',
'MFLAGS': '', 'CVSROOT': '/data/psf/python', 'INFODIR':
'/usr/share/info', 'CC': 'gcc', 'XINITRC': '/etc/X11/xinit/xinitrc',
'_': '/usr/bin/make', 'CXX': 'g++', 'OLDPWD': '/home/buildslave',
'HOSTNAME': 'python', 'CONFIG_PROTECT': '/usr/X11R6/lib/X11/xkb
/usr/share/texmf/tex/generic/config/
/usr/share/texmf/tex/platex/config/ /usr/share/texmf/dvips/config/
/usr/share/texmf/dvipdfm/config/ /usr/share/texmf/xdvi/', 'MAKELEVEL':
'1', 'PWD': '/home/buildslave/python-trunk', 'MAIL':
'/home/buildslave/', 'PAGER': '/usr/bin/less'}
2006/02/19 13:55 EST [-] command finished with signal None, exit code 0
2006/02/19 13:55 EST [-] SlaveBuilder.commandComplete
<buildbot.slave.commands.SVN instance at 0x406bc90c>
2006/02/19 13:58 EST [-] sending app-level keepalive
2006/02/19 14:08 EST [-] sending app-level keepalive
2006/02/19 14:18 EST [-] sending app-level keepalive
2006/02/19 14:28 EST [-] sending app-level keepalive
2006/02/19 14:38 EST [-] sending app-level keepalive
2006/02/19 14:48 EST [-] sending app-level keepalive
2006/02/19 14:58 EST [-] sending app-level keepalive
2006/02/19 15:08 EST [-] sending app-level keepalive
2006/02/19 15:18 EST [-] sending app-level keepalive
2006/02/19 15:28 EST [-] sending app-level keepalive
2006/02/19 15:38 EST [-] sending app-level keepalive
2006/02/19 15:42 EST [Broker,client] SlaveBuilder.remote_print(x86
gentoo trunk): message from master: ping
2006/02/19 15:42 EST [Broker,client]
SlaveBuilder.remote_ping(<SlaveBuilder 'x86 gentoo trunk'>)
2006/02/19 15:45 EST [Broker,client] asked to interrupt current
command: The web-page 'stop build' button was pressed by 'nnorwitz':
svn hung

2006/02/19 15:45 EST [Broker,client]  .. but none was running
2006/02/19 15:46 EST [Broker,client] SlaveBuilder.remote_print(x86
gentoo trunk): message from master: ping
2006/02/19 15:46 EST [Broker,client]
SlaveBuilder.remote_ping(<SlaveBuilder 'x86 gentoo trunk'>)
2006/02/19 15:48 EST [-] sending app-level keepalive
-------------- next part --------------
A non-text attachment was scrubbed...
Name: twistd.log
Type: text/x-log
Size: 135413 bytes
Desc: not available
URL: <http://buildbot.net/pipermail/devel/attachments/20060219/d4c6f682/attachment.bin>