[Buildbot-devel] "commandFailed" error on Windows build slave

[Gerald Combs]

I recently upgraded from Buildbot 0.6.2 to 0.6.6.  Since then, our
Windows build slave has been timing out regularly.  Lots of errors are
logged on the slave, which are included below.  Sorry about the weird
wrapping.  It was cut+pasted from a Windows command shell.


2005/06/15 16:33 Central Daylight Time [-] Traceback (most recent call
last):
          File
"C:\Python24\Lib\site-packages\twisted\scripts\_twistw.py", line
44, in runApp
            app.runReactorWithLogging(config, oldstdout, oldstderr)
          File
"C:\Python24\Lib\site-packages\twisted\application\app.py", line
128, in runReactorWithLogging
            reactor.run()
          File
"C:\Python24\Lib\site-packages\twisted\internet\posixbase.py", li
ne 199, in run
            self.mainLoop()
          File
"C:\Python24\Lib\site-packages\twisted\internet\posixbase.py", li
ne 207, in mainLoop
            self.runUntilCurrent()
        --- <exception caught here> ---
          File "C:\Python24\Lib\site-packages\twisted\internet\base.py",
line 53
3, in runUntilCurrent
            call.func(*call.args, **call.kw)
          File
"c:\Python24\Lib\site-packages\buildbot\slave\commands.py", line
266, in doTimeout
            self.kill(msg)
          File
"c:\Python24\Lib\site-packages\buildbot\slave\commands.py", line
275, in kill
            self.commandFailed(CommandInterrupted("no process to
interrupt"))
        exceptions.AttributeError: ShellCommand instance has no
attribute 'comma
ndFailed'

2005/06/15 16:34 Central Daylight Time [-] Traceback (most recent call
last):
          File
"C:\Python24\Lib\site-packages\twisted\scripts\_twistw.py", line
44, in runApp
            app.runReactorWithLogging(config, oldstdout, oldstderr)
          File
"C:\Python24\Lib\site-packages\twisted\application\app.py", line
128, in runReactorWithLogging
            reactor.run()
          File
"C:\Python24\Lib\site-packages\twisted\internet\posixbase.py", li
ne 199, in run
            self.mainLoop()
          File
"C:\Python24\Lib\site-packages\twisted\internet\posixbase.py", li
ne 207, in mainLoop
            self.runUntilCurrent()
        --- <exception caught here> ---
          File "C:\Python24\Lib\site-packages\twisted\internet\base.py",
line 51
0, in runUntilCurrent
            f(*a, **kw)
          File
"c:\Python24\Lib\site-packages\buildbot\slave\commands.py", line
88, in outReceived
            self.command.addStdout(data)
        exceptions.AttributeError: 'NoneType' object has no attribute
'addStdout
'

2005/06/15 16:34 Central Daylight Time [-] Traceback (most recent call
last):
          File
"C:\Python24\Lib\site-packages\twisted\scripts\_twistw.py", line
44, in runApp
            app.runReactorWithLogging(config, oldstdout, oldstderr)
          File
"C:\Python24\Lib\site-packages\twisted\application\app.py", line
128, in runReactorWithLogging
            reactor.run()
          File
"C:\Python24\Lib\site-packages\twisted\internet\posixbase.py", li
ne 199, in run
            self.mainLoop()
          File
"C:\Python24\Lib\site-packages\twisted\internet\posixbase.py", li
ne 207, in mainLoop
            self.runUntilCurrent()
        --- <exception caught here> ---
          File "C:\Python24\Lib\site-packages\twisted\internet\base.py",
line 51
0, in runUntilCurrent
            f(*a, **kw)
          File
"c:\Python24\Lib\site-packages\buildbot\slave\commands.py", line
88, in outReceived
            self.command.addStdout(data)
        exceptions.AttributeError: 'NoneType' object has no attribute
'addStdout
'

2005/06/15 16:34 Central Daylight Time [-] Traceback (most recent call
last):
          File
"C:\Python24\Lib\site-packages\twisted\scripts\_twistw.py", line
44, in runApp
            app.runReactorWithLogging(config, oldstdout, oldstderr)
          File
"C:\Python24\Lib\site-packages\twisted\application\app.py", line
128, in runReactorWithLogging
            reactor.run()
          File
"C:\Python24\Lib\site-packages\twisted\internet\posixbase.py", li
ne 199, in run
            self.mainLoop()
          File
"C:\Python24\Lib\site-packages\twisted\internet\posixbase.py", li
ne 207, in mainLoop
            self.runUntilCurrent()
        --- <exception caught here> ---
          File "C:\Python24\Lib\site-packages\twisted\internet\base.py",
line 51
0, in runUntilCurrent
            f(*a, **kw)
          File
"c:\Python24\Lib\site-packages\buildbot\slave\commands.py", line
88, in outReceived
            self.command.addStdout(data)
        exceptions.AttributeError: 'NoneType' object has no attribute
'addStdout
'

2005/06/15 16:34 Central Daylight Time [-] Traceback (most recent call
last):
          File
"C:\Python24\Lib\site-packages\twisted\scripts\_twistw.py", line
44, in runApp
            app.runReactorWithLogging(config, oldstdout, oldstderr)
          File
"C:\Python24\Lib\site-packages\twisted\application\app.py", line
128, in runReactorWithLogging
            reactor.run()
          File
"C:\Python24\Lib\site-packages\twisted\internet\posixbase.py", li
ne 199, in run
            self.mainLoop()
          File
"C:\Python24\Lib\site-packages\twisted\internet\posixbase.py", li
ne 207, in mainLoop
            self.runUntilCurrent()
        --- <exception caught here> ---
          File "C:\Python24\Lib\site-packages\twisted\internet\base.py",
line 51
0, in runUntilCurrent
            f(*a, **kw)
          File
"c:\Python24\Lib\site-packages\buildbot\slave\commands.py", line
88, in outReceived
            self.command.addStdout(data)
        exceptions.AttributeError: 'NoneType' object has no attribute
'addStdout
'

2005/06/15 16:34 Central Daylight Time [-] Traceback (most recent call
last):
          File
"C:\Python24\Lib\site-packages\twisted\scripts\_twistw.py", line
44, in runApp
            app.runReactorWithLogging(config, oldstdout, oldstderr)
          File
"C:\Python24\Lib\site-packages\twisted\application\app.py", line
128, in runReactorWithLogging
            reactor.run()
          File
"C:\Python24\Lib\site-packages\twisted\internet\posixbase.py", li
ne 199, in run
            self.mainLoop()
          File
"C:\Python24\Lib\site-packages\twisted\internet\posixbase.py", li
ne 207, in mainLoop
            self.runUntilCurrent()
        --- <exception caught here> ---
          File "C:\Python24\Lib\site-packages\twisted\internet\base.py",
line 51
0, in runUntilCurrent
            f(*a, **kw)
          File
"c:\Python24\Lib\site-packages\buildbot\slave\commands.py", line
88, in outReceived
            self.command.addStdout(data)
        exceptions.AttributeError: 'NoneType' object has no attribute
'addStdout
'

2005/06/15 16:34 Central Daylight Time [-] Traceback (most recent call
last):
          File
"C:\Python24\Lib\site-packages\twisted\scripts\_twistw.py", line
44, in runApp
            app.runReactorWithLogging(config, oldstdout, oldstderr)
          File
"C:\Python24\Lib\site-packages\twisted\application\app.py", line
128, in runReactorWithLogging
            reactor.run()
          File
"C:\Python24\Lib\site-packages\twisted\internet\posixbase.py", li
ne 199, in run
            self.mainLoop()
          File
"C:\Python24\Lib\site-packages\twisted\internet\posixbase.py", li
ne 207, in mainLoop
            self.runUntilCurrent()
        --- <exception caught here> ---
          File "C:\Python24\Lib\site-packages\twisted\internet\base.py",
line 51
0, in runUntilCurrent
            f(*a, **kw)
          File
"c:\Python24\Lib\site-packages\buildbot\slave\commands.py", line
88, in outReceived
            self.command.addStdout(data)
        exceptions.AttributeError: 'NoneType' object has no attribute
'addStdout
'

2005/06/15 16:34 Central Daylight Time [-] Traceback (most recent call
last):
          File
"C:\Python24\Lib\site-packages\twisted\scripts\_twistw.py", line
44, in runApp
            app.runReactorWithLogging(config, oldstdout, oldstderr)
          File
"C:\Python24\Lib\site-packages\twisted\application\app.py", line
128, in runReactorWithLogging
            reactor.run()
          File
"C:\Python24\Lib\site-packages\twisted\internet\posixbase.py", li
ne 199, in run
            self.mainLoop()
          File
"C:\Python24\Lib\site-packages\twisted\internet\posixbase.py", li
ne 207, in mainLoop
            self.runUntilCurrent()
        --- <exception caught here> ---
          File "C:\Python24\Lib\site-packages\twisted\internet\base.py",
line 51
0, in runUntilCurrent
            f(*a, **kw)
          File
"c:\Python24\Lib\site-packages\buildbot\slave\commands.py", line
88, in outReceived
            self.command.addStdout(data)
        exceptions.AttributeError: 'NoneType' object has no attribute
'addStdout
'

2005/06/15 16:34 Central Daylight Time [-] Traceback (most recent call
last):
          File
"C:\Python24\Lib\site-packages\twisted\scripts\_twistw.py", line
44, in runApp
            app.runReactorWithLogging(config, oldstdout, oldstderr)
          File
"C:\Python24\Lib\site-packages\twisted\application\app.py", line
128, in runReactorWithLogging
            reactor.run()
          File
"C:\Python24\Lib\site-packages\twisted\internet\posixbase.py", li
ne 199, in run
            self.mainLoop()
          File
"C:\Python24\Lib\site-packages\twisted\internet\posixbase.py", li
ne 207, in mainLoop
            self.runUntilCurrent()
        --- <exception caught here> ---
          File "C:\Python24\Lib\site-packages\twisted\internet\base.py",
line 51
0, in runUntilCurrent
            f(*a, **kw)
          File
"c:\Python24\Lib\site-packages\buildbot\slave\commands.py", line
88, in outReceived
            self.command.addStdout(data)
        exceptions.AttributeError: 'NoneType' object has no attribute
'addStdout
'

2005/06/15 16:34 Central Daylight Time [-] Traceback (most recent call
last):
          File "C:\Python24\Lib\site-packages\twisted\python\log.py",
line 56, i
n callWithLogger
            return callWithContext({"system": lp}, func, *args, **kw)
          File "C:\Python24\Lib\site-packages\twisted\python\log.py",
line 41, i
n callWithContext
            return context.call({ILogContext: newCtx}, func, *args, **kw)
          File
"C:\Python24\Lib\site-packages\twisted\python\context.py", line 5
2, in callWithContext
            return self.currentContext().callWithContext(ctx, func,
*args, **kw)

          File
"C:\Python24\Lib\site-packages\twisted\python\context.py", line 3
1, in callWithContext
            return func(*args,**kw)
        --- <exception caught here> ---
          File
"C:\Python24\Lib\site-packages\twisted\internet\win32eventreactor
.py", line 190, in _runAction
            closed = getattr(fd, action)()
          File
"C:\Python24\Lib\site-packages\twisted\internet\win32eventreactor
.py", line 350, in inConnectionLost
            self.connectionLostNotify()
          File
"C:\Python24\Lib\site-packages\twisted\internet\win32eventreactor
.py", line 357, in connectionLostNotify
            self.connectionLost()
          File
"C:\Python24\Lib\site-packages\twisted\internet\win32eventreactor
.py", line 368, in connectionLost
            self.protocol.processEnded(failure.Failure(err))
          File
"c:\Python24\Lib\site-packages\buildbot\slave\commands.py", line
103, in processEnded
            self.command.finished(sig, rc)
        exceptions.AttributeError: 'NoneType' object has no attribute
'finished'


2005/06/15 16:34 Central Daylight Time [-] Traceback (most recent call
last):
          File
"C:\Python24\Lib\site-packages\twisted\application\app.py", line
128, in runReactorWithLogging
            reactor.run()
          File
"C:\Python24\Lib\site-packages\twisted\internet\posixbase.py", li
ne 199, in run
            self.mainLoop()
          File
"C:\Python24\Lib\site-packages\twisted\internet\posixbase.py", li
ne 210, in mainLoop
            self.doIteration(t)
          File
"C:\Python24\Lib\site-packages\twisted\internet\win32eventreactor
.py", line 168, in doWaitForMultipleEvents
            log.callWithLogger(fd, self._runAction, action, fd)
        --- <exception caught here> ---
          File "C:\Python24\Lib\site-packages\twisted\python\log.py",
line 56, i
n callWithLogger
            return callWithContext({"system": lp}, func, *args, **kw)
          File "C:\Python24\Lib\site-packages\twisted\python\log.py",
line 41, i
n callWithContext
            return context.call({ILogContext: newCtx}, func, *args, **kw)
          File
"C:\Python24\Lib\site-packages\twisted\python\context.py", line 5
2, in callWithContext
            return self.currentContext().callWithContext(ctx, func,
*args, **kw)

          File
"C:\Python24\Lib\site-packages\twisted\python\context.py", line 3
1, in callWithContext
            return func(*args,**kw)
          File
"C:\Python24\Lib\site-packages\twisted\internet\win32eventreactor
.py", line 196, in _runAction
            self._disconnectSelectable(fd, closed, action == 'doRead')
          File
"C:\Python24\Lib\site-packages\twisted\internet\posixbase.py", li
ne 237, in _disconnectSelectable
            selectable.connectionLost(failure.Failure(why))
          File
"C:\Python24\Lib\site-packages\twisted\internet\win32eventreactor
.py", line 362, in connectionLost
            self.reactor.removeEvent(self.hProcess)
          File
"C:\Python24\Lib\site-packages\twisted\internet\win32eventreactor
.py", line 102, in removeEvent
            del events[event]
        exceptions.KeyError: <PyHANDLE object at 0x011B32AC>

2005/06/15 16:43 Central Daylight Time [-] sending app-level keepalive
2005/06/15 16:53 Central Daylight Time [-] sending app-level keepalive
2005/06/15 17:03 Central Daylight Time [-] sending app-level keepalive
2005/06/15 17:13 Central Daylight Time [-] sending app-level keepalive