[users at bb.net] DockerLatentWorker throwing error in ShellCommand

[Povilas Kanapickas]

Hi,

I have no ideas why this could happen right now.

Could you submit the issue to GitHub so that it doesn't get lost?

Thank you a lot!
Povilas

On 10/13/20 9:54 PM, 斟酌鵬兄 wrote:
> Hi all,
> 
> I'm trying to setup a windows worker with DockerLatentWorker ( Which
> is running windows container ). After the container has been started
> and successfully connected it fails on git --version. After some
> digging, I've discovered that not only git, it just failed on any
> command.
> 
> I've tested the docker client by going into the master's python shell.
> I can run commands within the containers without a problem ( using
> client.exec_run ).
> 
> Any ideas?
> 
> Error Log:
> 2020-10-13 18:29:49+0000 [-] starting build <Build myproject-win
> number:1 results:success>.. pinging the worker <LatentWorkerForBuilder
> builder='myproject-win' worker='nano2004-netcore-3_1' state
> =BUILDING>
> 2020-10-13 18:29:49+0000 [-] sending ping
> 2020-10-13 18:29:49+0000 [Broker,0,10.0.7.1] ping finished: success
> 2020-10-13 18:29:50+0000 [-]
> ShellCommand.startCommand(cmd=<RemoteShellCommand '['pwsh', '/?']'>)
> 2020-10-13 18:29:50+0000 [-]   cmd.args = {'workdir': 'build', 'env':
> None, 'want_stdout': 1, 'want_stderr': 1, 'logfiles': {}, 'timeout':
> 1200, 'maxTime': None, 'sigtermTime': None, 'usePTY'
> : None, 'logEnviron': True, 'initial_stdin': None}
> 2020-10-13 18:29:50+0000 [-] <RemoteShellCommand '['pwsh', '/?']'>:
> RemoteCommand.run [0]
> 2020-10-13 18:29:50+0000 [-] command '['pwsh', '/?']' in dir 'build'
> 2020-10-13 18:29:51+0000 [-] BuildStep.failed; traceback follows
>         Traceback (most recent call last):
>           File "/usr/lib/python3.8/site-packages/twisted/internet/defer.py",
> line 501, in errback
>             self._startRunCallbacks(fail)
>           File "/usr/lib/python3.8/site-packages/twisted/internet/defer.py",
> line 568, in _startRunCallbacks
>             self._runCallbacks()
>           File "/usr/lib/python3.8/site-packages/twisted/internet/defer.py",
> line 654, in _runCallbacks
>             current.result = callback(current.result, *args, **kw)
>           File "/usr/lib/python3.8/site-packages/twisted/internet/defer.py",
> line 1475, in gotResult
>             _inlineCallbacks(r, g, status)
>         --- <exception caught here> ---
>           File "/usr/lib/python3.8/site-packages/buildbot/process/buildstep.py",
> line 573, in startStep
>             self.results = yield self.run()
>           File "/usr/lib/python3.8/site-packages/buildbot/process/buildstep.py",
> line 732, in run
>             results = yield self._start_deferred
>           File "/usr/lib/python3.8/site-packages/buildbot/process/buildstep.py",
> line 925, in runCommand
>             res = yield command.run(self, self.remote, self.build.builder.name)
>           File "/usr/lib/python3.8/site-packages/buildbot/process/remotecommand.py",
> line 146, in _finished
>             yield self.remoteComplete(failure)
>           File "/usr/lib/python3.8/site-packages/twisted/internet/defer.py",
> line 1418, in _inlineCallbacks
>             result = g.send(result)
>           File "/usr/lib/python3.8/site-packages/buildbot/process/buildstep.py",
> line 732, in run
>             results = yield self._start_deferred
>           File "/usr/lib/python3.8/site-packages/twisted/internet/defer.py",
> line 1416, in _inlineCallbacks
>             result = result.throwExceptionIntoGenerator(g)
>           File "/usr/lib/python3.8/site-packages/twisted/python/failure.py",
> line 512, in throwExceptionIntoGenerator
>             return g.throw(self.type, self.value, self.tb)
>           File "/usr/lib/python3.8/site-packages/buildbot/process/buildstep.py",
> line 925, in runCommand
>             res = yield command.run(self, self.remote, self.build.builder.name)
>           File "/usr/lib/python3.8/site-packages/buildbot/process/remotecommand.py",
> line 146, in _finished
>             yield self.remoteComplete(failure)
>         buildbot.process.remotecommand.RemoteException:
> b'buildbot_worker.exceptions.AbandonChain': -1
>         Traceback (most recent call last):
>         Failure: buildbot_worker.exceptions.AbandonChain: -1
> 2020-10-13 18:29:52+0000 [-]
> releaseLocks(ShellCommand(command=['pwsh', '/?'])): []
> 2020-10-13 18:29:52+0000 [-]  step 'shell' complete: exception
> (["'pwsh /?' (exception)"])
> 2020-10-13 18:29:52+0000 [-]  <Build myproject-win number:1
> results:exception>: build finished
> 2020-10-13 18:29:52+0000 [-] nano2004-netcore-3_1 has been put in
> quarantine for 10s
> 2020-10-13 18:29:52+0000 [-] releaseLocks(<DockerLatentWorker
> 'nano2004-netcore-3_1'>): []
> 2020-10-13 18:29:52+0000 [-] disconnecting old worker nano2004-netcore-3_1 now
> 2020-10-13 18:29:52+0000 [-] waiting for worker to finish disconnecting
> 2020-10-13 18:29:52+0000 [-] insubstantiating worker
> <DockerLatentWorker 'nano2004-netcore-3_1'>
> 2020-10-13 18:29:52+0000 [Broker,0,10.0.7.1]
> Worker.detached(nano2004-netcore-3_1)
> 2020-10-13 18:29:52+0000 [Broker,0,10.0.7.1]
> releaseLocks(<DockerLatentWorker 'nano2004-netcore-3_1'>): []
> 2020-10-13 18:29:52+0000 [-] Stopping container aa10bb...
>