[Buildbot-devel] Intermittent Connection.Lost error with Windows slaves

[Dmitry Mikhin]

Replying to myself with yet another update:

The version without PuTTY tunnel (direct slave to master connection,
LibVirtSlave slave) was dying every time. The total build takes about
3 hours, with some tests up to 30 minutes. It never completed once.

Bringing back PuTTY tunnel and setting sshd ClientAliveInterval to 60
on the master side: died (tested once). This time did not even restart
the VirtualSlave with another error (apparently unrelated to the
original Connection lost, error message attached below).

So, all my tinkering did have some effect, regrettably, exactly the
opposite to the one I hoped for.

Now will try manually-started virtual box.

Dmitry

2012-09-07 13:23:38+1000 [-] releaseLocks(<Build trunk, mingw32 on
Windows XP>): [(<MasterLock(performance, 1000)>,
<buildbot.locks.LockAccess instance at 0x24eb7e8>)]
2012-09-07 13:23:43+1000 [-] Unhandled Error
        Traceback (most recent call last):
          File "/usr/lib64/python2.7/threading.py", line 503, in __bootstrap
            self.__bootstrap_inner()
          File "/usr/lib64/python2.7/threading.py", line 530, in
__bootstrap_inner
            self.run()
          File "/usr/lib64/python2.7/threading.py", line 483, in run
            self.__target(*self.__args, **self.__kwargs)
        --- <exception caught here> ---
          File "/usr/lib/python2.7/site-packages/Twisted-11.1.0-py2.7-linux-x86_64.egg/twisted/python/threadpool.py",
line 207, in _worker
            result = context.call(ctx, function, *args, **kwargs)
          File "/usr/lib/python2.7/site-packages/Twisted-11.1.0-py2.7-linux-x86_64.egg/twisted/python/context.py",
line 118, in callWithContext
            return self.currentContext().callWithContext(ctx, func, *args, **kw)
          File "/usr/lib/python2.7/site-packages/Twisted-11.1.0-py2.7-linux-x86_64.egg/twisted/python/context.py",
line 81, in callWithContext
            return func(*args,**kw)
          File "/usr/lib/python2.7/site-packages/buildbot-0.8.5-py2.7.egg/buildbot/db/pool.py",
line 128, in thd
            rv = callable(conn, *args, **kwargs)
          File "/usr/lib/python2.7/site-packages/buildbot-0.8.5-py2.7.egg/buildbot/db/buildrequests.py",
line 169, in thd
            conn.execute(q)
          File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py",
line 1191, in execute
            params)
          File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py",
line 1271, in _execute_clauseelement
            return self.__execute_context(context)
          File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py",
line 1302, in __execute_context
            context.parameters[0], context=context)
          File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py",
line 1401, in _cursor_execute
            context)
          File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py",
line 1394, in _cursor_execute
            context)
          File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/default.py",
line 299, in do_execute
            cursor.execute(statement, parameters)
        sqlalchemy.exc.OperationalError: (OperationalError) database
is locked u'DELETE FROM buildrequest_claims WHERE
buildrequest_claims.brid IN (?) AND buildrequest_claims.objectid = ?'
(5547, 1)