[Buildbot-devel] MemoryError on build

[Dustin J. Mitchell]

That particular buildslave is also seeing things like:

2010-02-20 05:20:07-0500 [-] Unhandled Error
	Traceback (most recent call last):
	  File "/home/buildbot_slave_py24/slave-centos_5_python2_4/sandbox/lib/python2.4/site-packages/Twisted-9.0.0-py2.4-linux-i686.egg/twisted/internet/base.py",
line 397, in fireEvent
	    DeferredList(beforeResults).addCallback(self._continueFiring)
	  File "/home/buildbot_slave_py24/slave-centos_5_python2_4/sandbox/lib/python2.4/site-packages/Twisted-9.0.0-py2.4-linux-i686.egg/twisted/internet/defer.py",
line 190, in addCallback
	    callbackKeywords=kw)
	  File "/home/buildbot_slave_py24/slave-centos_5_python2_4/sandbox/lib/python2.4/site-packages/Twisted-9.0.0-py2.4-linux-i686.egg/twisted/internet/defer.py",
line 181, in addCallbacks
	    self._runCallbacks()
	  File "/home/buildbot_slave_py24/slave-centos_5_python2_4/sandbox/lib/python2.4/site-packages/Twisted-9.0.0-py2.4-linux-i686.egg/twisted/internet/defer.py",
line 323, in _runCallbacks
	    self.result = callback(self.result, *args, **kw)
	--- <exception caught here> --
-
	  File "/home/buildbot_slave_py24/slave-centos_5_python2_4/sandbox/lib/python2.4/site-packages/Twisted-9.0.0-py2.4-linux-i686.egg/twisted/internet/base.py",
line 410, in _continueFiring
	    callable(*args, **kwargs)
	  File "/home/buildbot_slave_py24/slave-centos_5_python2_4/sandbox/lib/python2.4/site-packages/Twisted-9.0.0-py2.4-linux-i686.egg/twisted/enterprise/adbapi.py",
line 221, in _start
	    return self.start()
	  File "/home/buildbot_slave_py24/slave-centos_5_python2_4/sandbox/lib/python2.4/site-packages/Twisted-9.0.0-py2.4-linux-i686.egg/twisted/enterprise/adbapi.py",
line 232, in start
	    self.threadpool.start()
	  File "/home/buildbot_slave_py24/slave-centos_5_python2_4/sandbox/lib/python2.4/site-packages/Twisted-9.0.0-py2.4-linux-i686.egg/twisted/python/threadpool.py",
line 76, in start
	    self.adjustPoolsize()
	  File "/home/buildbot_slave_py24/slave-centos_5_python2_4/sandbox/lib/python2.4/site-packages/Twisted-9.0.0-py2.4-linux-i686.egg/twisted/python/threadpool.py",
line 272, in adjustPoolsize
	    self.startAWorker()
	  File "/home/buildbot_slave_py24/slave-centos_5_python2_4/sandbox/lib/python2.4/site-packages/Twisted-9.0.0-py2.4-linux-i686.egg/twisted/python/threadpool.py",
line 83, in startAWorker
	    newThread.start()
	  File "/usr/lib/python2.4/threading.py", line 416, in start
	    _start_new_thread(self.__bootstrap, ())
	thread.error: can't start new thread

Sure enough, we have a (very bad) thread leak!  Buildot's test
isolation leaves a lot to be desired.  It looks like every test that
touches the DB leaks at least three threads, if not more.

I'll see what I can do.

Dustin

-- 
Open Source Storage Engineer
http://www.zmanda.com