[Buildbot-devel] added horizons to config, pruning causes exception

[Johnathan Hegge]

Long overdue but I finally wanted to add in horizons and clean old builds.   Added in the following:

c['changeHorizon'] = 300
c['buildHorizon'] = 200
c['eventHorizon'] = 50
c['logHorizon'] = 100

on restart of the master I got the following consistently:

 ow restarting buildbot process..
Following twistd.log until startup finished..
2013-10-01 11:43:32-0500 [-] Log opened.
2013-10-01 11:43:32-0500 [-] twistd 13.0.0 (/opt/PythonEnvs/bb086/bin/python 2.6.6) starting up.
2013-10-01 11:43:32-0500 [-] reactor class: twisted.internet.epollreactor.EPollReactor.
2013-10-01 11:43:32-0500 [-] Starting BuildMaster -- buildbot.version: 0.8.6p1
2013-10-01 11:43:32-0500 [-] Loading configuration from '/opt/BBproduction/master.cfg'
2013-10-01 11:43:32-0500 [-] unable to import dnotify, so Maildir will use polling instead
2013-10-01 11:43:32-0500 [-] Setting up database with URL 'sqlite:///state.sqlite'
2013-10-01 11:43:32-0500 [-] setting database journal mode to 'wal'
2013-10-01 11:43:32-0500 [-] Using SQLite Version (3, 6, 20)
2013-10-01 11:43:32-0500 [-] NOTE: this old version of SQLite does not support WAL journal mode; a busy master may encounter 'Database is locked' errors.  Consider upgrading.
2013-10-01 11:43:32-0500 [-] adding 1 new changesources, removing 0
2013-10-01 11:43:32-0500 [-] PBServerFactory starting on 9989
2013-10-01 11:43:32-0500 [-] Starting factory <twisted.spread.pb.PBServerFactory instance at 0x2eb93b0>
2013-10-01 11:43:32-0500 [-] adding 2 new slaves, removing 0
2013-10-01 11:43:32-0500 [-] adding 4 new builders, removing 0
2013-10-01 11:43:32-0500 [-] trying to load status pickle from /opt/BBproduction/android_ci/builder
2013-10-01 11:43:32-0500 [-] added builder Android client Continuous Integration in category android_ci
2013-10-01 11:43:32-0500 [-] trying to load status pickle from /opt/BBproduction/production-build/builder
2013-10-01 11:43:32-0500 [-] added builder Win 7 64-bit (VS2010) Production in category production
2013-10-01 11:43:32-0500 [-] trying to load status pickle from /opt/BBproduction/win_ci/builder
2013-10-01 11:43:32-0500 [-] added builder Windows client Continuous Integration in category win_ci
2013-10-01 11:43:32-0500 [-] trying to load status pickle from /opt/BBproduction/production-ios-build/builder
2013-10-01 11:43:32-0500 [-] added builder Mac iOS client Production in category production
2013-10-01 11:43:32-0500 [-] adding scheduler 'CI'
2013-10-01 11:43:32-0500 [-] while pruning changes
	Traceback (most recent call last):
	  File "/usr/lib64/python2.6/threading.py", line 504, in __bootstrap
	    self.__bootstrap_inner()
	  File "/usr/lib64/python2.6/threading.py", line 532, in __bootstrap_inner
	    self.run()
	  File "/usr/lib64/python2.6/threading.py", line 484, in run
	    self.__target(*self.__args, **self.__kwargs)
	--- <exception caught here> ---
	  File "/opt/PythonEnvs/bb086/lib/python2.6/site-packages/twisted/python/threadpool.py", line 172, in _worker
	    result = context.call(ctx, function, *args, **kwargs)
	  File "/opt/PythonEnvs/bb086/lib/python2.6/site-packages/twisted/python/context.py", line 118, in callWithContext
	    return self.currentContext().callWithContext(ctx, func, *args, **kw)
	  File "/opt/PythonEnvs/bb086/lib/python2.6/site-packages/twisted/python/context.py", line 81, in callWithContext
	    return func(*args,**kw)
	  File "/opt/PythonEnvs/bb086/lib/python2.6/site-packages/buildbot/db/pool.py", line 183, in __thd
	    rv = callable(arg, *args, **kwargs)
	  File "/opt/PythonEnvs/bb086/lib/python2.6/site-packages/buildbot/db/changes.py", line 200, in thd
	    table.delete(table.c.changeid.in_(ids_to_delete)))
	  File "/opt/PythonEnvs/bb086/lib/python2.6/site-packages/sqlalchemy/engine/base.py", line 1449, in execute
	    params)
	  File "/opt/PythonEnvs/bb086/lib/python2.6/site-packages/sqlalchemy/engine/base.py", line 1584, in _execute_clauseelement
	    compiled_sql, distilled_params
	  File "/opt/PythonEnvs/bb086/lib/python2.6/site-packages/sqlalchemy/engine/base.py", line 1698, in _execute_context
	    context)
	  File "/opt/PythonEnvs/bb086/lib/python2.6/site-packages/sqlalchemy/engine/base.py", line 1691, in _execute_context
	    context)
	  File "/opt/PythonEnvs/bb086/lib/python2.6/site-packages/sqlalchemy/engine/default.py", line 331, in do_execute
	    cursor.execute(statement, parameters)

Commenting out the horizons and restarting works fine so I've rolled back for now.   So many builds to prune that I've hit a ulimit?