[Buildbot-devel] Buildbot performance with 25+ slaves

[Dustin J. Mitchell]

I'm with Benoît -- you're not anywhere close to Buildbot's capacity.

Option 1, corrupt DB, is certainly possible -- and deleting or moving
aside state.sqlite is a reasonable way to find out (although note that
moving it aside then moving it back will likely be problematic).

There are scattered reports (http://trac.buildbot.net/ticket/1992 and
http://trac.buildbot.net/ticket/2055) of livelock problems.  One was
due to a bug in Python tickled by OpenBSD's pthreads implementation,
while the other appears to be due to the way 'buildbot start' works.
Consider starting buildbot with 'twistd -noy buildbot.tac' instead,
and see if that helps.

If nothing else, try stracing the process and send me a sufficient but
not overwhelming quantity of output..

Dustin