[Buildbot-devel] Scaling buildbot

[Dan Kegel]

On Thu, Jun 11, 2015 at 2:30 PM, Pierre Tardy <tardyp at gmail.com> wrote:
>> > How much slaves do you have?
>>
>> Only ten or so
>
> so this shouldn't be slow with mysql, and a decent cpu on the master.

Hrm.  So why is gitpoller killing my master?
I have about 190 git repos, each with 1-3 branches and 1-4 OS's, so
about 900 builders.
When the problem happens, the load average is about 1.0, and I see
about six zombie gits (they get
harvested within two seconds, but we're doing so much polling that new
gits come and go very quickly).

My impression from this is that gitpoller should not be used for more
than about 50
repos, and above that, git hooks of some sort should be used to push
notifications to the master.  Does that agree with your experience?
- Dan