[Buildbot-devel] Scaling buildbot

[Mikhail Sobolev]

On Thu, Jun 11, 2015 at 02:53:21PM -0700, Dan Kegel wrote:
> On Thu, Jun 11, 2015 at 2:30 PM, Pierre Tardy <tardyp at gmail.com> wrote:
> >> > How much slaves do you have?
> >>
> >> Only ten or so
> >
> > so this shouldn't be slow with mysql, and a decent cpu on the master.
> 
> Hrm.  So why is gitpoller killing my master?
> I have about 190 git repos, each with 1-3 branches and 1-4 OS's, so
> about 900 builders.
> When the problem happens, the load average is about 1.0, and I see
> about six zombie gits (they get
> harvested within two seconds, but we're doing so much polling that new
> gits come and go very quickly).
One important question: how do you access those repos?  For example, I used to
access a number (on par with what you have) of git repos via SSH; using
ControlMaster option helped drastically.

-- 
Misha