[Buildbot-devel] Scaling buildbot
mss at mawhrin.net
Tue Jun 16 15:00:31 UTC 2015
On Thu, Jun 11, 2015 at 02:53:21PM -0700, Dan Kegel wrote:
> On Thu, Jun 11, 2015 at 2:30 PM, Pierre Tardy <tardyp at gmail.com> wrote:
> >> > How much slaves do you have?
> >> Only ten or so
> > so this shouldn't be slow with mysql, and a decent cpu on the master.
> Hrm. So why is gitpoller killing my master?
> I have about 190 git repos, each with 1-3 branches and 1-4 OS's, so
> about 900 builders.
> When the problem happens, the load average is about 1.0, and I see
> about six zombie gits (they get
> harvested within two seconds, but we're doing so much polling that new
> gits come and go very quickly).
One important question: how do you access those repos? For example, I used to
access a number (on par with what you have) of git repos via SSH; using
ControlMaster option helped drastically.
More information about the devel