[Buildbot-devel] How many project per master?

Marc-Antoine Ruel maruel at chromium.org
Tue May 14 22:22:32 UTC 2013


As a random example, the chromium try server, visible at
http://build.chromium.org/p/tryserver.chromium/waterfall, has around 700
slaves connected and it's baring the load with pain. Note that it's running
on a fairly powerful machine with 64gb of ram but increasing the number of
cpu cores won't help since buildbot is mostly single-threaded.

Note that you may hit another issue, the load on the subversion server
itself, depending on your use case, e.g. how many gb each checkout
represents. You may want to create a read-only svnsync'ed clone if the
server is not powerful enough.

So overall, it should be fine.

We never run multiple buildslave instance on a single VM, we use slave
sharing instead; e.g. a single buildslave is connected to multiple builders.

M-A


2013/5/14 Diane Maple <dianemaple76 at yahoo.com>

>
> Hello,
>
> How many projects can I have controlled by one master?
>
> I currently have 5 masters for different projects.
> Each master has between 26 and 48 builds to control.
> I was thinking of merging all of them into one.
> I just want to make sure buildbot will be okay with this.
>
> My goal is to have my 14 slave systems have 8 builder processes each.
> These 8 builders building any of the projects that need to be built.
>
> As of now I have configured the buildbot master to have two slaves for
> each master on each slave node.
>
> The problem is the slaves are either under used or over used depending on
> what is happening in subversion.
>
> Thank you for your comments.
>
> Diane
>
>
> ------------------------------------------------------------------------------
> AlienVault Unified Security Management (USM) platform delivers complete
> security visibility with the essential security capabilities. Easily and
> efficiently configure, manage, and operate all of your security controls
> from a single console and one unified framework. Download a free trial.
> http://p.sf.net/sfu/alienvault_d2d
> _______________________________________________
> Buildbot-devel mailing list
> Buildbot-devel at lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/buildbot-devel
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://buildbot.net/pipermail/devel/attachments/20130514/f2ca4c83/attachment.html>


More information about the devel mailing list