[Buildbot-devel] Buildbot buildmaster hardware recommendations

[Fabrice Coulon]

Hi,

I am using Buildbot at my work place since 2010. The system has
problem to scale up i.e, the Buildbot web status is very slow (it can
take
sometimes one minute to retrieve results from it under heavy load).

We have one script that automatically gathers Buildbot's webstatus
reports (via e.g:http://buildbot-st:8010/builders/enter_name/builds/216)

We run one Buildmaster in a virtual machine, and about 100 buildslaves
process (on native real hardware, ~10 buildslaves/host),
we run only one build per buildslaves.

The amount of text  data transfered (stdio) from buildslaves to
buildmaster can sometimes be around ~30MB per builds.

What I am looking for is some hardware recommendations for the
Buildmaster (knowing that Buildbot is single threaded) and that we
cannot spread the load to several Buildmaster processes yet and that
we have about 500 builders.

Could somebody give an example of the hardware config used for the
buildmaster. For example:

* CPU
* RAM
* SSD size
* Network

Thank you!