[Buildbot-devel] FW: Buildbot buildmaster hardware recommendations

[Pierre Tardy]

On Wed, Jun 12, 2013 at 2:29 PM, Fabrice Coulon <coruja074 at gmail.com> wrote:

> Thank you for your quick answer Pierre!
>
> The company is http://www.axis.com/, the business is "Network Cameras".
> We have just made the big step between Buildbot 0.7.12 and Buildbot 0.8.6p1.
>
> It looks like the memory consumption has exploded between 0.7.x and 0.8.x,
> I was wondering also if there was a formula available to estimate the
> memory consumed by one Buildmaster? Currently we do not know if the system
> is leaking memory or just caching a lot of data (hoping that it will stop
> growing when it will reach the maximum number of cached objects). I have
> noticed that by default Buildbot caches many objects like for example 15
> build requests per builders, but how big is for example build request
> object, etc.
>

My own experience is that we reboot buildbot every week to make sure we
destroy potencial leaks. In our case, the leaks where more in our custom
process than in buildbot. Now that we fixed those issues, we dont have too
much leaks. Its always a good idea to have a nagios-like monitor the memory
consumption over time, and see if its increasing over time.

You should not reduce too much the caching, as its generally very useful
for perf. increasing it is often a good idea, as its easy to add memory to
your VM (while its not to add monothread CPU power).
the LRU cache system will make sure it does not explode. AFAIK, this works
well.

Pierre
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://buildbot.net/pipermail/devel/attachments/20130612/0afc2735/attachment.html>