[Buildbot-devel] Dealing with / preventing "no space left on device" scenarios
kevin.funk at kdab.com
Tue Mar 10 08:02:56 UTC 2015
On Monday 09 March 2015 09:04:36 Jim Rowan wrote:
> One solution to the slave situation would be simply to adapt your startup
> script to remove all builder dirs when it starts, and restart it
Doesn't work for us:
- We want to keep (some) builder dirs, because
- they contain a checkout that'd take hours to re-checkout
- they contain a build we want to re-use (b/c it'd take hours to rebuild)
Unfortunately using external scripts doesn't work, b/c Buildbot is the only
instance that knows *which* builders are no longer in use and thus can be
safely pruned. So the functionality *has* to rely on the Buildbot
configuration, more or less.
> On Mar 9, 2015, at 4:27 AM, Kevin Funk <kevin.funk at kdab.com> wrote:
> > Heya,
> > one of our most recurring (read: boring) tasks at the moment with Buildbot
> > is to make sure both the master and our slaves have enough disk space to
> > fulfill their task.
> > *Master*
> > For the master, I finally solved this problem by doing
> > c['changeHorizon'] = 200
> > c['buildHorizon'] = 100
> > c['eventHorizon'] = 50
> > c['logHorizon'] = 40
> > c['buildCacheSize'] = 15
> > in master.cfg, as suggested by
> > http://docs.buildbot.net/current/manual/cfg-global.html#horizons
> > Before that change, the master usually ran out of space because of the
> > huge
> > amount of pickle and log files. Now I'm wondering why these values aren't
> > the default to begin with, to avoid having users run into this situation
> > from the start?
> > *Slaves*
> > For the slaves, it's more tricky (for us).
> > Since the set of projects we work on is usually dynamic, builder are
> > frequently renamed/added/removed. Buildbot currently does not prune
> > no-longer- used builder dirs, which is a problem. We usually run out of
> > disk space on the slaves because of that.
> > I didn't find a solution to that yet, is there?
> > Thanks for your time
Kevin Funk | kevin.funk at kdab.com | Software Engineer
KDAB (Deutschland) GmbH&Co KG, a KDAB Group company
Tel. Germany +49-30-521325470, Sweden (HQ) +46-563-540090
KDAB - Qt Experts - Platform-independent software solutions
-------------- next part --------------
A non-text attachment was scrubbed...
Size: 7021 bytes
Desc: not available
More information about the devel