[Buildbot-devel] Dealing with / preventing "no space left on device" scenarios

[Kevin Funk]

On Monday 09 March 2015 20:19:44 Dustin J. Mitchell wrote:
> The horizon settings aren't the default because it would run the risk
> of users losing data without realizing it.

Fair enough.

Although this is log data which I'd consider being kept until a healthy amount 
of size. It's not like my Linux Kernel's dmesg output is kept forever either.

> There's a bug on file to purge unused directories -
> http://trac.buildbot.net/ticket/2324

Thanks for that one, somehow Google didn't bring this up. CC'ed, and maybe 
I'll even have time to work on that feature.

Regards
 
> Dustin
> 
> On Mon, Mar 9, 2015 at 6:31 AM, Dan Kegel <dank at kegel.com> wrote:
> > Related question: could/should buildbot have some kind of low disk space
> > alert?> 
> > On Mon, Mar 9, 2015 at 2:27 AM, Kevin Funk <kevin.funk at kdab.com> wrote:
> >> Heya,
> >> 
> >> one of our most recurring (read: boring) tasks at the moment with
> >> Buildbot is to make sure both the master and our slaves have enough disk
> >> space to fulfill their task.
> >> 
> >> *Master*
> >> 
> >> For the master, I finally solved this problem by doing
> >> 
> >>   c['changeHorizon'] = 200
> >>   c['buildHorizon'] = 100
> >>   c['eventHorizon'] = 50
> >>   c['logHorizon'] = 40
> >>   c['buildCacheSize'] = 15
> >> 
> >> in master.cfg, as suggested by
> >> http://docs.buildbot.net/current/manual/cfg-global.html#horizons
> >> 
> >> Before that change, the master usually ran out of space because of the
> >> huge
> >> amount of pickle and log files. Now I'm wondering why these values aren't
> >> the default to begin with, to avoid having users run into this situation
> >> from the start?
> >> 
> >> *Slaves*
> >> 
> >> For the slaves, it's more tricky (for us).
> >> 
> >> Since the set of projects we work on is usually dynamic, builder are
> >> frequently renamed/added/removed. Buildbot currently does not prune
> >> no-longer- used builder dirs, which is a problem. We usually run out of
> >> disk space on the slaves because of that.
> >> 
> >> I didn't find a solution to that yet, is there?
> >> 
> >> Thanks for your time
> >> 
> >> --
> >> Kevin Funk | kevin.funk at kdab.com | Software Engineer
> >> KDAB (Deutschland) GmbH&Co KG, a KDAB Group company
> >> Tel. Germany +49-30-521325470, Sweden (HQ) +46-563-540090
> >> KDAB - Qt Experts - Platform-independent software solutions
> >> -------------------------------------------------------------------------
> >> ----- Dive into the World of Parallel Programming The Go Parallel
> >> Website, sponsored by Intel and developed in partnership with Slashdot
> >> Media, is your hub for all things parallel software development, from
> >> weekly thought leadership blogs to news, videos, case studies, tutorials
> >> and more. Take a look and join the conversation now.
> >> http://goparallel.sourceforge.net/
> >> _______________________________________________
> >> Buildbot-devel mailing list
> >> Buildbot-devel at lists.sourceforge.net
> >> https://lists.sourceforge.net/lists/listinfo/buildbot-devel
> > 
> > --------------------------------------------------------------------------
> > ---- Dive into the World of Parallel Programming The Go Parallel Website,
> > sponsored by Intel and developed in partnership with Slashdot Media, is
> > your hub for all things parallel software development, from weekly
> > thought leadership blogs to news, videos, case studies, tutorials and
> > more. Take a look and join the conversation now.
> > http://goparallel.sourceforge.net/
> > _______________________________________________
> > Buildbot-devel mailing list
> > Buildbot-devel at lists.sourceforge.net
> > https://lists.sourceforge.net/lists/listinfo/buildbot-devel

-- 
Kevin Funk | kevin.funk at kdab.com | Software Engineer
KDAB (Deutschland) GmbH&Co KG, a KDAB Group company
Tel. Germany +49-30-521325470, Sweden (HQ) +46-563-540090
KDAB - Qt Experts - Platform-independent software solutions
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 7021 bytes
Desc: not available
URL: <http://buildbot.net/pipermail/devel/attachments/20150310/6c51d4a7/attachment.bin>