[Buildbot] #2871: make buildbot portable within AWS by moving static log files to s3 and using aws lifecycle management

Buildbot trac trac at buildbot.net
Wed Aug 13 01:01:29 UTC 2014


#2871: make buildbot portable within AWS by moving static log files to s3 and
using aws lifecycle management
------------------------+-----------------------
Reporter:  jrf222       |      Owner:
    Type:  enhancement  |     Status:  new
Priority:  major        |  Milestone:  undecided
 Version:  0.8.9        |   Keywords:
------------------------+-----------------------
 This is a feature request.

 Problem:  buildbot accumulates log files... forever.

 Solution:  move them to s3 immediately.

 Motivations:

   * s3 has "object lifecycle management", which can auto expire or archive
 the logs: http://docs.aws.amazon.com/AmazonS3/latest/dev/object-lifecycle-
 mgmt.html

   * s3 serves static web sites nicely:
 http://docs.aws.amazon.com/AmazonS3/latest/dev/WebsiteHosting.html

   * this makes it practical to put buildbot into a configuration that does
 not need a particular machine to stay running.  You can put the database
 in one of AWS' hosted databases, and with this feature, the rest of the
 state will be off the box.  http://aws.amazon.com/rds/postgresql/


 Implementation issues to address:

 This feature requires to pieces:

 1)  cause buildbot to push files to s3 as they get generated

 2)  cause buildbot to hyperlink to the s3-backed static website for static
 files that it currently holds on disk

--
Ticket URL: <http://trac.buildbot.net/ticket/2871>
Buildbot <http://buildbot.net/>
Buildbot: build/test automation


More information about the bugs mailing list