[Buildbot] #2871: make buildbot portable within AWS by moving static log files to s3 and using aws lifecycle management
Buildbot trac
trac at buildbot.net
Wed Aug 13 01:01:29 UTC 2014
#2871: make buildbot portable within AWS by moving static log files to s3 and
using aws lifecycle management
------------------------+-----------------------
Reporter: jrf222 | Owner:
Type: enhancement | Status: new
Priority: major | Milestone: undecided
Version: 0.8.9 | Keywords:
------------------------+-----------------------
This is a feature request.
Problem: buildbot accumulates log files... forever.
Solution: move them to s3 immediately.
Motivations:
* s3 has "object lifecycle management", which can auto expire or archive
the logs: http://docs.aws.amazon.com/AmazonS3/latest/dev/object-lifecycle-
mgmt.html
* s3 serves static web sites nicely:
http://docs.aws.amazon.com/AmazonS3/latest/dev/WebsiteHosting.html
* this makes it practical to put buildbot into a configuration that does
not need a particular machine to stay running. You can put the database
in one of AWS' hosted databases, and with this feature, the rest of the
state will be off the box. http://aws.amazon.com/rds/postgresql/
Implementation issues to address:
This feature requires to pieces:
1) cause buildbot to push files to s3 as they get generated
2) cause buildbot to hyperlink to the s3-backed static website for static
files that it currently holds on disk
--
Ticket URL: <http://trac.buildbot.net/ticket/2871>
Buildbot <http://buildbot.net/>
Buildbot: build/test automation
More information about the bugs
mailing list