[Buildbot-devel] Is it possible to deploy buildbot to google app engine

[Marcus Lindblom]

On 2009-12-30 11:06, Dustin Sallings wrote:
>
> On Dec 30, 2009, at 1:08, Marcus Lindblom wrote:
>
>> Also, we might not be able to run Twisted at all (as it's backend event
>> handlers, the reactors, do low-level stuff that doesn't seem to be
>> allowed) which would make a conversion rather invasive. (Unless there's
>> similar solution (or twisted-backend) that would work on GAE...)
>
> What part of GAE is interesting?
All of it, I'd say. :)

I think it'd be awesomely cool to run buildbot instances on GAE, but 
that would, as I said, require ripping out quite a bit of the entrails 
and re-jigger them into something new, that doesn't store any state in 
memory for more than the lifetime of the request.

The current pickle-system might work on GAE, but we need to 
pickle/unpickle a lot (probably too much) on each request. Brian's DB 
work would not be applicable, unless it also abstracts the backend store 
so much that a non-RDB store is feasible.

> I made a webhook status notifier and made an excessively simple, but 
> event-driven UI here:
>
> http://bbstatus.appspot.com/
>
> source code is here:
>
> http://github.com/dustin/bbstatus
>
> I'd love to see that be touched by someone who knows how to make UIs 
> that make sense.  :)
>
Interesting work. Does it poll the build-masters regularly to update the 
info?

Building a web-only-interface for buildbot on GAE should be easy 
(if/when we have a HTTP-interface to the DB) and would off-load some 
work from the master, so that it could focus on controlling the slaves 
and storing results. But, running the entire buildmaster on GAE would be 
even cooler. The way GAE scales would make it attractive to run really 
large build masters on, handling 100s or thousands of builds/slaves.

Humhum. Next project after jinja is integrated?! (heh... I'm having 
delusion of grandure.. before lunch. ;)

Cheers,
/Marcus