[Buildbot-devel] Fwd: [Buildbot] #641: New Default CSS

[Almad]

On Thursday 10 of December 2009 10:55:34 Marcus Lindblom wrote:
> But having a separate web server and BuildBot as a web service backend
> is an interesting idea. But I think we have a slight collision course
> with Brians DB work there, as that will bring the data into a SQL DB,
> from which several processes/threads can work.

I'm actually working on that. My approach is:

 - django is used as main framework (this thing must first work inhouse, and 
we're djangonauts)
 - configuration is stored in rdbms, as it's convenient to use
 - build results are retrieved via status plugin and stored in mongodb 
database (via [1])

 - mongodb is used as it should be faster then rdbms, it's easier to work with 
(build results are json anyway). Asynchronous writes are also problem, 
compatible python library shold be on it's way [2]


Project is called CthulhuBot and is available at [3]. It's still WIP, but 
we're using it inhouse and it mostly works. However, it's not yet vcs-agnostic 
and friends (it's still kind of written for our git-based workflow) and just 
wrapping buildbot is not it goal.

Additionally, there is simple "buildmaster client" cthylla [4] and set of 
"slave" setup.py plugins citools [5].

My idea/hope is to enpower common users to create their own buildslaves as 
they need them, as well as create new project. So first thing on my plate is to 
have better configuration (so you write a plugin for company that says "create 
debian package according to our policy and upload it to repository, and user 
only says on web "OK, I want this for my project". This works now), but I'm 
assuming company-like network (= master has ssh access to slaves).

Second plan is to make better reporting, I'd like to have "developer 
dashboard" displaying all commits done by logged user and their test results 
(kind of filtered tgrid).

Also, RSS/pubsubhubhub should be super easy by then.

I'm now in phase "first step: it's crufty, but works for us", so I'm now 
writing docs and preparing to polish things and stuff. My thoughts were to 
announce project when I'll have neat tutorial "how to automatically build your 
python package in virtualenv with few clicks" ;)

Comments welcomed, althrough we should probably move to separate topic/thread.

> Cheers,
> /Marcus

Almad


[1] http://github.com/ella/buildbot-mongodb-status
[2] http://github.com/fiorix/mongo-async-python-driver
[3] http://github.com/ella/cthulhubot
[4] http://github.com/ella/cthylla
[5] http://github.com/ella/citools