[Buildbot-devel] [GSoC]New MQ option to Buildbot

[Dustin J. Mitchell]

Welcome Damon!

I'm psyched about this project - it's a major piece of nine
functionality that has been left largely un-implemented until now.
The current version of nine can only support message communication
within a single process.  Damon's project will extend that to use
Kombu for message communication between an arbitrary number of
masters.  Kombu has a bunch of backends -- from a simple in-memory
backend for the single-master mode, to a serverless ZeroMQ backend, to
the deluxe AMQP backend that talks to brokers like RabbitMQ.

And don't worry about requirements.  We've patterned this on the DB
requirement.  Yes, Kombu is another requirement, but it's just a
Python package, so not a significant addition; and just like Buildbot
doesn't *require* MySQL or Postgres, there's no need to run any other
service like RabbitMQ either, if you don't want to.

For those who have worked with apps using messaging backends (Celery,
OpenStack, etc.), it'd be great like to hear your experiences, either
from a development or ops perspective.  What are the pitfalls you've
encountered?  What design mistakes have you seen in other software
that we should try to avoid?

Dustin

On Sat, Apr 26, 2014 at 6:03 AM, Damon Wang <damon.devops at gmail.com> wrote:
> Hi all,
>
> I'm happy to get the opportunity to join Buildbot's develop community as a
> GSoC project, I need to thank Dustin's hard work on community and Pierre's
> reply to my email which both helped me a lot, thank tychoish and Ernie
> volunteer to mentor me :-)
>
> Briefly introducing myself: My name is Wei Wang, you can call me Damon, I'm
> a junior undergraduate student from China, major in Information and
> Computing Science.
>
> About my project: We know Buildbot nine will bring some new features,
> including using messages and message queue, but implementing a new MQ is
> hard, which is part of Dustin's previous work, I plan to make a new MQ
> option based on Kombu.
>
> What I'm doing now: My mentors have recommend me some articles, now I am
> reading them and Buildbot's wiki (the Wiki is great!), after I'm more
> familiar with Buildbot, I'll read Buildbot's code, which I have scanned
> little of them :-)
>
> No ideas are perfect, pleases leave a message if you have any advice!
>
> Thanks,
> Damon Wang
>
> ------------------------------------------------------------------------------
> Start Your Social Network Today - Download eXo Platform
> Build your Enterprise Intranet with eXo Platform Software
> Java Based Open Source Intranet - Social, Extensible, Cloud Ready
> Get Started Now And Turn Your Intranet Into A Collaboration Platform
> http://p.sf.net/sfu/ExoPlatform
> _______________________________________________
> Buildbot-devel mailing list
> Buildbot-devel at lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/buildbot-devel
>