[Buildbot-devel] buildbot for testers

[James Youngman]

On Fri, May 22, 2009 at 6:24 AM, Kregg Kemper <kreggk at comcast.net> wrote:
>    Hello,
>
>      I would like to start getting involved with buildbot and do some
> development that might expand the capabilities to be usable by a test group
> for running regression testing. So far have created a fork, read some
> documentation, and browsed the source code. That's about it. Not sure what
> to do next.
>
>      I have developed a system that does some similar stuff as buildbot and
> would like to merge some of my ideas into buildbot. The one oh wish list
> mentioned something like a test bot that handled running automated tests
> that could come from a separate code base. This is what I would like to
> expand on and start developing. This bot would be used to run black box
> regression testing created by the test team in their environment. Some of
> the stuff I want to do:
>
> testbot receives notification that a build is complete and installer is
> ready. The bot see if it matches a pre-defined test plan for that
> build/baseline. The valid test plans are run.

Wouldn't this be easier if the tests were simply included in the same
branch as the code to which they apply?


> a test plan determines what resource the tests will run on and which tests
> will be ran.
>
> resource could be a computer or a VM that on a server that shares limited
> resources.

Buildbot seems to do this reasonably well.

>    This is the stuff I do at work and want to incorporate into build bot,
> but I have no idea how interested other people or in this stuff. Any
> feedback on this would be cool.

My main interest is in getting Buildbot to buid and test a tarball, as
opposed to needing to check the source out in the slave.   I'm working
on it, but not devoting much time to it.

James.