[Buildbot-devel] custom scheduler for parallelism

Greg MacDonald gmacdonald at trionworlds.com
Mon Jul 13 18:35:10 UTC 2015


Hi Pierre,

The getSchedulersAndProperties method is just what I was looking for! Thanks a lot!

-Greg

From: Pierre Tardy [mailto:tardyp at gmail.com]
Sent: Saturday, July 11, 2015 7:45 AM
To: Mikhail Sobolev; buildbot-devel at lists.sourceforge.net
Subject: Re: [Buildbot-devel] custom scheduler for parallelism

Hi,
The Trigger step now has a getSchedulersAndProperties customization point, which can allow you to create the same build several times, but with different parameters as properties.

You can see an example in buildbot_travis:
https://github.com/tardyp/buildbot_travis/blob/master/buildbot_travis/steps/spawner.py#L51


Le sam. 11 juil. 2015 à 15:49, Mikhail Sobolev <mss at mawhrin.net<mailto:mss at mawhrin.net>> a écrit :
Hi Greg,

On Fri, Jul 10, 2015 at 08:43:02PM +0000, Greg MacDonald wrote:
>    I have a few jobs that are good parallelism candidates in that several
>    console commands can be split up between machines. I've got some basic
>    parallelism with the triggerable scheduler and multiple builders, but I
>    have to make a builder for each machine, which means I have to divvy up
>    the commands in advance. I would much prefer a more general solution where
>    I dynamically start a multiple instances of a single builder with each
>    instance having a different command to run. This way the nodes are kept
>    general and the load can be spread around the cluster dynamically. Is
>    there a way to do this that I'm not aware of? It doesn't seem like things
>    are setup this way so I was thinking of extending the triggerable
>    scheduler to do this, using the build properties to pass the command to
>    run. Does this sound like a reasonable course of action? Thx.
I wonder if you could share the snippet of your current configuration related
to your question?

--
Misha

------------------------------------------------------------------------------
Don't Limit Your Business. Reach for the Cloud.
GigeNET's Cloud Solutions provide you with the tools and support that
you need to offload your IT needs and focus on growing your business.
Configured For All Businesses. Start Your Cloud Today.
https://www.gigenetcloud.com/
_______________________________________________
Buildbot-devel mailing list
Buildbot-devel at lists.sourceforge.net<mailto:Buildbot-devel at lists.sourceforge.net>
https://lists.sourceforge.net/lists/listinfo/buildbot-devel
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://buildbot.net/pipermail/devel/attachments/20150713/51e93aa2/attachment.html>


More information about the devel mailing list