[devel at bb.net] Is it possible to support parallel steps from a single build?

Clément Hurlin clement.hurlin at provenrun.com
Sun Aug 18 12:57:42 UTC 2019


Indeed, introducing new builders may pollute the list of builders, which
I used to think as a bot's public interface. You could maybe prefix them
with a label ([internal]) and make sure they show up at the end of the
list ?

I have never investigated the code of buildbot that makes the interface
between builders and steps; but moving from sequential steps to possibly
parallel ones seems like a big conceptual change.

Clément

> Thanks Clement, that’s what I read online as well. But I feel like
> having multiple builders make it not quite flexible, and may confuse
> our users. 
> Is it easy to enable parallel steps? If I want to do a pull request
> for it, do you have any suggestions?
>
>> On Aug 16, 2019, at 12:48 AM, Clément Hurlin
>> <clement.hurlin at provenrun.com <mailto:clement.hurlin at provenrun.com>>
>> wrote:
>>
>> Hi Yixing,
>>
>>   I believe it is not possible to parallelize steps within a single
>> builder. However, if you're OK to have multiple builders; you could
>> move each parallelizable step to another builder and trigger
>> <http://docs.buildbot.net/latest/manual/configuration/buildsteps.html#triggering-schedulers>
>> all these spinoff builders from the main builder.
>>
>> Best,
>>
>> Clément
>>
>>
>>> Hi there,
>>>
>>> We are using buildbot for CI tests. In our build we have 20 steps but most of them could be fully parallelized. We wonder if we can allow parallel steps from the single build, this will allow us to run the entire build much faster.
>>>
>>> Thanks,
>>> Yixing
>>> _______________________________________________
>>> devel mailing list
>>> devel at buildbot.net
>>> https://lists.buildbot.net/mailman/listinfo/devel
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.buildbot.net/pipermail/devel/attachments/20190818/ff62a15c/attachment.html>


More information about the devel mailing list