[users at bb.net] A LOT of build steps

Pedro Algarvio pedro at algarvio.me
Thu Jul 19 09:18:38 UTC 2018


Hello All.

I'm at a crossroad.
I have a master which is responsible for 4 projects right now. 3 of them are very lightweight on the master and also on the step complexity involving at most 5 steps for a build.
On the other hand, the 4th project in comparison, is a mammoth. On PRs we have ~60 steps(because we split the test suite into chunks)(We build at most 3 PRs at the same time).

For branch builds(we build at most 1 branch at a time), we add an extra set of tests which take much longer but that's beside the point. The point is that for branch builds its something around 140 steps.
So the UI, when loading all of this kind of falls apart. Eventually it does load though.

The obvious step now would be to split into 2 masters, just one process serving the UI? 3, 4? for that amount of build steps? And still single master for the actual builds?

Those UI processes will they actually make a difference? They would be behind nginx of course.

The UI makes a call/subscription per step. If it could gather all steps and then subscribe to all at once, performance could improve. But I don't know enough of the JS side of BB to even attempt tackling this with the free amount of time I have.

Anyway.
Pointers, tips, are more than welcome.

Best,
Pedro.
Pedro Algarvio @ Phone
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.buildbot.net/pipermail/users/attachments/20180719/38403e51/attachment.html>


More information about the users mailing list