[Buildbot-devel] How is Mozilla Buildbot Setup?

[Maria Marcano]

Thanks for sharing this information,

is very impressive knowing Buildbot scales to such a big setup (~6294
slaves over 57 masters)


On Fri, Apr 17, 2015 at 11:15 PM, Dustin J. Mitchell <dustin at v.igoro.us> wrote:
> I asked Kim Moir for some data, and here's what she provided:
>
> ---
> #build/try slaves
> Linux AWS 1235
> Mac  81
> Win 183
>
> #test slaves
> Android pandas 482
> Emulators for Android 398
> Linux tests in AWS 2990
> Linux tests on bare metal 174
> Mac 259
> Windows 492
>
> Note that numbers for AWS indicate the maximum possible pool of
> machines for that class of builds/tests.  We only allocate the number
> we need based on number of pending jobs.
>
> With respect to buildbot masters, we have 57.
> ---
>
> The pandas are Pandaboards housed in custom-built enclosures with
> IP-controllable power supplies and a system for remotely installing
> and self-testing them.
>
> We have run into limits on the number of Builders a single master can
> be configured for, due to the maximum number of outstanding object
> references Perspective Broker will allow and due simply to memory
> constraints on the masters.  So we've divided our masters and
> buildslaves into groups based on location and platform (for example, a
> few masters in our datacenter are assigned just to windows testers).
>
> The build/test process begins with build jobs which then use 'buildbot
> sendchange' to trigger corresponding test jobs on the resulting
> artifacts.  We have a much more involved release process which, I
> believe, uses Trigger steps.
>
> The masters run a patched 0.8.2 and the buildslaves run a patched 0.8.4.
>
> Dustin
>
> On Wed, Apr 15, 2015 at 1:34 PM, Mikhail Sobolev <mss at mawhrin.net> wrote:
>> On Wed, Apr 15, 2015 at 05:12:31PM +0200, Maria Marcano wrote:
>>> I think it will be interesting to know how is the current Mozilla
>>> Buildbot setup in terms of number Slaves / Masters / Builder
>>> Configuration
>>>
>>> And the number of Builders and Slaves per Master currently configured.
>> One bit I know for sure they do not use the latest 0.8.x.
>>
>> Otherwise, I agree, it'd be interesting to know some details about the setup.
>>
>> --
>> Misha
>>
>> ------------------------------------------------------------------------------
>> BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT
>> Develop your own process in accordance with the BPMN 2 standard
>> Learn Process modeling best practices with Bonita BPM through live exercises
>> http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- event?utm_
>> source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF
>> _______________________________________________
>> Buildbot-devel mailing list
>> Buildbot-devel at lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/buildbot-devel
>
> ------------------------------------------------------------------------------
> BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT
> Develop your own process in accordance with the BPMN 2 standard
> Learn Process modeling best practices with Bonita BPM through live exercises
> http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- event?utm_
> source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF
> _______________________________________________
> Buildbot-devel mailing list
> Buildbot-devel at lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/buildbot-devel