[Buildbot-devel] How is Mozilla Buildbot Setup?

[Dustin J. Mitchell]

I asked Kim Moir for some data, and here's what she provided:

---
#build/try slaves
Linux AWS 1235
Mac  81
Win 183

#test slaves
Android pandas 482
Emulators for Android 398
Linux tests in AWS 2990
Linux tests on bare metal 174
Mac 259
Windows 492

Note that numbers for AWS indicate the maximum possible pool of
machines for that class of builds/tests.  We only allocate the number
we need based on number of pending jobs.

With respect to buildbot masters, we have 57.
---

The pandas are Pandaboards housed in custom-built enclosures with
IP-controllable power supplies and a system for remotely installing
and self-testing them.

We have run into limits on the number of Builders a single master can
be configured for, due to the maximum number of outstanding object
references Perspective Broker will allow and due simply to memory
constraints on the masters.  So we've divided our masters and
buildslaves into groups based on location and platform (for example, a
few masters in our datacenter are assigned just to windows testers).

The build/test process begins with build jobs which then use 'buildbot
sendchange' to trigger corresponding test jobs on the resulting
artifacts.  We have a much more involved release process which, I
believe, uses Trigger steps.

The masters run a patched 0.8.2 and the buildslaves run a patched 0.8.4.

Dustin

On Wed, Apr 15, 2015 at 1:34 PM, Mikhail Sobolev <mss at mawhrin.net> wrote:
> On Wed, Apr 15, 2015 at 05:12:31PM +0200, Maria Marcano wrote:
>> I think it will be interesting to know how is the current Mozilla
>> Buildbot setup in terms of number Slaves / Masters / Builder
>> Configuration
>>
>> And the number of Builders and Slaves per Master currently configured.
> One bit I know for sure they do not use the latest 0.8.x.
>
> Otherwise, I agree, it'd be interesting to know some details about the setup.
>
> --
> Misha
>
> ------------------------------------------------------------------------------
> BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT
> Develop your own process in accordance with the BPMN 2 standard
> Learn Process modeling best practices with Bonita BPM through live exercises
> http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- event?utm_
> source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF
> _______________________________________________
> Buildbot-devel mailing list
> Buildbot-devel at lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/buildbot-devel