[Buildbot-devel] Scaling buildbot

[Jim Rowan]

On Jun 18, 2015, at 2:19 PM, Dan Kegel <dank at kegel.com> wrote:

> Noticed that wget of a large log falls to 30 KB/s while gitpoller is
> active, and goes up to 3 MB/s when no gitpoller is active.
> I wonder if gitpoller is running too much in the foreground, slowing
> down the twisted event loop….
> 

On a related topic… we’ve noticed that FileUpload performance from buildslaves that are far away (50ms WAN) is horrible, compared to scp or rsync over ssh; about 10X slower.   For us, it’s always that way and doesn’t seem to vary a lot.  The local (LAN) upload performance is fine.   Anyone noticed this and/or have solutions?