[users at bb.net] Nine performance worse than 0.8.14

[Elliot Saba]

I have ~60 builders, but really only 8 or so that do any real work.  (I
have lots of pseudo-builders to do things like clean out the source tree if
I want to do a from-scratch build, etc...)  I could cut down on the number
of builders if I need to, but greater than the any performance concerns is
the fact that when my buildbot instance is under heavy load (many builders
running at once) since the web ui does a separate ajax request for each
builder, if the buildbot starts dropping responses (which has happened to
me before) I can get an incomplete picture of the list of builders; some
builders show up, some don't, and of those that show up some builds don't
show up. I the webui used some kind of batch API where all builder statuses
are returned at once, then either there would be no builders, or all
builders with their statuses, instead of a kind of mixture.

The above problem hasn't happened since I switched over to
HTTP2/postgresql, so perhaps that is the solution, I'll keep using the
buildbot and let you know.
-E

On Mon, Jan 16, 2017 at 2:30 AM, Pierre Tardy <tardyp at gmail.com> wrote:

> Hi Elliot,
> Actually, after more investigation, the slowness of nine.bb.net I got was
> just due to latencies between EU(where I am) and US (where buildbot.net
> infra is)
>
> I looked at your trace, I can only see one place with 100%cpu for a while,
> and that is while fetching the list of builders.
> How many builders do you have?
>
> Pierre
>
> Le sam. 14 janv. 2017 à 10:30, Pierre Tardy <tardyp at gmail.com> a écrit :
>
>> Hi Elliot,
>>
>> I was looking at such slowdowns yesterday on nine.buildbot.net
>> For example https://nine.buildbot.net/#/builders/2/builds/87278 take
>> 300-600ms per http request. Which makes the full page load to 20s !
>>
>> I am not sure yet what is the reason, as when I built nine.bb.net in the
>> first time, things were much much smoother.
>> The DB now has 90k+ builds so this might be sqlite not scaling. I need to
>> do more tests.
>>
>> An easy way to speed up the UI is to enable http2
>> https://github.com/buildbot/buildbot-infra/pull/167/files
>>
>> You can also run https://github.com/tardyp/buildbot_profiler and tell us
>> what you get.
>>
>> Regards,
>> Pierre
>>
>> Le sam. 14 janv. 2017 à 09:31, Elliot Saba <staticfloat at gmail.com> a
>> écrit :
>>
>> I have noticed that the web interface in Nine has significantly worse
>> performance than in 0.8.14.  By significantly worse performance, I mean
>> that when there are multiple builds going on, the web interface takes many
>> seconds to load, and often times out so that I have to reload my browser a
>> few times to get all the elements to load.  Sometimes I will open the
>> "builders" page, and only a subset of all the builder rows will populate
>> the lists because some of the requests will timeout.
>>
>> Could this be because of a misconfiguration, or is this simply part of
>> the transition over to the new codebase?  I don't really know where to
>> begin testing in order to narrow down what is causing the slowdowns.
>>
>> Thanks,
>> -E
>> _______________________________________________
>> users mailing list
>> users at buildbot.net
>> https://lists.buildbot.net/mailman/listinfo/users
>>
>>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.buildbot.net/pipermail/users/attachments/20170116/d182d34d/attachment.html>