<html><head></head><body>Don't really have a notion of the implications of not sorting, but I managed to reduce the CPU spike and reconfigure time by providing 'prioritizeBuilders` on the master config which just returns the unsorted builders.<br>
<br>
Best,<br>
Pedro.<br><br><div class="gmail_quote">On July 19, 2018 2:26:29 PM GMT+01:00, Dan Kegel <dank@kegel.com> wrote:<blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
<pre class="k9mail">About 1800 builders. Cpu was high, mostly in mysqld, but buildbot<br>was also busy:<br><br> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+<br>COMMAND<br>26049 mysql 20 0 2404832 220032 6992 S 161.1 2.7 285:11.00<br>mysqld<br>25662 buildbot 20 0 4636132 3.019g 10932 S 24.9 38.7 202:59.14<br>python3<br><br>Normally it takes 2 minutes to reconfigure, so something odd was going on.<br><br>buildbot sure takes a lot of RAM.<br><br>On Thu, Jul 19, 2018 at 1:01 AM, Pedro Algarvio <pedro@algarvio.me> wrote:<br><blockquote class="gmail_quote" style="margin: 0pt 0pt 1ex 0.8ex; border-left: 1px solid #729fcf; padding-left: 1ex;"> How many builder are involved, more or less, in your setup?<br> Was your CPU pegged while reconfig was running?<br><br> Best,<br> Pedro.<br><br> On July 18, 2018 5:31:12 AM GMT+01:00, Dan Kegel <dank@kegel.com> wrote:<br><blockquote class="gmail_quote" style="margin: 0pt 0pt 1ex 0.8ex; border-left: 1px solid #ad7fa8; padding-left: 1ex;"><br> Reran reconfig just now, and it took less than 2 minutes, as expected.<br><br> Why the heck did it take an hour last time?<br><br><br> On Tue, Jul 17, 2018 at 9:07 PM, Dan Kegel <dank@kegel.com> wrote:<br><blockquote class="gmail_quote" style="margin: 0pt 0pt 1ex 0.8ex; border-left: 1px solid #8ae234; padding-left: 1ex;"><br> Any guesses how long the reconfig took?<br><br> Scroll down to see:<br><br><br><br><br><br><br><br><br><br><br><br><br><br><br><br><br><br><br><br><br><br><br><br><br><br><br><br><br><br><br><br><br><br><br><br><br><br><br><br> 2018-07-17 18:10:51-0700 [-] reconfig is ongoing for 3180 s<br><br> OMG.<br><br> On Tue, Jul 17, 2018 at 5:32 PM, Dan Kegel <dank@kegel.com> wrote:<br><blockquote class="gmail_quote" style="margin: 0pt 0pt 1ex 0.8ex; border-left: 1px solid #fcaf3e; padding-left: 1ex;"><br> Hi all,<br> I finally switched to mysqld instead of sqlite<br> when I made the leap to buildbot 1.x.<br> At first it was much faster.<br><br> Now, though.... 'buildbot reconfig' has been running for 900 seconds<br> and still isn't done. ps shows:<br><br> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+<br> COMMAND<br> 26049 mysql 20 0 2404832 220032 6992 S 161.1 2.7 285:11.00<br> mysqld<br> 25662 buildbot 20 0 4636132 3.019g 10932 S 24.9 38.7 202:59.14<br> python3<br><br> Seems like I've run into a gotcha. Do I have to reframbulate the<br> primary cryptokey tv tables in mysqld or sommat?<br></blockquote></blockquote><br><hr><br><br> users mailing list<br> users@buildbot.net<br> <a href="https://lists.buildbot.net/mailman/listinfo/users">https://lists.buildbot.net/mailman/listinfo/users</a><br></blockquote><br><br> Pedro Algarvio @ Phone<br></blockquote></pre></blockquote></div><br>
Pedro Algarvio @ Phone</body></html>