[users at bb.net] Buildbot Hanging

[Pierre Tardy]

Sorry, I realize now my answer was a bit too direct. I was answering from
my phone.

I do care about Buildbot hanging, this is something we should resolve. I
dont see anything obvious from the master.cfg you provided.
So we really need to dig further together.

It looks like you are only using one worker, which is probably on the same
machine.
In that case, I would advise you to configure LocalWorker instead of
Worker, which avoids you to manage a separate process.
http://docs.buildbot.net/latest/manual/cfg-workers.html#local-workers

Regards
Pierre

On Thu, Apr 6, 2017 at 7:57 PM Pierre Tardy <tardyp at gmail.com> wrote:

> There is no concept of "pending build" in buildbot nine UI anymore. Are
> you seeing buildrequests or builds in the builder UI?
>
> Also the logs are from forth of April and we are the six. Are you sure you
> are looking at the right log?
> You will need to look at the last meaningful message which is not poller
> or keep alive. It is very often that the answer is in the log, but the log
> is full of noise and I have hard time finding out.
>
> Le jeu. 6 avr. 2017 19:37, Chris Spencer <chrisspen at gmail.com> a écrit :
>
> Buildbot shows pending builds, but never begins running the build, almost
> like the worker has crashed. However, the worker's twistd.log shows it's
> still running.
>
> I also thought that my experimental nextBuild callback was the cause of
> the issue, so I removed it and restarted buildbot. However, the problem
> existed before I added my callback, and the problem remains after I removed
> it.
>
> On Thu, Apr 6, 2017 at 1:19 PM, Pierre Tardy <tardyp at gmail.com> wrote:
>
> Hi Chris. I am not sure exactly what you mean as hang. Could you please
> describe me what happens and what should happen instead for you?
>
> I see you are also playing with nextBuild in another thread. Beware that a
> crashing or misbehaving nextBuild can easily make buildbot stop creating
> new build.
>
> Le jeu. 6 avr. 2017 16:44, Chris Spencer <chrisspen at gmail.com> a écrit :
>
> OS: Ubuntu 16.04
> Twisted: 17.1.0
> Buildbot: 0.9.4
>
>
>
> On Thu, Apr 6, 2017 at 10:29 AM, Dan Kegel <dank at kegel.com> wrote:
>
> On Thu, Apr 6, 2017 at 6:54 AM, Chris Spencer <chrisspen at gmail.com> wrote:
> > I'm continuing to see some strange issues with Buildbot hanging. I tried
> > using a crontab to see if the worker or master had crashed and restart
> them,
> > but it looks like they're still running just fine. Buildbot's even
> showing
> > pending builds, but it's not ignoring them.
> >
> > If I manually restart them, it immediately begins working again, but I
> have
> > no way to detect it being hung except to login and check if there are
> > pending builds with nothing being processed.
> >
> > How do I diagnose and fix this?
>
> I know the pain.  (On cygwin, with a very old twisted, I'm
> seeing a hang very often at the end of the git step; twisted
> is failing to notice its child has finished.  I have also seen
> hangs on Linux, but not that one, and much less often.)
>
> What OS, and versions of twisted and buildbot?
>
> Can you get a backtrace from the hung worker?
>
>
> _______________________________________________
> users mailing list
> users at buildbot.net
> https://lists.buildbot.net/mailman/listinfo/users
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.buildbot.net/pipermail/users/attachments/20170407/8350c912/attachment.html>