[Buildbot-devel] Had to restart master...

[Dan Kegel]

A new builder just wouldn't show me a force build button,
even though I was logged in, and the code was the same
for all builders.  Restarting fixed it.

For the record, I'm running v0.8.7p1-15-g4ed9634 from git,
I tend to do "sudo initctl reload buildmaster", sometimes with typos,
and what I noticed in the log that might be related:

$ grep "master may" /home/buildbot/master-state/sandbox/g-speak/twistd.log
2014-02-18 11:27:32-0800 [-] WARNING: reconfig partially applied;
master may malfunction
2014-02-18 14:54:17-0800 [-] WARNING: reconfig partially applied;
master may malfunction
2014-02-20 08:04:09-0800 [-] WARNING: reconfig partially applied;
master may malfunction
2014-03-21 18:00:05-0700 [Broker,1432,10.10.150.125] WARNING: reconfig
partially applied; master may malfunction
2014-03-24 11:09:11-0700 [Broker,1448,10.10.150.125] WARNING: reconfig
partially applied; master may malfunction
2014-03-24 13:05:27-0700 [Broker,1463,10.10.150.125] WARNING: reconfig
partially applied; master may malfunction
2014-03-24 15:30:18-0700 [Broker,1473,10.10.150.125] WARNING: reconfig
partially applied; master may malfunction
2014-03-24 15:47:49-0700 [Broker,1207,10.10.131.97] WARNING: reconfig
partially applied; master may malfunction
2014-03-30 16:10:14-0700 [-] WARNING: reconfig partially applied;
master may malfunction

One of the incidents in detail:

2014-03-30 16:10:14-0700 [-] during reconfig:
        Traceback (most recent call last):
          File "/home/buildbot/master-state/sandbox/local/lib/python2.7/site-packages/twisted/internet/defer.py",
line 1213, in unwindGenerator
            return _inlineCallbacks(None, gen, Deferred())
          File "/home/buildbot/master-state/sandbox/local/lib/python2.7/site-packages/twisted/internet/defer.py",
line 1070, in _inlineCallbacks
            result = g.send(result)
          File "/home/buildbot/master-state/sandbox/buildbot-git/master/buildbot/process/botmaster.py",
line 162, in reconfigService
            new_config)
          File "/home/buildbot/master-state/sandbox/local/lib/python2.7/site-packages/twisted/internet/defer.py",
line 1213, in unwindGenerator
            return _inlineCallbacks(None, gen, Deferred())
        --- <exception caught here> ---
          File "/home/buildbot/master-state/sandbox/local/lib/python2.7/site-packages/twisted/internet/defer.py",
line 1070, in _inlineCallbacks
            result = g.send(result)
          File "/home/buildbot/master-state/sandbox/buildbot-git/master/buildbot/config.py",
line 736, in reconfigService
            yield svc.reconfigService(new_config)
          File "/home/buildbot/master-state/sandbox/buildbot-git/master/buildbot/buildslave.py",
line 232, in reconfigService
            d = self.updateSlave()
          File "/home/buildbot/master-state/sandbox/buildbot-git/master/buildbot/buildslave.py",
line 339, in updateSlave
            return self.sendBuilderList()
          File "/home/buildbot/master-state/sandbox/buildbot-git/master/buildbot/buildslave.py",
line 714, in sendBuilderList
            d = AbstractBuildSlave.sendBuilderList(self)
          File "/home/buildbot/master-state/sandbox/buildbot-git/master/buildbot/buildslave.py",
line 560, in sendBuilderList
            d = self.slave.callRemote("setBuilderList", blist)
          File "/home/buildbot/master-state/sandbox/local/lib/python2.7/site-packages/twisted/spread/pb.py",
line 345, in callRemote
            _name, args, kw)
          File "/home/buildbot/master-state/sandbox/local/lib/python2.7/site-packages/twisted/spread/pb.py",
line 858, in _sendMessage
            raise DeadReferenceError("Calling Stale Broker")
        twisted.spread.pb.DeadReferenceError: Calling Stale Broker

2014-03-30 16:10:14-0700 [-] WARNING: reconfig partially applied;
master may malfunction