[Buildbot-devel] Nightly schedulers not running

[Thomas Middeldorp]

The new exception looks like this:

2011-11-28 13:15:08+1300 [-] while initializing Nightly 'nightly-build'
         Traceback (most recent call last):
           File 
"/usr/local/lib/python2.6/dist-packages/Twisted-11.0.0-py2.6-linux-x86_64.egg/twisted/internet/defer.py", 
line 388, in errback
             self._startRunCallbacks(fail)
           File 
"/usr/local/lib/python2.6/dist-packages/Twisted-11.0.0-py2.6-linux-x86_64.egg/twisted/internet/defer.py", 
line 455, in _startRunCallbacks
             self._runCallbacks()
           File 
"/usr/local/lib/python2.6/dist-packages/Twisted-11.0.0-py2.6-linux-x86_64.egg/twisted/internet/defer.py", 
line 542, in _runCallbacks
             current.result = callback(current.result, *args, **kw)
           File 
"/usr/local/lib/python2.6/dist-packages/Twisted-11.0.0-py2.6-linux-x86_64.egg/twisted/internet/defer.py", 
line 891, in gotResult
             _deferGenerator(g, deferred)
         --- <exception caught here> ---
           File 
"/usr/local/lib/python2.6/dist-packages/Twisted-11.0.0-py2.6-linux-x86_64.egg/twisted/internet/defer.py", 
line 866, in _deferGenerator
             result = g.next()
           File 
"/usr/local/lib/python2.6/dist-packages/buildbot-0.8.5-py2.6.egg/buildbot/schedulers/base.py", 
line 134, in getState
             yield wfd.getResult()
           File 
"/usr/local/lib/python2.6/dist-packages/Twisted-11.0.0-py2.6-linux-x86_64.egg/twisted/internet/defer.py", 
line 845, in getResult
             self.result.raiseException()
           File 
"/usr/local/lib/python2.6/dist-packages/Twisted-11.0.0-py2.6-linux-x86_64.egg/twisted/python/threadpool.py", 
line 207, in _worker
             result = context.call(ctx, function, *args, **kwargs)
           File 
"/usr/local/lib/python2.6/dist-packages/Twisted-11.0.0-py2.6-linux-x86_64.egg/twisted/python/context.py", 
line 118, in callWithContext
             return self.currentContext().callWithContext(ctx, func, 
*args, **kw)
           File 
"/usr/local/lib/python2.6/dist-packages/Twisted-11.0.0-py2.6-linux-x86_64.egg/twisted/python/context.py", 
line 81, in callWithContext
             return func(*args,**kw)
           File 
"/usr/local/lib/python2.6/dist-packages/buildbot-0.8.5-py2.6.egg/buildbot/db/pool.py", 
line 128, in thd
             rv = callable(conn, *args, **kwargs)
           File 
"/usr/local/lib/python2.6/dist-packages/buildbot-0.8.5-py2.6.egg/buildbot/db/state.py", 
line 95, in thd
             return json.loads(row.value_json)
           File "/usr/lib/pymodules/python2.6/simplejson/__init__.py", 
line 307, in loads
             return _default_decoder.decode(s)
           File "/usr/lib/pymodules/python2.6/simplejson/decoder.py", 
line 338, in decode
             raise ValueError(errmsg("Extra data", s, end, len(s)))
         exceptions.ValueError: Extra data: line 1 column 17 - line 1 
column 18 (char 17 - 18)

One of the other two builders had a slightly different last line:

         exceptions.ValueError: Extra data: line 1 column 15 - line 1 
column 16 (char 15 - 16)

I tried adding "print row, row.value_json" just above the raise as well 
but that doesn't look obviously bad either...

2011-11-28 16:25:19+1300 [-] (u'1322162939.8104999',) 1322162939.8104999

Anything else I should check/try?

- Thomas


On 28/11/2011 12:06 p.m., Dustin J. Mitchell wrote:
> That's normal-looking.  Odd!
>
> Try adding a 'raise':
>
> diff --git a/master/buildbot/db/state.py b/master/buildbot/db/state.py
> index 4c471a5..8ee6421 100644
> --- a/master/buildbot/db/state.py
> +++ b/master/buildbot/db/state.py
> @@ -94,6 +94,7 @@ class StateConnectorComponent(base.DBConnectorComponent):
>               try:
>                   return json.loads(row.value_json)
>               except:
> +                raise
>                   raise TypeError("JSON error loading state value '%s' for %d" %
>                                   (name, objectid))
>           return self.db.pool.do(thd)
>
> and let's see what the resulting exception looks like?
>
> Dustin