[users at bb.net] 0.9.3, mostly finished, and another question.

Neil Gilmore ngilmore at grammatech.com
Wed Feb 1 16:28:03 UTC 2017


Hi Pierre,

Thanks for the advice.

I see that the key is to go through master.data more than trying to go 
through the object instances and their parents/sibling/children.

Neil Gilmore
grammatech.com

On 2/1/2017 10:22 AM, Pierre Tardy wrote:
> Hi Neil,
>
> My goto code for examples on how to get stuff from the data API is here:
> http://github.com/buildbot/buildbot/blob/master/master/buildbot/reporters/utils.py#L109
>
> I would suggest you to copy some part of this code
>
> something like this should work:
>
>     buildsteps = yield defer.gatherResults(
>         [master.data.get(("builds", build['buildid'], 'steps'))
>          for build in builds])
>     for s in buildsteps:
>         if step['name'] in interresting_step_names:
>             s['logs'] = yield master.data.get(("steps", s['stepid'], 
> 'logs'))
>             for l in s['logs']:
>                 first_100_lines = yield master.data.get(("logs", 
> l['logid'], 'contents', resultSpec=resultspec.ResultSpec(offset=0, 
> limit=100))
>
>
>
> Le mer. 1 févr. 2017 à 17:08, Neil Gilmore <ngilmore at grammatech.com 
> <mailto:ngilmore at grammatech.com>> a écrit :
>
>     Hi everyone.
>
>     Thanks to everyone on this list, and Pierre's patches in
>     particular, we
>     now have our masters running 0.9.3, with a couple, um,
>     enhancements. In
>     particular, we're using Pierre's patches to enable reconfiguration in
>     the schedulers. My users thank you.
>
>     We did see a few oddities upon restarting the masters, though. Quite a
>     few of our builders reported 2 builds running for a builder at the
>     same
>     time. And one builder even had an intervening build between the
>     two that
>     were building.
>
>     And now the question.
>
>     Back last fall, I inquired as to why our custom build step was failing
>     to produce a correct log (I haven't had a chance to follow up on this
>     particular item since then). Here's code:
>
>     class MyCustomStep(ShellCommand):
>           name = "errorlog"
>           haltOnFailure = 1
>           description = ["checking for errors"]
>           descriptionDone = ["done checking for errors"]
>
>           OFFprogressMetrics = ('output',)
>           # things to track: number of files compiled, number of
>     directories
>           # traversed (assuming 'make' is being used)
>
>           def createSummary(self, cmd):
>     self.addCompleteLog('stdio_head',cmd.getText()[0:65536])
>
>     Pierre's response that synchronous logs don't really work any more is
>     fine, and he offered this instead:
>     first_100_lines = yield self.master.data.get(("logs", log['logid'],
>     "contents"), resultSpec=resultspec.ResultSpec(offset=0, limit=100))
>
>     Unfortunately, I haven't been too successful at getting a log id from
>     inside of createSummary(). Is there any easy way to do that? (if
>     anyone
>     knows off the top of their head, it'll save me some work).
>
>     My current fix was to change master.cfg have our mail stuff use stdio
>     instead of stdio_head, and have the mail code to cut down the log
>     to 64K
>     there. This didn't quite have the intended effect.
>
>     I'd sort of thought that only the logs for the failed steps would be
>     included. I was wrong. Any log in the build named stdio for any step
>     would be included. On the bright side, they're all cut down to 64K or
>     less. On the less-than-bright side, sometimes we get many logs
>     attached
>     (to the point where some emails were getting caught by an email list
>     waiting for moderator approval, as they got too large for the
>     lists' limit).
>
>     So it looks like I'm back to spelunking the code to find a log id. My
>     other option (which is really a hack) is to know that stdio_head
>     is only
>     generated in steps named errorlog, and only process those.
>
>     Neil Gilmore
>     grammatech.com <http://grammatech.com>
>
>     _______________________________________________
>     users mailing list
>     users at buildbot.net <mailto:users at buildbot.net>
>     https://lists.buildbot.net/mailman/listinfo/users
>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.buildbot.net/pipermail/users/attachments/20170201/f48d3f2a/attachment.html>


More information about the users mailing list