[users at bb.net] 0.9.3, mostly finished, and another question.

[Pierre Tardy]

Hi Neil,

My goto code for examples on how to get stuff from the data API is here:
http://github.com/buildbot/buildbot/blob/master/master/buildbot/reporters/utils.py#L109

I would suggest you to copy some part of this code

something like this should work:

    buildsteps = yield defer.gatherResults(
        [master.data.get(("builds", build['buildid'], 'steps'))
         for build in builds])
    for s in buildsteps:
        if step['name'] in interresting_step_names:
            s['logs'] = yield master.data.get(("steps", s['stepid'],
'logs'))
            for l in s['logs']:
                first_100_lines = yield master.data.get(("logs",
l['logid'], 'contents', resultSpec=resultspec.ResultSpec(offset=0,
limit=100))



Le mer. 1 févr. 2017 à 17:08, Neil Gilmore <ngilmore at grammatech.com> a
écrit :

Hi everyone.

Thanks to everyone on this list, and Pierre's patches in particular, we
now have our masters running 0.9.3, with a couple, um, enhancements. In
particular, we're using Pierre's patches to enable reconfiguration in
the schedulers. My users thank you.

We did see a few oddities upon restarting the masters, though. Quite a
few of our builders reported 2 builds running for a builder at the same
time. And one builder even had an intervening build between the two that
were building.

And now the question.

Back last fall, I inquired as to why our custom build step was failing
to produce a correct log (I haven't had a chance to follow up on this
particular item since then). Here's code:

class MyCustomStep(ShellCommand):
      name = "errorlog"
      haltOnFailure = 1
      description = ["checking for errors"]
      descriptionDone = ["done checking for errors"]

      OFFprogressMetrics = ('output',)
      # things to track: number of files compiled, number of directories
      # traversed (assuming 'make' is being used)

      def createSummary(self, cmd):
          self.addCompleteLog('stdio_head',cmd.getText()[0:65536])

Pierre's response that synchronous logs don't really work any more is
fine, and he offered this instead:
first_100_lines = yield self.master.data.get(("logs", log['logid'],
"contents"), resultSpec=resultspec.ResultSpec(offset=0, limit=100))

Unfortunately, I haven't been too successful at getting a log id from
inside of createSummary(). Is there any easy way to do that? (if anyone
knows off the top of their head, it'll save me some work).

My current fix was to change master.cfg have our mail stuff use stdio
instead of stdio_head, and have the mail code to cut down the log to 64K
there. This didn't quite have the intended effect.

I'd sort of thought that only the logs for the failed steps would be
included. I was wrong. Any log in the build named stdio for any step
would be included. On the bright side, they're all cut down to 64K or
less. On the less-than-bright side, sometimes we get many logs attached
(to the point where some emails were getting caught by an email list
waiting for moderator approval, as they got too large for the lists' limit).

So it looks like I'm back to spelunking the code to find a log id. My
other option (which is really a hack) is to know that stdio_head is only
generated in steps named errorlog, and only process those.

Neil Gilmore
grammatech.com

_______________________________________________
users mailing list
users at buildbot.net
https://lists.buildbot.net/mailman/listinfo/users
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.buildbot.net/pipermail/users/attachments/20170201/0836a805/attachment.html>