[Buildbot-devel] How to handle logfiles when multiple tests are run in a single buildstep

Fulvio Cervone fcervone at me.com
Tue Apr 12 23:53:33 UTC 2011


I guess that i did misunderstood.

Anyway I think that as I mentioned, he can easily get the data out of the single log file just with a bit of grep and sed/awk; if he wants to dump the logs in an external file. Then he could just make a web page to present the single links to each of the tests and link it to the waterfall page (or in any other area that he see fit); I saw some nice examples in the web folder, that I will probably use to present my test results.

It sound easier in this way, compared to writing a custom subclass, but that's just me (maybe is enough to overload the createSummary and put the logic there ? It will be a pain thou to create single links for each test without some heavy data processing on the main log file)

Anyway an example of what Bill want to accomplish would help :)

-f


On Apr 12, 2011, at 3:28 PM, Amber Yust wrote:

> I think you missed what Bill was asking about. It seems he's converting from one step per test to many tests per step, and is inquiring about how best to handle logs for those tests.
> 
> Bill, is there a particular use-case that you have that would not be able to work with just having all of the tests output into the same shared log for the step? If having a shared log would work, you can just have all of the tests log to stdio and use the existing log, greping through for whatever individual test you need.
> 
> If you absolutely need links to separate logfiles, you'll probably have to subclass one of the BuildStep classes to add in some additional addLogFile calls.
> 
> ~Amber
> 
> On Tue, Apr 12, 2011 at 3:23 PM, Fulvio Cervone <fcervone at me.com> wrote:
> Bill,
> 
> If you have one step per test you will get a log per step (the stdio), and the link to each log file will be available to you; so you can just put the link in a mail and send it out (I assume that you need to send reports with pass and fail, so you will have a mail notifier, in which you can append lines from each log and generate a report).
> 
> Another way would be to get the steps to dump the output to a file, and then you can manipulate the file content and do whatever you see fit.
> 
> Just check the mail notifier section on the manual; it has a great example where you can see how to call the logs, parse them and stick the links to the logs in a message formatter (either in html or plain text if you prefer).
> 
> Either way is very simple, but maybe there are others that are even easier :)
> 
> -f
> 
> 
> On Apr 12, 2011, at 11:16 AM, William Deegan wrote:
> 
> > Greetings,
> >
> > I'll be changing a build from having a buildstep per test to on
> > buildstep which launches the tests into a compute farm via gridengine.
> >
> > I'm wondering what's the best way to create links to the logfile
> > generated by these tests?
> > Typically 1 or 2 per test.
> >
> > Ideally the buildstep would show the number of passed/failed tests and
> > have links to all the tests logfiles.
> >
> > Any advice on the simplest way to accomplish this is most welcome!
> >
> > Thanks,
> > Bill
> >
> > ------------------------------------------------------------------------------
> > Forrester Wave Report - Recovery time is now measured in hours and minutes
> > not days. Key insights are discussed in the 2010 Forrester Wave Report as
> > part of an in-depth evaluation of disaster recovery service providers.
> > Forrester found the best-in-class provider in terms of services and vision.
> > Read this report now!  http://p.sf.net/sfu/ibm-webcastpromo
> > _______________________________________________
> > Buildbot-devel mailing list
> > Buildbot-devel at lists.sourceforge.net
> > https://lists.sourceforge.net/lists/listinfo/buildbot-devel
> 
> 
> ------------------------------------------------------------------------------
> Forrester Wave Report - Recovery time is now measured in hours and minutes
> not days. Key insights are discussed in the 2010 Forrester Wave Report as
> part of an in-depth evaluation of disaster recovery service providers.
> Forrester found the best-in-class provider in terms of services and vision.
> Read this report now!  http://p.sf.net/sfu/ibm-webcastpromo
> _______________________________________________
> Buildbot-devel mailing list
> Buildbot-devel at lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/buildbot-devel
> 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://buildbot.net/pipermail/devel/attachments/20110412/8431a184/attachment.html>


More information about the devel mailing list