[Buildbot-devel] Marking a build step as failed unless the STDOUT contains a magic string.

[Stefan Seefeld]

Daniel Svensson wrote:
> On Jan 22, 2008 5:10 PM, Scott Lawrence <slawrence at pingtel.com> wrote:
>> It's not very robust to look for magic strings.  It's much better to
>> just make sure that your makefile is written so that 'make' will return
>> a failure status unless all tests pass.
> 
> How do you show how many tests passed/failed? What if you want to
> extend the mechanism to keep track of testcases that doesn't meet the
> required coverage goal?

If things get a little more complex, I'd suggest using an actual testing 
tool to track such things. Incidentally, I'm the maintainer of QMTest: 
http://qmtest.com, which I have been using in conjunction with buildbot 
to drive testing, as well as to generate final and detailed test reports.

Regards,
		Stefan

-- 

       ...ich hab' noch einen Koffer in Berlin...