[Buildbot-devel] Marking a build step as failed unless the STDOUT contains a magic string.

Stefan Seefeld seefeld at sympatico.ca
Tue Jan 22 17:32:51 UTC 2008

Daniel Svensson wrote:
> On Jan 22, 2008 5:10 PM, Scott Lawrence <slawrence at pingtel.com> wrote:
>> It's not very robust to look for magic strings.  It's much better to
>> just make sure that your makefile is written so that 'make' will return
>> a failure status unless all tests pass.
> How do you show how many tests passed/failed? What if you want to
> extend the mechanism to keep track of testcases that doesn't meet the
> required coverage goal?

If things get a little more complex, I'd suggest using an actual testing 
tool to track such things. Incidentally, I'm the maintainer of QMTest: 
http://qmtest.com, which I have been using in conjunction with buildbot 
to drive testing, as well as to generate final and detailed test reports.



       ...ich hab' noch einen Koffer in Berlin...

More information about the devel mailing list