[Buildbot-devel] Purpose of buildbot.status.web.tests?

[Marcus Lindblom]

Stefan Seefeld wrote:
> On 11/03/2009 03:41 PM, Brian Warner wrote:
>> This was intended to support the "Problem Tracking" feature that I
>> always wanted but never got around to implementing. The idea would be to
>> record fine-grained machine-parseable test results, instead of just a
>> single full-suite SUCCESS/FAILURE and some unparseable logfiles. Then
>> other tools could ask questions like "how frequently does
>> buildbot.test.test_slaves.LatentSlave.testSequence fail?", or look for
>> transitions from passing to failing and correlate them with the Changes
>> that went into it.
>>    
> 
> There are already tools that allow this (one of those I happen to be the 
> maintainer of: http://qmtest.com). I believe it would be better to keep 
> that functionality separate from what buildbot has to offer.

I agree. Simply allowing a set of files to be uploaded per build would 
suffice, be they text-logfiles, html or whatever. (Perhaps links to  the 
web-frontend of a test-db that get's updated by tools run on the slave?)

Summary, tests-stuff goes out the window. :)

Cheers
/Marcus