[Buildbot-devel] HTML test results

[Stefan Seefeld]

On 03/23/2010 01:48 PM, tom fogal wrote:
>
> As I mention below, the main issue is getting a global view of a test
> across a suite of testers.  First of all, each tester is going to name
> the image the same, so if I'm going to upload all of them to a single
> master, I need to mangle the directory names specially, or at least the
> image names.  Secondly, the HTML generated by our test suite is, of
> course, ignorant of the results from the other machines.
>
> To construct a global view, I need some kind of foreach loop over all
> of the builders associated with a particular schedular.  Each iteration
> of the loop needs to pull out the image for *that* builder, which would
> again need to know about the name mangling I did during upload.

The way I have addressed this in the past is this:

Have N build slaves set up for testing, and one build (local to the 
build master) set up for report generation. Then:

1) Pack build-specific test results in a tarball, whose name encodes the 
builder (name).
2) Upload that tarball to the master
3) The "report" slave is triggered by a dependent scheduler, once all 
the test builders have finished their work, and the tarballs are 
uploaded. It detects available tarballs (and from that, the set of test 
runs to include in the report), and does whatever is needed to generate 
the report.

The end result is a global test report (hyperlinked set of HTML, PDF, or 
whatever you want).


Regards,
         Stefan

-- 

       ...ich hab' noch einen Koffer in Berlin...