I wrote a buildstep to parse output from our ruby testrunner. It should be useful to anyone else using the Test::Unit::UI::Console runner. http://buildbot.net/trac/wiki/RubyTestUnitStep