[Buildbot] #3445: add test configuration that runs random subset of tests in random order

Buildbot trac trac at buildbot.net
Tue Feb 9 16:42:51 UTC 2016


#3445: add test configuration that runs random subset of tests in random order
----------------------+-------------------
Reporter:  rutsky     |      Owner:
    Type:  undecided  |     Status:  new
Priority:  major      |  Milestone:  0.9.+
 Version:  master     |   Keywords:
----------------------+-------------------
 When all tests are run sequentially some subtle issues can be missed, e.g.
 https://github.com/buildbot/buildbot/pull/1978

 Additional metabbocfg/Travis configuration should be added that will run
 random subset of tests in random order.

 Dustin says, that `trial` has support such tests run mode.
 Also Dustin mentioned, that it would be nice to have control over random
 seed, so that these tests would be reproducible.

--
Ticket URL: <http://trac.buildbot.net/ticket/3445>
Buildbot <http://buildbot.net/>
Buildbot: build/test automation


More information about the bugs mailing list