[Buildbot] #3445: add test configuration that runs random subset of tests in random order
Buildbot trac
trac at buildbot.net
Tue Feb 9 16:42:51 UTC 2016
#3445: add test configuration that runs random subset of tests in random order
----------------------+-------------------
Reporter: rutsky | Owner:
Type: undecided | Status: new
Priority: major | Milestone: 0.9.+
Version: master | Keywords:
----------------------+-------------------
When all tests are run sequentially some subtle issues can be missed, e.g.
https://github.com/buildbot/buildbot/pull/1978
Additional metabbocfg/Travis configuration should be added that will run
random subset of tests in random order.
Dustin says, that `trial` has support such tests run mode.
Also Dustin mentioned, that it would be nice to have control over random
seed, so that these tests would be reproducible.
--
Ticket URL: <http://trac.buildbot.net/ticket/3445>
Buildbot <http://buildbot.net/>
Buildbot: build/test automation
More information about the bugs
mailing list