[Buildbot-devel] html.Waterfall robots.txt support patch

[Brian Warner]

> html = html.Waterfall(http_port=8010, favicon="favicon.ico", 
> css="buildbot.css", allowForce=False, robots="robots.txt")
> 
> I hope this is useful and can be integrated into the next release.

I've committed a slightly-modified version of this patch: I renamed the
argument from robots= to robots_txt=, to make it a bit more clear what was
being affected. I was tempted to make it a boolean, or to accept either a
string (filename) or False (disallow all robots), and also to rename it
robots_txt_filename=, but the release is too close and I didn't want to mess
with it too much. When the web-parts code goes in, I'll probably have a
simple flag you can set on the top-level server object to do the
disallow-all-robots thing, and provide a slightly more complicated way to set
up your own custom robots.txt file.

thanks!
 -Brian