[Buildbot-commits] buildbot ChangeLog, 1.919, 1.920 setup.py, 1.44, 1.45

[Brian Warner]

Update of /cvsroot/buildbot/buildbot
In directory sc8-pr-cvs3.sourceforge.net:/tmp/cvs-serv4077

Modified Files:
	ChangeLog setup.py 
Log Message:
[project @ webstatus: ship a robots.txt which discourages access to all large dynamically-generated pages]

Original author: warner at lothar.com
Date: 2007-08-13 17:16:21+00:00

Index: ChangeLog
===================================================================
RCS file: /cvsroot/buildbot/buildbot/ChangeLog,v
retrieving revision 1.919
retrieving revision 1.920
diff -u -d -r1.919 -r1.920
--- ChangeLog	13 Aug 2007 08:20:51 -0000	1.919
+++ ChangeLog	13 Aug 2007 17:22:44 -0000	1.920
@@ -1,5 +1,13 @@
 2007-08-13  Brian Warner  <warner at lothar.com>
 
+	* buildbot/status/web/robots.txt: put a robots.txt in new installs
+	which discourages robot access to all large dynamically-generated
+	pages. The intention is that the index page and the 'about' page
+	are the only ones which should be crawlable.
+	* buildbot/scripts/runner.py (Maker.public_html): same
+	(createMaster): same
+	* setup.py: ship index.html and robots.txt in source distributions
+
 	* buildbot/status/web/waterfall.py: add 'refresh' query arg, to
 	activate automatic reloading of the page (using a meta Refresh:
 	tag). Closes #69.

Index: setup.py
===================================================================
RCS file: /cvsroot/buildbot/buildbot/setup.py,v
retrieving revision 1.44
retrieving revision 1.45
diff -u -d -r1.44 -r1.45
--- setup.py	17 Apr 2007 06:38:49 -0000	1.44
+++ setup.py	13 Aug 2007 17:22:44 -0000	1.45
@@ -75,7 +75,11 @@
                 ],
       data_files=[("buildbot", ["buildbot/buildbot.png"]),
                   ("buildbot/clients", ["buildbot/clients/debug.glade"]),
-                  ("buildbot/status/web", ["buildbot/status/web/classic.css"]),
+                  ("buildbot/status/web",
+                   ["buildbot/status/web/classic.css",
+                    "buildbot/status/web/index.html",
+                    "buildbot/status/web/robots.txt",
+                    ]),
                   ("buildbot/scripts", ["buildbot/scripts/sample.cfg"]),
                   ("buildbot/test/mail", testmsgs),
                   ("buildbot/test/subdir", ["buildbot/test/subdir/emit.py"]),