[Buildbot-devel] Few buildbot improvements

exarkun at twistedmatrix.com exarkun at twistedmatrix.com
Sun Apr 11 02:55:46 UTC 2010


On 10 Apr, 09:39 pm, macke at yar.nu wrote:
>[snip]
>
>I'd love to see some Comet[1]-stuff (which is the common name for 
>server
>-> client HTTP push tech) for these things, but that probably requires
>Orbited[2] or something. (Unless there's something neat for twisted, 
>not
>sure..)

That would be Athena.  http://divmod.org/trac/wiki/DivmodNevow/Athena

However, for some reason, BuildBot has always shied away from a Nevow 
dependency.

Jean-Paul
>
>My BuildbotIcon does a lot of polling too, and our developer-intranet
>page has 5 buildmasters which are polled every 10-15 secs (to show on
>the public screen). This polling adds up time.
>
>Adding caching of HTML inside buildbot would've been cool, but I'm not
>too familiar with buildbot's internals and good cache invalidation
>strategies (which is Hard (tm) see quote[3]).

A really good first start to this would just be figuring out when 
caching might help.  This just involves looking at the data at hand and 
figuring out how to decide if a cache might be valid or not.  A good 
next step is just to set caching headers that reflect this.  This will 
already give you something that will interact well with any reasonable 
caching proxy, of which there are many.  As a final step, actually 
avoiding the redundant html generation in buildbot itself will help 
anyone who can't actually set up a caching proxy.

Jean-Paul




More information about the devel mailing list