[Buildbot-devel] Compressing build logs, input wanted

[Marcus Lindblom]

Axel Hecht wrote:
> 2009/1/20 Marcus Lindblom <macke at yar.nu 
> <mailto:macke at yar.nu>>
> 
>     Axel Hecht wrote:
>      > Hi all,
>      >
>      > I just pushed a git branch,
>      > http://github.com/Pike/buildbot/commits/bug26, to compress logs
>      > post-facto with bz2.

[snip]

>      > I'd like to know what others would expect, and who's relying on
>     what in
>      > the logfiles.

[snip]

>     However, wouldn't it make more sense to gzip them, so that they could be
>     sent in compressed format directly to browsers that accepted gzip
>     format?
> 
> Not so much as most users look at the HTML formatted output of the logs, 
> and those need to get the html wraps fed upfront, and of course you 
> wouldn't be able to just compress the logfile, but you had to compress 
> the logs inside the channels, which is going to be harder.
> 
> And you can't just update the master dir by compressing the logfiles 
> manually, which some folks might want to do.

Right. I forgot about the colorization and the separation of raw logs vs 
formatted logs.

>     I'd also wish for pluggable compression (so that I could use 7z, which
>     is fast and I like it :)
>  
> The downside of pluggable compression would be that you'd have to try 
> all compression modes on reading logs, and on hasContent etc.

True. Misconception slightly related to the previous pargraph.

/Marcus