[Buildbot-devel] stalling when downloading log files ?

[Nathaniel Smith]

On Wed, Jun 22, 2005 at 03:59:35PM -0700, Brian Warner wrote:
> > For example, try getting
> > http://build.fluendo.com:8081/fc2-core-full/builds/70/distcheck/0
> 
> I see that page stalling too. I'd point you at the twisted buildbot, because
> it's at 0.6.6, but its host was upgraded to twisted-2.0.0 recently.
> 
> Do you see a big spike in CPU usage when somebody hits that page and their
> download stalls? I'm wondering if there's some sort of O(n^2) problem biting
> us.
> 
> The logfile delivery code was changed a lot in 0.6.5, making it a bit more
> dependent upon Twisted's Producer/Consumer mechanisms. It's possible that
> there's a bug in twisted-1.3 that got fixed in -2.0 .

Well, _something_ strange seems to be going on; I added 'self.paused =
False' to __init__, and log.msg calls to pauseProducing and
resumeProducing and get:

2005/07/18 17:00 EDT [HTTPChannel,9,66.92.218.83] resumeProducing, self.paused was 0
2005/07/18 17:00 EDT [HTTPChannel,9,66.92.218.83] pauseProducing, self.paused was 0
2005/07/18 17:00 EDT [HTTPChannel,9,66.92.218.83] resumeProducing, self.paused was 1
2005/07/18 17:00 EDT [HTTPChannel,9,66.92.218.83] pauseProducing, self.paused was 0

and that's it; doesn't seem like resumeProducing gets called again.
Maybe that's normal, maybe not...

I can't get ZopeInterface to build at all, so I guess I get to do the
ugly kluge :-).

-- Nathaniel

-- 
So let us espouse a less contested notion of truth and falsehood, even
if it is philosophically debatable (if we listen to philosophers, we
must debate everything, and there would be no end to the discussion).
  -- Serendipities, Umberto Eco