[Buildbot-devel] Acceptable dependency versions for patches?
exarkun at divmod.com
Sat Sep 15 13:40:34 UTC 2007
On Fri, 14 Sep 2007 17:39:26 -0500, "Dustin J. Mitchell" <dustin at zmanda.com> wrote:
>On 9/14/07, David Bolen <db3l.net at gmail.com> wrote:
>> * File uploading, which breaks down for large files due to chaining
>> all the deferreds for every block of the file, which if the file is
>> large enough will blow up by exceeding Python's recursion limit as
>> the chain is processed (not to mention using more memory). I've
>> switched this to a generator based approach. (I haven't patched
>> downloading, but it has the same potential issue)
>Generators should be safe. You could alternately "break" the call
>chain periodically by scheduling a timer with duration 0.
You can also break the call chain like this (untested):
overallResult = Deferred()
oneResult = processOne(listOfStuff.pop())
The advantage of this approach over using callLater is primarily
that it is simpler to test.
More information about the devel