[Buildbot-devel] Developing a S3UploadFile buildstep

[Gianluca Sforna]

Hi all,
I am trying to develop a S3FileUpload step, and right now the code is
largely based on the existing FileUpload step, just replacing the real
file creation in the _FileWriter class with a temporary file created
with os.tmpfile() ( see http://pastie.org/821970 for some code ). The
idea is to upload this temporary to S3 using the great python-boot
library we already depend on for the latent buildslave stuff.

Now my issue; if I attempt to use the S3FileUpload class in a factory,
it seems to work properly for smaller files, but when feeding it with
a larger one (about 10Mb) I see the following messages in the slave's
twistd.log:

2010/02/12 17:07 +0200 [Broker,client]
SlaveFileUploadCommand._writeBlock(): allowed=16384 readlen=9754
2010/02/12 17:07 +0200 [Broker,client]
SlaveFileUploadCommand._writeBlock(): allowed=16384 readlen=0
2010/02/12 17:07 +0200 [Broker,client] Unhandled error in Deferred:

And then the build never completes (neither with success or failed status).

I do really hope someone here has an idea about where to look, because
I'm a bit confused about how to diagnose the issue.

Thanks in advance

Gianluca

-- 
Gianluca Sforna

http://morefedora.blogspot.com
http://www.linkedin.com/in/gianlucasforna