[Buildbot-commits] [Buildbot] #1963: FileUpload creates truncated file when buildslave is not on localhost

[Buildbot]

#1963: FileUpload creates truncated file when buildslave is not on localhost
----------------------+-----------------------
Reporter:  landry     |      Owner:
    Type:  undecided  |     Status:  new
Priority:  major      |  Milestone:  undecided
 Version:  0.8.3p1    |   Keywords:
----------------------+-----------------------
 I'm getting a strange issue running a buildbot for mozilla on OpenBSD.

 After a build, i'd like to upload the resulting package from the
 buildslave to the buildmaster, it works fine if the slave (amd64) is
 local, but generates a 14-bytes truncated file if the slave is remote
 (sparc64)

 Here's my master.cfg snippet :
 {{{
     factory.addStep(SetProperty(name="get package name", command="find
 objdir/ -name *.tar.bz2 -exec basename {} \;", property='package_name'))
     factory.addStep(SetProperty(name="get package path", command="find
 objdir/ -name *.tar.bz2", property='package_path'))
 factory.addStep(FileUpload(slavesrc=WithProperties("%(package_path)s"),
 masterdest=
         WithProperties("public_html/builds/%(package_name)s")
     ))

 }}}

 You can see the files here : http://buildbot.rhaalovely.net/builds/

 The buildmaster twistd.log shows nothing strange :
 {{{

 2011-05-15 10:07:24+0200 [-] FileUpload started, from slave
 'objdir/dist/firefox-5.0a2.en-US.openbsd4.9-sparc64.tar.bz2' to master
 'public_html/builds/firefox-5.0a2.en-US
 .openbsd4.9-sparc64.tar.bz2'
 2011-05-15 10:07:24+0200 [-] <buildbot.steps.transfer.StatusRemoteCommand
 instance at 0x20ccc7878>: RemoteCommand.run [1018]
 2011-05-15 10:07:24+0200 [-]
 releaseLocks(<buildbot.steps.transfer.FileUpload instance at
 0x20f197cb0>): []
 2011-05-15 10:07:24+0200 [-]  step 'upload_1' complete: success
 }}}

 But the file is truncated :

 {{{
 # file //var/buildbot/public_html/builds/firefox-5*
 //var/buildbot/public_html/builds/firefox-5.0a2.en-
 US.openbsd4.9-sparc64.tar.bz2: bzip2 compressed data, block size = 900k
 //var/buildbot/public_html/builds/firefox-5.0a2.en-
 US.openbsd4.9-x86_64.tar.bz2:  bzip2 compressed data, block size = 900k
 # ls -l //var/buildbot/public_html/builds/firefox-5*
 -rw-------  1 _buildbot  _buildbot        14 May 15 10:07
 //var/buildbot/public_html/builds/firefox-5.0a2.en-
 US.openbsd4.9-sparc64.tar.bz2
 -rw-------  1 _buildbot  _buildbot  17278587 May 15 05:25
 //var/buildbot/public_html/builds/firefox-5.0a2.en-
 US.openbsd4.9-x86_64.tar.bz2

 #tar tzf /var/buildbot/public_html/builds/firefox-5.0a2.en-
 US.openbsd4.9-sparc64.tar.bz2
 gzip: stdin: unrecognized file format
 tar: End of archive volume 1 reached
 tar: Sorry, unable to determine archive format.

 }}}

 As a detail, 'objdir' path for the SetProperty call on both slaves is a
 symlink. Could it be related ? Or arch-related ?

 {{{
 # ls -l /var/buildslave/mozilla-aurora-sparc64/build/objdir
 lrwxrwxrwx  1 root  _buildslave  30 May  7 13:12 /var/buildslave/mozilla-
 aurora-sparc64/build/objdir -> obj-sparc64-unknown-openbsd4.9
 }}}

 How can i debug that issue ?

-- 
Ticket URL: <http://trac.buildbot.net/ticket/1963>
Buildbot <http://buildbot.net/>
Buildbot: build/test automation