[Buildbot-devel] svn:externals and update mode

[tom fogal]

I've got a repository with two svn:externals setup, and see frequent
problems with it using an SVN(mode="update") step to update it.  This
is on Linux (svn version: 1.6.5).

One of the :externals should be checked out into a directory named
"IO".  When I see the issue, the `svn update' step prints out:

  Fetching external item into 'IO'
  svn: warning: 'IO' is not a working copy

The first line is stdout and the latter is stderr.

The bbot config line is:

  tvk.addStep(SVN(svnurl=tuvok_root,
                  mode="update",
                  always_purge=True,
                  alwaysUseLatest=True))

I can ssh to the slave and rm -fr the IO directory, and all is well
afterwards.  When I do that, the directory is mysteriously empty, sans
files and directories which could conceivably be autogenerated (i.e.
"Makefile"s and the like).

For the builds which work, it seems that both the :externals do not
exist; the `svn update' causes "A"dds for every file from those two
repositories.

I use the same build factory for OS X.  On that platform, every other
build works.  Just like Linux, when it works it "A"dds every file from
the subrepositories.  However, when it does fail, I get the output I
appended to this email.

Linux slave is 0.7.12 and svn version 1.6.5.  OS X slave is 0.8.1.
OS X svn is 1.6.1.  Master is 0.8.1p1.  The server is world-facing
&& I don't mind giving out the URL, but I don't want to post it on a
public/archived list; ask and I'll followup privately.

Ideas?

-tom

----- os x slave output ----
(view as text)

starting svn operation
/Users/tfogal/thehost-obfuscated/bin/svn status --non-interactive --no-auth-cache --xml --no-ignore
 in dir /Users/tfogal/slaves/iv3d/tvk-osx-10.6-x86/build (timeout 1200 secs)
 watching logfiles {}
 argv: ['/Users/tfogal/thehost-obfuscated/bin/svn', 'status', '--non-interactive', '--no-auth-cache', '--xml', '--no-ignore']
 environment:
  HOME=/Users/tfogal
  LC_MESSAGES=C
  PATH=/opt/local/bin:/opt/local/sbin:/Users/tfogal/thehost-obfuscated/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/bin:/usr/texbin:/usr/X11/bin:~/sw/bin
  PWD=/Users/tfogal/slaves/iv3d/tvk-osx-10.6-x86/build
  PYTHONPATH=:/Users/tfogal/thehost-obfuscated/lib64/python2.6/site-packages:/Users/tfogal/thehost-obfuscated/lib/python2.6/site-packages::/Users/tfogal/thehost-obfuscated/lib64/python2.6/site-packages:/Users/tfogal/thehost-obfuscated/lib/python2.6/site-packages
  VERSIONER_PYTHON_PREFER_32_BIT=no
  VERSIONER_PYTHON_VERSION=2.6
  __CF_USER_TEXT_ENCODING=0x1F6:0:3
 closing stdin
 using PTY: False
elapsedTime=0.954975
/Users/tfogal/slaves/iv3d/tvk-osx-10.6-x86/build/Makefile.tvk
/Users/tfogal/slaves/iv3d/tvk-osx-10.6-x86/build/Basics
/Users/tfogal/slaves/iv3d/tvk-osx-10.6-x86/build/IO
/Users/tfogal/slaves/iv3d/tvk-osx-10.6-x86/build/Makefile
/Users/tfogal/slaves/iv3d/tvk-osx-10.6-x86/build/Build/objects
/Users/tfogal/slaves/iv3d/tvk-osx-10.6-x86/build/Build/libTuvok.prl
/Users/tfogal/slaves/iv3d/tvk-osx-10.6-x86/build/Build/libTuvok.a
/Users/tfogal/slaves/iv3d/tvk-osx-10.6-x86/build/IO/expressions/Makefile.libexpr

remoteFailed: [Failure instance: Traceback from remote host -- Traceback (most recent call last):
  File "build/bdist.macosx-10.6-universal/egg/buildslave/commands/base.py", line 169, in processEnded
    
  File "build/bdist.macosx-10.6-universal/egg/buildslave/commands/base.py", line 703, in finished
    
  File "/Users/tfogal/sw/lib/python2.6/site-packages/Twisted-8.2.0-py2.6-macosx-10.6-universal.egg/twisted/internet/defer.py", line 243, in callback
    self._startRunCallbacks(result)
  File "/Users/tfogal/sw/lib/python2.6/site-packages/Twisted-8.2.0-py2.6-macosx-10.6-universal.egg/twisted/internet/defer.py", line 312, in _startRunCallbacks
    self._runCallbacks()
--- <exception caught here> ---
  File "/Users/tfogal/sw/lib/python2.6/site-packages/Twisted-8.2.0-py2.6-macosx-10.6-universal.egg/twisted/internet/defer.py", line 328, in _runCallbacks
    self.result = callback(self.result, *args, **kw)
  File "build/bdist.macosx-10.6-universal/egg/buildslave/commands/vcs.py", line 672, in _purgeAndUpdate2
    
  File "/System/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/shutil.py", line 208, in rmtree
    onerror(os.listdir, path, sys.exc_info())
  File "/System/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/shutil.py", line 206, in rmtree
    names = os.listdir(path)
exceptions.OSError: [Errno 2] No such file or directory: '/Users/tfogal/slaves/iv3d/tvk-osx-10.6-x86/build/IO/expressions/Makefile.libexpr'
]


----- os x slave output ----