[Buildbot-devel] My mistake in ShellCommand [?]

Amber Yust ayust at yelp.com
Thu May 19 15:51:34 UTC 2011


Things like < are a shell functionality; passing them via the
  ['bsub', '<', 'pragmatic_make_test_intel.q']
 list command syntax won't work.

Instead, you'll need to run them inside an actual shell, using the "bsub <
pragmatic_make_test_intel.q" syntax.

~Amber

On Thu, May 19, 2011 at 7:59 AM, Mark Richardson (Internal) <
mark.richardson at nag.co.uk> wrote:

> Hi all,
>
> [builder at openpetascale NightlyOPL]$ buildbot --version
> Buildbot version: 0.8.2
> Twisted version: 10.2.0
> (OPSlave)[OPLbuilder at opl pragmatic]$ buildslave --version
> Buildslave version: 0.8.2
> Twisted version: 10.2.0
>
> I wonder if I made a mistake in this shell command because the command
> fails when issued through the factory step ShellCommand but is okay
> interactive. from the twistd.log:
>
> > 2011-05-19 15:43:34+0100 [-]
> ShellCommand.startCommand(cmd=<RemoteShellCommand '['bsub', '<',
> 'pragmatic_make_test_intel.q']'>)
> > 2011-05-19 15:43:34+0100 [-]   cmd.args = {'workdir': 'build/pragmatic',
> 'env': None, 'want_stderr': 1, 'logfiles': {}, 'logEnviron': True,
> 'timeout': 1200, 'want_stdout': 1, 'usePTY': 'slave-config', 'maxTime':
> None}
> > 2011-05-19 15:43:34+0100 [-] <RemoteShellCommand '['bsub', '<',
> 'pragmatic_make_test_intel.q']'>: RemoteCommand.run [4]
> > 2011-05-19 15:43:34+0100 [-] command '['bsub', '<',
> 'pragmatic_make_test_intel.q']' in dir 'build/pragmatic'
> > 2011-05-19 15:43:34+0100 [-] LoggedRemoteCommand.start
> > 2011-05-19 15:43:34+0100 [Broker,0,XXX.XXX.XXX.XXX] <RemoteShellCommand
> '['bsub', '<', 'pragmatic_make_test_intel.q']'> rc=255
> > 2011-05-19 15:43:34+0100 [-] closing log <buildbot.status.builder.LogFile
> instance at 0x1e8426c8>
> > 2011-05-19 15:43:34+0100 [-]
> releaseLocks(<buildbot.steps.shell.ShellCommand instance at 0x1e8297e8>): []
> > 2011-05-19 15:43:34+0100 [-]  step 'shell_3' complete: failure
>
> the interactive command is:
>   bsub < pragmatic_make_test_intel.q
>
> and submits the tests to a queue on a HPC development machine. The
> queue system is Platform Lava (LSF). I follow this with q monitoring,
>  if the original command had worked (!).
>
> BTW this is from master.cfg
> > f_pragmatic_intel.addStep(
> ShellCommand(command=["cp","-p","tools/pragmatic_make_test_intel.q","pragmatic/"]
> ) )
> > f_pragmatic_intel.addStep(
> ShellCommand(command=["./configure"],workdir="build/pragmatic") )
> > f_pragmatic_intel.addStep(
> ShellCommand(command=["chmod","u+x","pragmatic_make_test_intel.q"],
> workdir="build/pragmatic") )
> > f_pragmatic_intel.addStep(
> ShellCommand(command=["bsub","<","pragmatic_make_test_intel.q"],
> workdir="build/pragmatic") )
> > f_pragmatic_intel.addStep( ShellCommand(command=["ls"],
> workdir="build/pragmatic") )
>
> thanks for any insights,
>
> Mark
>
> ________________________________________________________________________
> The Numerical Algorithms Group Ltd is a company registered in England
> and Wales with company number 1249803. The registered office is:
> Wilkinson House, Jordan Hill Road, Oxford OX2 8DR, United Kingdom.
>
> This e-mail has been scanned for all viruses by Star. The service is
> powered by MessageLabs.
> ________________________________________________________________________
>
>
> ------------------------------------------------------------------------------
> What Every C/C++ and Fortran developer Should Know!
> Read this article and learn how Intel has extended the reach of its
> next-generation tools to help Windows* and Linux* C/C++ and Fortran
> developers boost performance applications - including clusters.
> http://p.sf.net/sfu/intel-dev2devmay
> _______________________________________________
> Buildbot-devel mailing list
> Buildbot-devel at lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/buildbot-devel
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://buildbot.net/pipermail/devel/attachments/20110519/39cb705a/attachment.html>


More information about the devel mailing list