[Buildbot-devel] GitPoller against kernel sources hangs with 0.8.3p1

[Amber Yust]

Right now there's a low enough volume of traffic to buildbot-devel that we
generally just use it for both actual development and -users style
questions.

~Amber

On Sun, Jan 16, 2011 at 1:16 PM, brainstorm <braincode at gmail.com> wrote:

> Thanks for the attention and sorry for the noise guys, now it seems to
> go on with the sell command after git :)
>
> PD: Have you considered on opening a buildbot-users ML ?
>
> On Sun, Jan 16, 2011 at 10:12 PM, brainstorm <braincode at gmail.com> wrote:
> > Ok, I adjusted the shellcommand as follows:
> >
> > factory.addStep(ShellCommand(command=["make", "-j2", "uImage",
> > "modules"], env={'ARCH': 'arm', 'CROSS_COMPILE':
> > 'arm-linux-gnueabi-'}))
> >
> > But still hangs on git with no error messages or progress (even with
> > that flag enabled):
> >
> > (...)
> > 2011-01-16 22:00:54+0100 [-]   argv: ['/usr/bin/git', 'fetch', '-t',
> > 'http://git.gitorious.org/~brainstorm/efikamx/efika-kernel.git',
> > '+master']
> > 2011-01-16 22:00:54+0100 [-]  environment: {'LANG': 'en_US.UTF-8',
> > 'TERM': 'xterm', 'SHELL': '/bin/sh', 'SBCARCH': 'i686',
> > 'SPEECHD_PORT': '6684', 'PWD':
> > '/var/lib/buildbot/romanvg/runtests/source', 'LOGNAME': 'buildbot',
> > 'USER': 'buildbot', 'PATH':
> > '/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games', 'MAIL':
> > '/var/mail/buildbot', 'HOME': '/var/lib/buildbot', 'MODULESHOME':
> > '/usr/lib/modulecmd'}
> > 2011-01-16 22:00:54+0100 [-]   closing stdin
> > 2011-01-16 22:00:54+0100 [-]   using PTY: False
> > 2011-01-16 22:09:41+0100 [-] sending app-level keepalive
> >
> >
> > On Sun, Jan 16, 2011 at 9:46 PM, Amber Yust <ayust at yelp.com> wrote:
> >> I see you're using the progress= flag, which is good - when you say it
> >> 'hangs halfway through', which part of the git clone process is it
> halfway
> >> through, according to the progress messages? File download?
> >> Also, is there a reason you're using ShellCommand(['/bin/bash', ...])
> >> instead of just ShellCommand([...]) ? You can pass an env={} dict to
> >> ShellCommand to set environment variables, you don't need to use bash
> >> interpretation for that.
> >> ~Amber
> >>
> >> On Sun, Jan 16, 2011 at 12:40 PM, brainstorm <braincode at gmail.com>
> wrote:
> >>>
> >>> On Sun, Jan 16, 2011 at 8:29 PM, Dustin J. Mitchell <dustin at v.igoro.us
> >
> >>> wrote:
> >>> > On Sun, Jan 16, 2011 at 9:06 AM, brainstorm <braincode at gmail.com>
> wrote:
> >>> >> Can you please try with this repo URL ?:
> >>> >>
> >>> >> git://gitorious.org/~brainstorm/efikamx/efika-kernel.git
> >>> >>
> >>> >> With "copy" modifier it generates a ".git" repo under
> >>> >> "runtests/source/":
> >>> >
> >>> > I assume you mean mode="copy", which is an argument to the Git
> *step*,
> >>> > not the GitPoller.
> >>>
> >>>
> >>>
> >>>
> >>> Indeed, I apologise for the confusion.
> >>>
> >>>
> >>>
> >>> >> buildbot/runtests# du -hs source/.git/
> >>> >> 608M    source/.git/
> >>> >>
> >>> >> Should'nt it create "source/efika-kernel" dir instead like the plain
> >>> >> "git clone" command does ?. Afterwards, it hangs midway when ~600MB
> of
> >>> >> repo contents have been downloaded. Using the interactive git, the
> >>> >> cloned repository is 914MB in size.
> >>> >
> >>> > It's hard to say without seeing your configuration.
> >>>
> >>>
> >>> The rest of the config is the vanilla one (included in the distro),
> >>> pasting the relevant section:
> >>>
> >>> =======================================
> >>>
> >>> from buildbot.process.factory import BuildFactory
> >>> from buildbot.steps.source import Git
> >>> from buildbot.steps.shell import ShellCommand
> >>>
> >>> factory = BuildFactory()
> >>>
> >>>
> >>> factory.addStep(Git(repourl='
> http://git.gitorious.org/~brainstorm/efikamx/efika-kernel.git',
> >>> mode='copy', progress=True))
> >>> #factory.addStep(ShellCommand(command=["echo", "Success !"]))
> >>>
> >>> factory.addStep(ShellCommand(command=["/bin/bash", '-ex', '-c', r"""
> >>>
> >>> ARCH=arm CROSS_COMPILE=arm-linux-gnueabi- make -j2 uImage modules
> >>>
> >>> """]))
> >>>
> >>> ======================================================
> >>>
> >>>
> >>> >> Then, it times out (1200 seconds) and fails, so no successive
> commands
> >>> >> are executed :-/
> >>> >
> >>> > There is a timeout agument (that was undocumented until about 15
> >>> > seconds ago) to the Git step that you can use to increase this.
> >>> >
> >>> > Dustin
> >>> >
> >>>
> >>>
> >>>
> ------------------------------------------------------------------------------
> >>> Protect Your Site and Customers from Malware Attacks
> >>> Learn about various malware tactics and how to avoid them. Understand
> >>> malware threats, the impact they can have on your business, and how you
> >>> can protect your company and customers by using code signing.
> >>> http://p.sf.net/sfu/oracle-sfdevnl
> >>> _______________________________________________
> >>> Buildbot-devel mailing list
> >>> Buildbot-devel at lists.sourceforge.net
> >>> https://lists.sourceforge.net/lists/listinfo/buildbot-devel
> >>
> >>
> >
>
>
> ------------------------------------------------------------------------------
> Protect Your Site and Customers from Malware Attacks
> Learn about various malware tactics and how to avoid them. Understand
> malware threats, the impact they can have on your business, and how you
> can protect your company and customers by using code signing.
> http://p.sf.net/sfu/oracle-sfdevnl
> _______________________________________________
> Buildbot-devel mailing list
> Buildbot-devel at lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/buildbot-devel
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://buildbot.net/pipermail/devel/attachments/20110116/99906abf/attachment.html>