[users at bb.net] Twisted issue or?

[Francesco Di Mizio]

Turned out to be buildbot_profiler in the docker above... :)

On Fri, Mar 24, 2017 at 2:19 PM, Francesco Di Mizio <
francescodimizio at gmail.com> wrote:

> Hey Pierre,
>
> thanks for answering. I am trying to create a minimal config showing the
> error. Meanwhile here's my full config:
>
> FROM ubuntu:15.10
> MAINTAINER Francesco <>
> LABEL image_name="master"
> LABEL description="test"
>
> RUN apt-get update && apt-get install -y python \
>         python-dev\
>          curl\
>          sudo\
>          python-virtualenv\
>         python-pip\
>         sqlite\
>         wget\
>         python-psycopg2\
>         libmysqlclient-dev
>
> RUN pip install pyvmomi \
>     mysql-python \
>     six==1.10.0 \
>     statprof \
>     service_identity \
>     twisted==15.5.0 \
>     "buildbot[bundle]==0.9.3" \
>     buildbot_profiler \
>     psutil
>
> RUN mkdir -p /buildbot/master
>
> RUN useradd -m -d /buildbot/master -p sa1aY64JOY94w buildbot
> RUN useradd -G adm ubuntu
> RUN chown -R buildbot:buildbot buildbot
>
>
> EXPOSE :8050
> EXPOSE 9989
>
> USER buildbot
>
> RUN cd /buildbot && buildbot create-master master
> WORKDIR /buildbot/master
>
>
> RUN usermod -d /buildbot/master buildbot
> RUN mv /buildbot/master/master.cfg.sample /buildbot/master/master.cfg
>
>
> #ENTRYPOINT ["/buildbot/master/start.sh"]
> # Keep the following line should we need it
> # CMD twistd --savestats -n --profiler=cprofile
>  --profile=/profiling/profile.stats -y ./buildbot.tac
> CMD twistd -n -y ./buildbot.tac
>
>
> where start.sh is simply:
>
> #!/bin/bash
> buildbot upgrade-master /buildbot/master
> echo "$@"
> exec "$@"
>
>
> As for the buildsteps messing with env, it's just not possible as bbot
> doesnt even start.
> As far as I am aware this docker file used to work until recently. My live
> env is in fact still running it...
>
>
> On Thu, Mar 23, 2017 at 1:26 PM, Pierre Tardy <tardyp at gmail.com> wrote:
>
>> Twisted does not upgrade itself, but there might be in your dockerfile
>> some of the command which does.
>> - is there a pip install -U somewhere?
>> - Is there some worker build or master shell command running some pip
>> later in the build, which could overwrite twisted in the middle of buildbot
>> running? If so, you should separate the virtualenv of the master/worker,
>> and the virtualenv of your builds
>>
>> It will be really hard to help without the full dockerfile, or a simplify
>> dockerfile reproducing the problem
>>
>> Regards
>> Pierre
>>
>>
>>
>> On Wed, Mar 22, 2017 at 11:50 AM Francesco Di Mizio <
>> francescodimizio at gmail.com> wrote:
>>
>>> Hey,
>>>
>>> found myself in a strange situation. I do run custom schedulers that
>>> require me to hardcode the twisted version that gets installed in my bbot
>>> server container.
>>>
>>> RUN pip install pyvmomi \
>>>     bla bla .... \
>>>     twisted==15.5.0 \
>>>     "buildbot[bundle]==0.9.3"
>>>
>>> Now somehow I am failing to start it with
>>>
>>>  File "/usr/local/bin/twistd", line 17, in <module>
>>>     from twisted.scripts.twistd import run
>>>   File "/buildbot/master/.local/lib/python2.7/site-packages/twisted/scripts/twistd.py",
>>> line 13, in <module>
>>>     from twisted.application import app
>>>   File "/buildbot/master/.local/lib/python2.7/site-packages/twisted/application/app.py",
>>> line 17, in <module>
>>>     from twisted import copyright, plugin, logger
>>>   File "/buildbot/master/.local/lib/python2.7/site-packages/twisted/plugin.py",
>>> line 35, in <module>
>>>     from twisted.python import log
>>>   File "/buildbot/master/.local/lib/python2.7/site-packages/twisted/python/log.py",
>>> line 26, in <module>
>>>     from twisted.logger import (
>>>   File "/buildbot/master/.local/lib/python2.7/site-packages/twisted/logger/__init__.py",
>>> line 89, in <module>
>>>     from ._levels import InvalidLogLevelError, LogLevel
>>>   File "/buildbot/master/.local/lib/python2.7/site-packages/twisted/logger/_levels.py",
>>> line 9, in <module>
>>>     from constantly import NamedConstant, Names
>>>
>>> Now constantly doesnt exist in the container and never did because in
>>> fact I never needed it.
>>>
>>> It looks like that twisted code being run is not 15.5 I've installed but
>>> a newer version. In particular the following line:
>>>
>>> from constantly import NamedConstant, Names
>>>
>>> was different in 15.5. As a matter of fact
>>>
>>> cat /usr/local/lib/python2.7/dist-packages/twisted/logger/_levels.py |
>>> more
>>> ....
>>> from twisted.python.constants import NamedConstant, Names
>>>
>>>
>>> So where the hell is /buildbot/master/.local/lib/py
>>> thon2.7/site-packages/twisted/logger/_levels.py coming from? Is twisted
>>> auto downloading/extracting latest Twisted itself in that folder?
>>>
>>> Thanks for hte help!
>>>
>>> Francesco
>>>
>>>
>>>
>>>
>>>
>>>
>>> _______________________________________________
>>> users mailing list
>>> users at buildbot.net
>>> https://lists.buildbot.net/mailman/listinfo/users
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.buildbot.net/pipermail/users/attachments/20170327/14bd3dc9/attachment.html>