<div dir="ltr">Turned out to be buildbot_profiler in the docker above... :)</div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Mar 24, 2017 at 2:19 PM, Francesco Di Mizio <span dir="ltr"><<a href="mailto:francescodimizio@gmail.com" target="_blank">francescodimizio@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hey Pierre,<div><br></div><div>thanks for answering. I am trying to create a minimal config showing the error. Meanwhile here's my full config:</div><div><br></div><div><div>FROM ubuntu:15.10</div><div>MAINTAINER Francesco <></div><div>LABEL image_name="master"</div><div>LABEL description="test"</div><div><br></div><div>RUN apt-get update && apt-get install -y python \</div><div> python-dev\</div><div> curl\</div><div> sudo\</div><div> python-virtualenv\</div><div> python-pip\</div><div> sqlite\</div><div> wget\</div><div> python-psycopg2\</div><div> libmysqlclient-dev</div><div> </div><div>RUN pip install pyvmomi \</div><div> mysql-python \</div><div> six==1.10.0 \</div><div> statprof \</div><div> service_identity \</div><div> twisted==15.5.0 \</div><div> "buildbot[bundle]==0.9.3" \</div><div> buildbot_profiler \</div><div> psutil</div><div> </div><div>RUN mkdir -p /buildbot/master</div><div><br></div><div>RUN useradd -m -d /buildbot/master -p sa1aY64JOY94w buildbot</div><div>RUN useradd -G adm ubuntu</div><div>RUN chown -R buildbot:buildbot buildbot</div><div><br></div><div><br></div><div>EXPOSE :8050 </div><div>EXPOSE 9989 </div><div><br></div><div>USER buildbot</div><div><br></div><div>RUN cd /buildbot && buildbot create-master master</div><div>WORKDIR /buildbot/master</div><div><br></div><div><br></div><div>RUN usermod -d /buildbot/master buildbot</div><div>RUN mv /buildbot/master/master.cfg.<wbr>sample /buildbot/master/master.cfg</div><div><br></div><div><br></div><div>#ENTRYPOINT ["/buildbot/master/start.sh"]</div><div># Keep the following line should we need it</div><div># CMD twistd --savestats -n --profiler=cprofile --profile=/profiling/profile.<wbr>stats -y ./buildbot.tac</div><div>CMD twistd -n -y ./buildbot.tac</div></div><div><br></div><div><br></div><div>where start.sh is simply:</div><div><br></div><div><div>#!/bin/bash</div><div>buildbot upgrade-master /buildbot/master<br></div><div>echo "$@"</div><div>exec "$@"</div></div><div><br></div><div><br></div><div>As for the buildsteps messing with env, it's just not possible as bbot doesnt even start.</div><div>As far as I am aware this docker file used to work until recently. My live env is in fact still running it...</div><div><br></div></div><div class="HOEnZb"><div class="h5"><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Mar 23, 2017 at 1:26 PM, Pierre Tardy <span dir="ltr"><<a href="mailto:tardyp@gmail.com" target="_blank">tardyp@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Twisted does not upgrade itself, but there might be in your dockerfile some of the command which does.<div>- is there a pip install -U somewhere?</div><div>- Is there some worker build or master shell command running some pip later in the build, which could overwrite twisted in the middle of buildbot running? If so, you should separate the virtualenv of the master/worker, and the virtualenv of your builds</div><div><br></div><div><div>It will be really hard to help without the full dockerfile, or a simplify dockerfile reproducing the problem</div><div><br></div><div>Regards</div><div>Pierre</div><div><br><div><br></div></div></div></div><br><div class="gmail_quote"><div><div class="m_4556905519900585023h5"><div dir="ltr">On Wed, Mar 22, 2017 at 11:50 AM Francesco Di Mizio <<a href="mailto:francescodimizio@gmail.com" target="_blank">francescodimizio@gmail.com</a>> wrote:<br></div></div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div class="m_4556905519900585023h5"><div dir="ltr" class="m_4556905519900585023m_-5160521130191618970gmail_msg">Hey,<div class="m_4556905519900585023m_-5160521130191618970gmail_msg"><br class="m_4556905519900585023m_-5160521130191618970gmail_msg"></div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg">found myself in a strange situation. I do run custom schedulers that require me to hardcode the twisted version that gets installed in my bbot server container.</div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"><br class="m_4556905519900585023m_-5160521130191618970gmail_msg"></div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"><div class="m_4556905519900585023m_-5160521130191618970gmail_msg">RUN pip install pyvmomi \</div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"> bla bla .... \</div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"> twisted==15.5.0 \</div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"> "buildbot[bundle]==0.9.3"</div></div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"><br class="m_4556905519900585023m_-5160521130191618970gmail_msg"></div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg">Now somehow I am failing to start it with </div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"><br class="m_4556905519900585023m_-5160521130191618970gmail_msg"></div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"> File "/usr/local/bin/twistd", line 17, in <module></div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"> from twisted.scripts.twistd import run</div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"> File "/buildbot/master/.local/lib/p<wbr>ython2.7/site-packages/twisted<wbr>/scripts/twistd.py", line 13, in <module></div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"> from twisted.application import app</div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"> File "/buildbot/master/.local/lib/p<wbr>ython2.7/site-packages/twisted<wbr>/application/app.py", line 17, in <module></div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"> from twisted import copyright, plugin, logger</div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"> File "/buildbot/master/.local/lib/p<wbr>ython2.7/site-packages/twisted<wbr>/plugin.py", line 35, in <module></div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"> from twisted.python import log</div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"> File "/buildbot/master/.local/lib/p<wbr>ython2.7/site-packages/twisted<wbr>/python/log.py", line 26, in <module></div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"> from twisted.logger import (</div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"> File "/buildbot/master/.local/lib/p<wbr>ython2.7/site-packages/twisted<wbr>/logger/__init__.py", line 89, in <module></div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"> from ._levels import InvalidLogLevelError, LogLevel</div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"> File "/buildbot/master/.local/lib/p<wbr>ython2.7/site-packages/twisted<wbr>/logger/_levels.py", line 9, in <module></div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"> from constantly import NamedConstant, Names</div></div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"><br class="m_4556905519900585023m_-5160521130191618970gmail_msg"></div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg">Now constantly doesnt exist in the container and never did because in fact I never needed it.</div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"><br class="m_4556905519900585023m_-5160521130191618970gmail_msg"></div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg">It looks like that twisted code being run is not 15.5 I've installed but a newer version. In particular the following line:</div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"><br class="m_4556905519900585023m_-5160521130191618970gmail_msg"></div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg">from constantly import NamedConstant, Names<br class="m_4556905519900585023m_-5160521130191618970gmail_msg"></div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"><br class="m_4556905519900585023m_-5160521130191618970gmail_msg"></div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg">was different in 15.5. As a matter of fact </div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"><br class="m_4556905519900585023m_-5160521130191618970gmail_msg"></div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"><div class="m_4556905519900585023m_-5160521130191618970gmail_msg">cat /usr/local/lib/python2.7/dist-<wbr>packages/twisted/logger/_level<wbr>s.py | more</div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg">....</div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg">from twisted.python.constants import NamedConstant, Names</div></div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"><br class="m_4556905519900585023m_-5160521130191618970gmail_msg"></div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"><br class="m_4556905519900585023m_-5160521130191618970gmail_msg"></div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg">So where the hell is /buildbot/master/.local/lib/py<wbr>thon2.7/site-packages/twisted/<wbr>logger/_levels.py coming from? Is twisted auto downloading/extracting latest Twisted itself in that folder?</div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"><br class="m_4556905519900585023m_-5160521130191618970gmail_msg"></div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg">Thanks for hte help!</div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"><br class="m_4556905519900585023m_-5160521130191618970gmail_msg"></div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg">Francesco</div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"><br class="m_4556905519900585023m_-5160521130191618970gmail_msg"></div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"><br class="m_4556905519900585023m_-5160521130191618970gmail_msg"></div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"><br class="m_4556905519900585023m_-5160521130191618970gmail_msg"></div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"><br class="m_4556905519900585023m_-5160521130191618970gmail_msg"></div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"><br class="m_4556905519900585023m_-5160521130191618970gmail_msg"></div><div class="m_4556905519900585023m_-5160521130191618970gmail_msg"><br class="m_4556905519900585023m_-5160521130191618970gmail_msg"></div></div></div></div>
______________________________<wbr>_________________<br class="m_4556905519900585023m_-5160521130191618970gmail_msg">
users mailing list<br class="m_4556905519900585023m_-5160521130191618970gmail_msg">
<a href="mailto:users@buildbot.net" class="m_4556905519900585023m_-5160521130191618970gmail_msg" target="_blank">users@buildbot.net</a><br class="m_4556905519900585023m_-5160521130191618970gmail_msg">
<a href="https://lists.buildbot.net/mailman/listinfo/users" rel="noreferrer" class="m_4556905519900585023m_-5160521130191618970gmail_msg" target="_blank">https://lists.buildbot.net/mai<wbr>lman/listinfo/users</a></blockquote></div>
</blockquote></div><br></div>
</div></div></blockquote></div><br></div>