<div dir="ltr">I think at that point I would start thinking about swapping network cables.. :)<div><br></div></div><br><div class="gmail_quote"><div dir="ltr">On Fri, Jun 30, 2017 at 10:32 AM Colin Chargy <<a href="mailto:Colin.Chargy@bentley.com">Colin.Chargy@bentley.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div lang="EN-US" link="blue" vlink="purple"><div class="m_5015667870317741764WordSection1">
<p class="MsoNormal">Hi Jim,<u></u><u></u></p>
<p class="MsoNormal">Thanks for the input.<u></u><u></u></p>
</div></div><div lang="EN-US" link="blue" vlink="purple"><div class="m_5015667870317741764WordSection1"><p class="MsoNormal">I did copy the save folder from slave to slave.<u></u><u></u></p>
<p class="MsoNormal">I did try to reboot the slave with no luck.<u></u><u></u></p>
<p class="MsoNormal">I don’t know the details about the network. We do have an IT team to handle it. All other slaves are with the same network setup.<u></u><u></u></p>
<p class="MsoNormal">I don’t know any other software running on the computer.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Except TCDdump/Wireshark, anyone knows another way to debug that ? Does buildbot or twisted has a verbose mode ?<u></u><u></u></p>
<p class="MsoNormal">I’m gonna try to open a direct ssh port forwarding tunnel between the master and the slave to see if that changes anything (might help us to understand the cause of the issue). I keep you posted.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Regards,<u></u><u></u></p>
<p class="MsoNormal">Colin Chargy<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div style="border:none;border-top:solid #e1e1e1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"></p></div></div></div></div><div lang="EN-US" link="blue" vlink="purple"><div class="m_5015667870317741764WordSection1"><div><div style="border:none;border-top:solid #e1e1e1 1.0pt;padding:3.0pt 0in 0in 0in"><p class="MsoNormal"><b>From:</b> Jim Rowan [mailto:<a href="mailto:jmr@computing.com" target="_blank">jmr@computing.com</a>] <br>
</p></div></div></div></div><div lang="EN-US" link="blue" vlink="purple"><div class="m_5015667870317741764WordSection1"><div><div style="border:none;border-top:solid #e1e1e1 1.0pt;padding:3.0pt 0in 0in 0in"><p class="MsoNormal"><b>Sent:</b> Friday, June 23, 2017 19:54</p></div></div></div></div><div lang="EN-US" link="blue" vlink="purple"><div class="m_5015667870317741764WordSection1"><div><div style="border:none;border-top:solid #e1e1e1 1.0pt;padding:3.0pt 0in 0in 0in"><p class="MsoNormal"><br>
<b>To:</b> Colin Chargy <<a href="mailto:Colin.Chargy@bentley.com" target="_blank">Colin.Chargy@bentley.com</a>><br>
<b>Cc:</b> <a href="mailto:users@buildbot.net" target="_blank">users@buildbot.net</a><br>
<b>Subject:</b> Re: [<a href="mailto:users@bb.net" target="_blank">users@bb.net</a>] Issue connecting slave to master<u></u><u></u></p></div></div></div></div><div lang="EN-US" link="blue" vlink="purple"><div class="m_5015667870317741764WordSection1">
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">hmmm. :). Some thoughts/questions interleaved below:<u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<p class="MsoNormal">On Jun 22, 2017, at 10:06 AM, Colin Chargy <<a href="mailto:Colin.Chargy@bentley.com" target="_blank">Colin.Chargy@bentley.com</a>> wrote:<u></u><u></u></p>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<p class="MsoNormal">Hi Jim,<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Thanks for the input. I tested what you suggested. The same slave folder on another computer wworks fine and another slave folder (from another computer) on this one doesn’t work.<u></u><u></u></p>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<p class="MsoNormal">I’m not positive what you’re saying — I think what you did above was to copy the actual slave folders in question from machine to machine, and then try to start them up? If so, that’s fine … just trying to fully understand. <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">In both of the tests you mention above, are the slaves talking to the “second” master — the one that doesn’t work?<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">If so, I think that pretty much proves that it’s something about *this machine*, and seems to me to be almost certainly external to buildbot.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">I have a few somewhat-wild-guess things to look at:<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">1.) If you haven’t already, reboot the slave.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">2.) I notice the slave's address is 192.168.0.254 and the master’s address is 192.168.0.1. Assuming a /24 network, those are by convention both a bit special — people might configure either one of them as gateways to other subnets.
Although that isn’t technically a problem, it makes me suspicious. Is this indeed on a /24 subnet? Are you sure that no other system is using these addresses? Do both machines have the correct subnet mask? (Some of these might be answered by your tcpdump
file, but I didn’t crack it open..)<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">3.) Is there some other software running on this particular slave machine that makes it unusual compared to the others?<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">For grins, don’t start anything else after a reboot, and just try to run this one slave. (By hand, if you are normally starting it as a service.)<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><br>
<br>
<u></u><u></u></p>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">I’m assuming that both slaves on that machine are sharing the same python installation, and therefore the same buildslave code? So the only thing unique is the actual slavedir and the name/password? <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Yes<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">And the master that it’s talking to has other working slaves on different machines?<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Yes, plenty and no one has thoses issues.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Any other idea ?<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Regards,<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Colin Chargy<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<div style="border:none;border-top:solid #e1e1e1 1.0pt;padding:3.0pt 0in 0in 0in">
<div>
<p class="MsoNormal"><b>From:</b><span class="m_5015667870317741764apple-converted-space"> </span>Jim Rowan [<a href="mailto:jmr@computing.com" target="_blank"><span style="color:purple">mailto:jmr@computing.com</span></a>]<span class="m_5015667870317741764apple-converted-space"> </span><br>
<b>Sent:</b><span class="m_5015667870317741764apple-converted-space"> </span>Tuesday, June 20, 2017 21:35<br>
<b>To:</b><span class="m_5015667870317741764apple-converted-space"> </span>Colin Chargy <<a href="mailto:Colin.Chargy@bentley.com" target="_blank"><span style="color:purple">Colin.Chargy@bentley.com</span></a>><br>
<b>Cc:</b><span class="m_5015667870317741764apple-converted-space"> </span><a href="mailto:users@buildbot.net" target="_blank"><span style="color:purple">users@buildbot.net</span></a><br>
<b>Subject:</b><span class="m_5015667870317741764apple-converted-space"> </span>Re: [<a href="mailto:users@bb.net" target="_blank"><span style="color:purple">users@bb.net</span></a>] Issue connecting slave to master<u></u><u></u></p>
</div>
</div>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">Wow .. so it’s apparently something specific to this particular slave on this particular machine, or the tuple of those with the particular master. Have you tried instantiating and starting the slave on a different windows 10 machine?
Or changing buildslave.tac to use a different (and working) slavename that is defined on that same master? (I think you said you did test this.). <u></u><u></u></p>
</div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">I’m assuming that both slaves on that machine are sharing the same python installation, and therefore the same buildslave code? So the only thing unique is the actual slavedir and the name/password? <u></u><u></u></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">And the master that it’s talking to has other working slaves on different machines?<u></u><u></u></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal">On Jun 20, 2017, at 10:13 AM, Colin Chargy <<a href="mailto:Colin.Chargy@bentley.com" target="_blank"><span style="color:purple">Colin.Chargy@bentley.com</span></a>> wrote:<u></u><u></u></p>
</div>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<div>
<div>
<p class="MsoNormal">Hi,<u></u><u></u></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">Thanks for your input. It doesn’t change anything.<span class="m_5015667870317741764apple-converted-space"> </span><span style="font-family:"Segoe UI Emoji",sans-serif">☹</span><u></u><u></u></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">Best regards,<u></u><u></u></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">Colin Chargy<u></u><u></u></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
<div>
<div style="border:none;border-top:solid #e1e1e1 1.0pt;padding:3.0pt 0in 0in 0in">
<div>
<div>
<p class="MsoNormal"><b>From:</b><span class="m_5015667870317741764apple-converted-space"> </span>Jim Rowan [<a href="mailto:jmr@computing.com" target="_blank"><span style="color:purple">mailto:jmr@computing.com</span></a>]<span class="m_5015667870317741764apple-converted-space"> </span><br>
<b>Sent:</b><span class="m_5015667870317741764apple-converted-space"> </span>Tuesday, June 20, 2017 17:11<br>
<b>To:</b><span class="m_5015667870317741764apple-converted-space"> </span>Colin Chargy <<a href="mailto:Colin.Chargy@bentley.com" target="_blank"><span style="color:purple">Colin.Chargy@bentley.com</span></a>><br>
<b>Cc:</b><span class="m_5015667870317741764apple-converted-space"> </span>Pierre Tardy <<a href="mailto:tardyp@gmail.com" target="_blank"><span style="color:purple">tardyp@gmail.com</span></a>>;<span class="m_5015667870317741764apple-converted-space"> </span><a href="mailto:users@buildbot.net" target="_blank"><span style="color:purple">users@buildbot.net</span></a><br>
<b>Subject:</b><span class="m_5015667870317741764apple-converted-space"> </span>Re: [<a href="mailto:users@bb.net" target="_blank"><span style="color:purple">users@bb.net</span></a>] Issue connecting slave to master<u></u><u></u></p>
</div>
</div>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">It’s a bit of a wild guess, but what happens if you stop the second (working) slave that is on the same machine before trying to start this one?<u></u><u></u></p>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
<div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<div>
<div>
<p class="MsoNormal">On Jun 20, 2017, at 8:10 AM, Colin Chargy <<a href="mailto:Colin.Chargy@bentley.com" target="_blank"><span style="color:purple">Colin.Chargy@bentley.com</span></a>> wrote:<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal">Hi Pierre,<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal">I tried with the following version :<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"><span lang="FR">$ buildslave --version</span><u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"><span lang="FR">Buildslave version: 0.8.8</span><u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"><span lang="FR">Twisted version: 12.3.0</span><u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"><span lang="FR"> </span><u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal">It’s now the exact same of the master and the behavior continues…<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal">Anything else I could try ?<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal">I’ll ask the admin of the server to update twisted.<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal">Best regards,<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal">Colin Chargy<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"><b>From:</b><span class="m_5015667870317741764apple-converted-space"> </span>Pierre Tardy [<a href="mailto:tardyp@gmail.com" target="_blank"><span style="color:purple">mailto:tardyp@gmail.com</span></a>]<span class="m_5015667870317741764apple-converted-space"> </span><br>
<b>Sent:</b><span class="m_5015667870317741764apple-converted-space"> </span>Tuesday, June 20, 2017 15:02<br>
<b>To:</b><span class="m_5015667870317741764apple-converted-space"> </span>Colin Chargy <<a href="mailto:Colin.Chargy@bentley.com" target="_blank"><span style="color:purple">Colin.Chargy@bentley.com</span></a>>;<span class="m_5015667870317741764apple-converted-space"> </span><a href="mailto:users@buildbot.net" target="_blank"><span style="color:purple">users@buildbot.net</span></a><br>
<b>Subject:</b><span class="m_5015667870317741764apple-converted-space"> </span>Re: [<a href="mailto:users@bb.net" target="_blank"><span style="color:purple">users@bb.net</span></a>] FW: Issue connecting slave to master<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal">Oh, I did not realize the very old twisted version. you can try to downgrade on the worker indeed.<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal">I see no reason not to upgrade twisted on master, though<u></u><u></u></p>
</div>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal">Pierre<u></u><u></u></p>
</div>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal">On Tue, Jun 20, 2017 at 2:45 PM Colin Chargy <<a href="mailto:Colin.Chargy@bentley.com" target="_blank"><span style="color:purple">Colin.Chargy@bentley.com</span></a>> wrote:<u></u><u></u></p>
</div>
</div>
</div>
</div>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt">
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal">Hi Pierre,<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal">I tested what you suggested :<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal">$ buildslave --version<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal">Buildslave version: 0.8.8<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal">Twisted version: 17.5.0<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal">This does not change the behavior. Should I test with another twisted version ?<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal">Regards,<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal">Colin<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"><b>From:</b><span class="m_5015667870317741764apple-converted-space"> </span>Pierre Tardy [mailto:<a href="mailto:tardyp@gmail.com" target="_blank"><span style="color:purple">tardyp@gmail.com</span></a>]<u></u><u></u></p>
</div>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"><b>Sent:</b><span class="m_5015667870317741764apple-converted-space"> </span>Tuesday, June 20, 2017 14:15<u></u><u></u></p>
</div>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"><br>
<b>To:</b><span class="m_5015667870317741764apple-converted-space"> </span>Colin Chargy <<a href="mailto:Colin.Chargy@bentley.com" target="_blank"><span style="color:purple">Colin.Chargy@bentley.com</span></a>>;<span class="m_5015667870317741764apple-converted-space"> </span><a href="mailto:users@buildbot.net" target="_blank"><span style="color:purple">users@buildbot.net</span></a><br>
<b>Subject:</b><span class="m_5015667870317741764apple-converted-space"> </span>Re: [<a href="mailto:users@bb.net" target="_blank"><span style="color:purple">users@bb.net</span></a>] FW: Issue connecting slave to master<u></u><u></u></p>
</div>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal">Colin,<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal">Its a bit harder to me to efficiently help you as 0.8.8 is quite an old version. I imagine upgrading is not an option..<u></u><u></u></p>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal">it might be an incompatibility of the slave version string. We usually try to maintain compatibility for new master version to old slave version, but we might not always take care of supporting running new slaves with older master.<u></u><u></u></p>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal">Did you try downgrading your slave version to 0.8.8?<u></u><u></u></p>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal">Pierre<u></u><u></u></p>
</div>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal">On Tue, Jun 20, 2017 at 11:53 AM Colin Chargy <<a href="mailto:Colin.Chargy@bentley.com" target="_blank"><span style="color:purple">Colin.Chargy@bentley.com</span></a>> wrote:<u></u><u></u></p>
</div>
</div>
</div>
</div>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt">
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal">Hi Pierre,<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal">Thanks for your reply.<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal">Indeed, I’ve seen in the failedToGetPerspective doc that it could fail with a wrong login password. However, the slave name and password seems correct (ie the same on the slave .toc file and on the server config). We also tested multiple
login/password couple to see if that changes anything (with no luck). The TCP dump seems to show that the last things which are sent are the host name and slave info which are the default one (I tried modify them with no luck). What happen after/inside failedToGetPerspective
? Does the connection changes port/connection/setting or anything else at this point ?<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal">I should probably add about info our set up : the server runs 2 buildbot masters and the slave computer also 2 buildbot slave (one for each master). We do have other computer that work that way without any problem. Of course, we checked
that each slave is connecting to the correct master. Only one of the slave/master couple fails (and as already said, only on this computer).<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal">Best regards,<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal">Colin Chargy<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"><b>From:</b><span class="m_5015667870317741764apple-converted-space"> </span>Pierre Tardy [mailto:<a href="mailto:tardyp@gmail.com" target="_blank"><span style="color:purple">tardyp@gmail.com</span></a>]<span class="m_5015667870317741764apple-converted-space"> </span><br>
<b>Sent:</b><span class="m_5015667870317741764apple-converted-space"> </span>Tuesday, June 20, 2017 11:41<br>
<b>To:</b><span class="m_5015667870317741764apple-converted-space"> </span>Colin Chargy <<a href="mailto:Colin.Chargy@bentley.com" target="_blank"><span style="color:purple">Colin.Chargy@bentley.com</span></a>>;<span class="m_5015667870317741764apple-converted-space"> </span><a href="mailto:users@buildbot.net" target="_blank"><span style="color:purple">users@buildbot.net</span></a><br>
<b>Subject:</b><span class="m_5015667870317741764apple-converted-space"> </span>Re: [<a href="mailto:users@bb.net" target="_blank"><span style="color:purple">users@bb.net</span></a>] FW: Issue connecting slave to master<u></u><u></u></p>
</div>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal">Hi Colin<u></u><u></u></p>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal">Could that be a problem with your slave password?<u></u><u></u></p>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"> def failedToGetPerspective(self, why):<u></u><u></u></p>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"> """The login process failed, most likely because of an authorization<u></u><u></u></p>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"> failure (bad password), but it is also possible that we lost the new<u></u><u></u></p>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"> connection before we managed to send our credentials.<u></u><u></u></p>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"> """<u></u><u></u></p>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"> log.msg("ReconnectingPBClientFactory.failedToGetPerspective")<u></u><u></u></p>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"> if why.check(pb.PBConnectionLost):<u></u><u></u></p>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"> log.msg("we lost the brand-new connection")<u></u><u></u></p>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"> # retrying might help here, let clientConnectionLost decide<u></u><u></u></p>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"> return<u></u><u></u></p>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"> # probably authorization<u></u><u></u></p>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"> self.stopTrying() # logging in harder won't help<u></u><u></u></p>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"> log.err(why)<u></u><u></u></p>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal">On Tue, Jun 20, 2017 at 9:18 AM Colin Chargy <<a href="mailto:Colin.Chargy@bentley.com" target="_blank"><span style="color:purple">Colin.Chargy@bentley.com</span></a>> wrote:<u></u><u></u></p>
</div>
</div>
</div>
</div>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt">
<div>
<div>
<div>
<p class="MsoNormal">Hi everyone,<br>
Before I start describing my issue, let me say to we have dozen of slaves (Win, Mac and Linux platform perfectly working right now), only one is problematic :<br>
We are facing an issue with slave connection to master. Here is the log on the slave side (see enclosed twisted.log for complete log) :<br>
[Broker,client] message from master: attached [Broker,client] ReconnectingPBClientFactory.failedToGetPerspective<br>
[Broker,client] we lost the brand-new connection [Broker,client] Lost connection to<span class="m_5015667870317741764apple-converted-space"> </span><a href="http://192.168.0.1:9989/" target="_blank"><span style="color:purple">192.168.0.1:9989</span></a><span class="m_5015667870317741764apple-converted-space"> </span>[Broker,client]
<twisted.internet.tcp.Connector instance at 0x03471918> will retry in 3 seconds<br>
<br>
And it starts it again.<br>
On the server side, the following log is produced :<br>
2017-06-19 16:11:27+0200 [Broker,9423,192.168.0.254] slave 'lrttestauto-test' attaching from IPv4Address(TCP, '192.168.0.254', 35524)<br>
2017-06-19 16:11:27+0200 [Broker,9423,192.168.0.254] Starting buildslave keepalive timer for 'lrttestauto-test'<br>
2017-06-19 16:11:27+0200 [Broker,9423,192.168.0.254] Peer will receive following PB traceback:<br>
2017-06-19 16:11:27+0200 [Broker,9423,192.168.0.254] Unhandled Error<br>
Traceback (most recent call last):<br>
Failure: twisted.spread.pb.PBConnectionLost: [Failure instance: Traceback (failure with no frames): <class 'twisted.internet.error.ConnectionLost'>: Connection to the other side was lost in a non-clean fashion.<br>
]<br>
<br>
I've checked that the login and password are correct and Buildbot version are the following :<br>
On the server-side (which is a Debian):<br>
Buildbot version: 0.8.8<br>
Twisted version: 12.3.0<br>
<br>
On the slave side (which is a Windows 10, buildslave installed via pip):<br>
Buildslave version: 0.8.14<br>
Twisted version: 17.5.0<br>
<br>
I've enclosed the slave log, the slave tac file and a tcpdump showing data transfer between slave and server (I've tried to debug it with Wireshark with no luck).<br>
<br>
What can I do to debug or to solve this issue ?<br>
<br>
Best regards,<br>
Colin Chargy<br>
_______________________________________________<br>
users mailing list<br>
<a href="mailto:users@buildbot.net" target="_blank"><span style="color:purple">users@buildbot.net</span></a><br>
<a href="https://lists.buildbot.net/mailman/listinfo/users" target="_blank"><span style="color:purple">https://lists.buildbot.net/mailman/listinfo/users</span></a><u></u><u></u></p>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Helvetica",sans-serif">_______________________________________________<br>
users mailing list<br>
</span><a href="mailto:users@buildbot.net" target="_blank"><span style="font-size:10.0pt;font-family:"Helvetica",sans-serif;color:purple">users@buildbot.net</span></a><span style="font-size:10.0pt;font-family:"Helvetica",sans-serif"><br>
</span><a href="https://lists.buildbot.net/mailman/listinfo/users" target="_blank"><span style="font-size:10.0pt;font-family:"Helvetica",sans-serif;color:purple">https://lists.buildbot.net/mailman/listinfo/users</span></a><u></u><u></u></p>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div>
</div></div>
_______________________________________________<br>
users mailing list<br>
<a href="mailto:users@buildbot.net" target="_blank">users@buildbot.net</a><br>
<a href="https://lists.buildbot.net/mailman/listinfo/users" rel="noreferrer" target="_blank">https://lists.buildbot.net/mailman/listinfo/users</a></blockquote></div>