[Buildbot-devel] How to integrate Buildbot Status server on an existing server?

Tue Mar 18 14:21:44 UTC 2014

Hi again,

public_html is the directory that sits on the same layer as "master.cfg" or
"templates" (that's what I meant by "next to master.cfg"). It should be
auto-created when you run "buildbot create-master" command.
It works well for any static content (i.e. the one served as-is), including
images, css files, JavaScript, etc.

If you want a completely new, but dynamic webpage, you'll need to integrate
it quite tightly via Buildbot's basement (Twisted framework). I'm no expert
there, so I might be wrong and I'll let the community to correct me (and
guide you on the topic). My current understanding is that those templates
you're trying to add are no more than "views" (in terms of
Model-View-Controller paradigm), and you need to add "controllers" to
Buildbot Python code.

You may find it easier to use some other framework that will show dynamic
pages for you, and reverse-proxy to it instead of Buildbot using your
solution when you need some custom web page (that's what we did).

Hope my babbling helps,
Vasily

2014-03-18 3:06 GMT+04:00 shiny knight <theshinyknight at me.com>:

> Hi Vasily,
>
> I would like to do both; since most of the data that I get is coming from
> build results.
>
> Could you describe further, the process for dynamic pages? I tried so far
> everything on the manual, and nothing works....tried to add a new folder
> for the /template on the status call, tried to add pages everywhere and
> restart the master, but so far no luck.
>
> I only get it to work if I clone an existing page and change the content
> in it...in that case it works just fine, but as soon as you try to add
> anything, it won't display it.
>
> So for static pages, I just put them in the public_html folder, which is
> in my master folder ? (you mention "next to master.cfg", which is confusing
> to me...do you mean that the pages goes where the cfg file is? or inside
> the public_html?).
>
> Does the public_html works also for images and other data? I think that I
> tried to put a page in there, but it was a jinja template, not a static
> page...I will try again  :)
>
> I never imagined that adding some extra pages would be such a complex
> thing; I guess that is more efficient to have a second server machine that
> does only the website part, and connect to the Buildbot server to just
> display the data on the waterfall page. Altho it is a waste of resources to
> me :)
>
> Thanks!!!
>
>
> On Mar 17, 2014, at 4:05 AM, Vasily <vasslitvinov at pisem.net> wrote:
>
> Hi,
>
> If you want to add more templated pages it might be tricky, but if you
> need static web content - that's a piece of cake, just drop your files to
> public_html directory next to master.cfg (*not* to templates!), and add
> links to those.
>
> Thanks,
> Vasily
>
>
> 2014-03-17 10:12 GMT+04:00 shiny knight <theshinyknight at me.com>:
>
>> Thanks all! I was able finally to set it up as Pierre mentioned; which is
>> the same method that you use, Vasily (I assume...I have no clue of what
>> nginx is).
>>
>> I did a reverse proxy, creating a site on OSX server app, on 443, using
>> my IP address; then I modified the conf file that was created in the server
>> folder, and added the redirect to the port of the buildbot.
>>
>> This works awesome with the bot pages; but I have no way to add new pages
>> now.
>>
>> Basically, if I want to add a new page to the home; and I link to it; the
>> page won't be loaded, either if I put it where the root page is (which is
>> in the web/template folder in Library/python.....buildbot), nor in the site
>> folder where OSX Server created the folder for the html files.
>>
>> I have no clue why is happening; I would assume that the buildbot status
>> server root is where the root and the other web pages are, but it seems
>> that is not true at all.
>>
>> Tried to make a test page, with a simple line or 2 of text, within the {
>> %block content % } and { % end block %}, and place it in the web/template,
>> where waterfall and all the other pages are, but I get always the error
>> page that says "No such resource - File not found". Not sure how to
>> troubleshoot this, since I never wrote a web site from scratch; just used
>> stuff like dreamweaver to make a site and customize it.
>>
>> Tried also to copy and paste the href used in the layout.html file, but
>> no luck:
>>
>> <a href="{{ path_to_root }}test">Test</a>
>>
>> All the other links works fine; for some reasons, the bot does not see
>> any page other than the ones that are added in the layout page. If I modify
>> any of these pages (waterfall, grid, and so on), it works fine; but I need
>> to add more pages, not just modify the ones added by the Buildbot by
>> default.
>>
>> Any suggestion?
>>
>>
>> On Mar 13, 2014, at 12:35 PM, Vasily <vasslitvinov at pisem.net> wrote:
>>
>> Hi all,
>> We use Buildbot behind nginx reverse-proxy, it provides SSL and basic
>> HTTP auth as well as some nice redirections.
>> Is it worth describing somewhere?
>>
>> Thanks,
>> Vasily
>> 13.03.2014 22:45 пользователь "Pierre Tardy" <tardyp at gmail.com> написал:
>>
>>> my friend google just gave me this url, which is basically what I use
>>> with my setup.
>>>
>>> http://ckan.readthedocs.org/en/ckan-1.4.1/buildbot.html
>>>
>>>
>>> Pierre
>>>
>>>
>>> On Thu, Mar 13, 2014 at 7:42 PM, Pierre Tardy <tardyp at gmail.com> wrote:
>>>
>>>> Hi,
>>>> A number of people are running buildbot behind a http server configured
>>>> as reverse-proxy.
>>>>
>>>> This is actually what I recommend, as the web server can automatically
>>>> manage spdy, gzip compression, or kerberos authentication.
>>>>
>>>> You can look at the documentation for apache's mod_proxy to know how to
>>>> do it.
>>>>
>>>> We certainly would not refuse a patch with some detailled instructions
>>>> on how to configure buildbot with apache reverse proxy. :)
>>>>
>>>> Regards,
>>>> Pierre
>>>>
>>>> Pierre
>>>>
>>>>
>>>> On Thu, Mar 13, 2014 at 9:27 AM, shiny knight <theshinyknight at me.com>wrote:
>>>>
>>>>> Is there is any user that is running Buildbot on OSX, running also the
>>>>> web server on it? (in particular, Mavericks with the latest Server app).
>>>>>
>>>>> I am planning to add the Buildbot Webstatus to an existing server;
>>>>> this server run on OSX Mavericks Server, has a landing page on port 80,
>>>>> which is redirect to 443 for authentication.
>>>>>
>>>>> Basically I would like to keep the OSX server running as is, and add a
>>>>> link on the page, that will open the Webstatus pages from the Buildbot. But
>>>>> so far I had no luck finding info about how to do so.
>>>>>
>>>>> Seems that if I use the same url for the status server, the Buildbot
>>>>> page won't load. I am no network admin nor a server expert, so I am pretty
>>>>> sure that I am doing it incorrectly, but without documentation I have
>>>>> limited options to troubleshoot the issue.
>>>>>
>>>>> The status page section in the manual do not mention how to circumvent
>>>>> the problem of an existing server integration.
>>>>>
>>>>> So, if there is any user that went trough this and was able to
>>>>> configure his site on OSX, and also add the Buildbot Status server, I would
>>>>> gladly hear your suggestions.
>>>>>
>>>>> Thanks
>>>>>
>>>>> ------------------------------------------------------------------------------
>>>>> Learn Graph Databases - Download FREE O'Reilly Book
>>>>> "Graph Databases" is the definitive new guide to graph databases and
>>>>> their
>>>>> applications. Written by three acclaimed leaders in the field,
>>>>> this first edition is now available. Download your free book today!
>>>>> http://p.sfnet/sfu/13534_NeoTech <http://p.sf.net/sfu/13534_NeoTech>
>>>>> _______________________________________________
>>>>> Buildbot-devel mailing list
>>>>> Buildbot-devel at lists.sourceforge.net
>>>>> https://lists.sourceforge.net/lists/listinfo/buildbot-devel
>>>>>
>>>>
>>>>
>>>
>>>
>>> ------------------------------------------------------------------------------
>>> Learn Graph Databases - Download FREE O'Reilly Book
>>> "Graph Databases" is the definitive new guide to graph databases and
>>> their
>>> applications. Written by three acclaimed leaders in the field,
>>> this first edition is now available. Download your free book today!
>>> http://p.sf.net/sfu/13534_NeoTech
>>> _______________________________________________
>>> Buildbot-devel mailing list
>>> Buildbot-devel at lists.sourceforge.net
>>> https://lists.sourceforge.net/lists/listinfo/buildbot-devel
>>>
>>>
>> ------------------------------------------------------------------------------
>> Learn Graph Databases - Download FREE O'Reilly Book
>> "Graph Databases" is the definitive new guide to graph databases and their
>> applications. Written by three acclaimed leaders in the field,
>> this first edition is now available. Download your free book today!
>>
>> http://p.sf.net/sfu/13534_NeoTech_______________________________________________
>>
>> Buildbot-devel mailing list
>> Buildbot-devel at lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/buildbot-devel
>>
>>
>>
>
> ------------------------------------------------------------------------------
> Learn Graph Databases - Download FREE O'Reilly Book
> "Graph Databases" is the definitive new guide to graph databases and their
> applications. Written by three acclaimed leaders in the field,
> this first edition is now available. Download your free book today!
>
> http://p.sf.net/sfu/13534_NeoTech_______________________________________________
> Buildbot-devel mailing list
> Buildbot-devel at lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/buildbot-devel
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://buildbot.net/pipermail/devel/attachments/20140318/a89f02d7/attachment.html>