[users at bb.net] Gathering and displaying build time statistics on buildbot?

[Pierre Tardy]

Hi Dan,
We have started last year interesting project in gsoc to  connect buildbot
to a stats processing database like influxdb.
http://docs.buildbot.net/latest/developer/stats-service.html
http://docs.buildbot.net/latest/manual/cfg-global.html#cfg-stats-service

Yes.. its built for nine.

For eight indeed you are pretty much bound to polling the json api.

As I know you have some performance issue on your master, I have to tell
you that this json api can be quite heavy, as it does a lot of unpickling
data within the reactor.
This means that if you are going for a big query like dumping all the
builds since the beginning of time in one http query, this will hang your
bot until its finished parsing all the pickles for all your builds.
However, if you take care of not shooting yourself in the foot, and always
query builds/per builds, then you have access to all the data.

Regards,
Pierre


Le lun. 14 mars 2016 à 18:12, Dan Kegel <dank at kegel.com> a écrit :

> Oh, also, I guess there's http://trac.buildbot.net/wiki/BuildbotJson
> which looks easy to try, I may start with that.
>
> On Mon, Mar 14, 2016 at 9:55 AM, Dan Kegel <dank at kegel.com> wrote:
> > Hi!  I see that Buildbot has metrics and statistics things:
> > http://docs.buildbot.net/latest/manual/cfg-global.html#metrics-options
> >
> http://docs.buildbot.net/latest/manual/cfg-global.html#statistics-service
> > but there seems to be no user-story-oriented guide about how to use them
> > to e.g. measure how long a particular builder (or all builders) takes
> > and display a histogram showing its median and 90th percentile durations.
> >
> > The closest I found was
> > https://github.com/buildbot/buildbot/pull/1725
> > https://gist.github.com/prasoon2211/cbe93436acc436be61c9
> > http://trac.buildbot.net/ticket/2461
> > http://trac.buildbot.net/ticket/3350
> >
> > What is the state of the art here on branch eight?  (I'm at the tip of
> > eight now.  Could move to nine if it makes this easier.)
> _______________________________________________
> users mailing list
> users at buildbot.net
> https://lists.buildbot.net/mailman/listinfo/users
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.buildbot.net/pipermail/users/attachments/20160315/c0c44358/attachment.html>