Beat to index HTTP output

coudenysj · May 2, 2019, 1:50pm

Hi all,

I was wondering if there is a beat which can periodically call a HTTP endpoint which outputs JSON, and index that data straight into Elasticsearch?

This is useful for PHP opcache information, for instance (which must be fetched over the HTTP layer).

Regards,
Jachim

aloulo47 · May 2, 2019, 2:21pm

I think heartbeat can help you

coudenysj · May 2, 2019, 2:32pm

Thanks for the suggestion, but I don't think it is specific enough.

I think I will create my own beat (with https://github.com/kozlice/phpfpmbeat as an example).

aloulo47 · May 2, 2019, 2:35pm

yeah you can create your own beat with your own logic is not difficult to do i have already created a beat for a specific use case good luck than

martinr_ubi · May 2, 2019, 8:59pm

@coudenysj
this is a native feature of metricbeat.
both polling a http endpoint and being a http endpoint that you can push into.

https://www.elastic.co/guide/en/beats/metricbeat/current/metricbeat-module-http.html

I use it myself to poll the endpoints of some application and ship that into es. The /metrics of flume comes to mind as an example I use. as there is no flume module.

coudenysj · May 6, 2019, 8:09am

@martinr_ubi awesome! Thanks, I'll take a look at it.

system · June 3, 2019, 10:09am

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.