Logstash input Odata /API stream

Elastic Stack Logstash
1

I want to use logstach to bring in data from a public OData site or even via a public API.
Like the NYC 311 service requests data stream
do I use an HTTP input, how do I specify the API call to the csv data

https://data.cityofnewyork.us/resource/fhrw-4uyv.csv

I can download the file but prefer to not use a static file but rather a live feed such as the on above.

Jawahar

2

Have a look at the http_poller input. It has the limitation that the url query cannot be dynamic using a file or a last_value like the jdbc input does.

You may be able to use ENV vars in the LS config and an external cron job that runs LS in http_poller one shot mode.

https://dev.socrata.com/docs/queries/

3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.