I am tasked with extracting data from a 3'rd party API that return JSON objects.
While reading through the documentation for logstash, *beat and elasticsearch, i read that logstash can't connect to 3'rd party API's (with or without authentication tokens) and that *beats cannot deliver such data either.
So i am wondering what the best way would be to get this kind of data.
I am thinking one approach could be to make a Java "agent" to connect to the API and deliver the JSON objects directly to elasticsearch, but is this approach the best one available?
The datasource is MySQL, but i am not sure i will be able to get a MySQL user to query the DB from logstash.
Thanks in advance.