Hey there!
I have some inquiries about the usage of Logstash. I have a few "Crawlers" that request controllers param. I successfully inserted them into elasticsearch but the data had no structure and thus made it hard to analyze.
Logstash might be the tool that I need to integrate between the "Crawlers" and Elasticsearch.
I uderstand that i need to build a sepceific ".conf" for each "Crawler" as they each have their own provider and each provider has many different kinds of controllers.
How to I go about that without spending too much time? Is there a way to streamline it? Seems like it would be a sisyphean job...
I'm looking fro a way to enrich the data in order to analyze it later and get insights.