I want to setup the logstash configuration described in the docs, but I don't understand how to set it up. Here's the sentence I'm struggling with:
you can set up a load balancer between your data source machines and the Logstash cluster
Yeah, ok, sounds great. But right now I've configured my one Logstash Shipping Instance to ship data from one logfile and I start it with
sudo service logstash start</code
What is this load balancer thing? How do I load balance a logfile? And how do I create/configure a logstash cluster? I found the documentation very easy to follow along up until this last section where there are no links to further explain how it's done. Frustrating.
My goal is to set up the structure in the very last image of that document. Multiple logstash shipper instances (logstash cluster) that work together in reading the log file and send to an MQ. The second part, read from MQ and send to ES-cluster is already done. But the shipper-configuration I have today keeps crashing. So if I have multiple instances it wont stop working just because one instance crashes.