I have set up 3 master nodes with Elastisearch installed. I want to achieve storing ~600KHz to Elasticsearch. Some people had suggested me to have a look on Logstash. However, I have no idea how to configure it. What is Logstash forwarder? Is it needed?
If I desire my values, how can I do it? Do I need to implement my own app? What is the easiest way to do it?
Thank you in advance.
Hey
Logstash is a system you can use to pull logs from various places (including files), filter and mangle them, and then push it to various endpoints, including Elasticsearch. The main page is here: https://www.elastic.co/products/logstash
There are various input plugins available, so you'll need to find one that fits your needs, and then set it up.
Logstash forwarder is used when you don't want to install Logstash itself on the same machine as the source of your logs. Once again, it depends on what you want to do if you need it or not.
Also look at the Logstash Book and the Logstash Config Guide.
J