LogStash and FileBeats Architecture For the Log Monitoring Use Case

If I have 5 machines, those five machins needs to prcessed by logstassh. And each machines feeds needs to be sent to a different Kafka Topic.

What all things are required:
- File Beats instaltion at 5 machines ?
- Single Logstash instace in a single machine, with single pipeline ?
- To ensure High Availability, additional instnace in a differe machine..

And if this extends to the 200 machines all feeding simultaneously what should be architecture ?
Also only certain filtered content will be posted to Kafka Topic. Non Filtered Content will need to send to ElasticSeach to be used for Data Retention..

Please let me know is this architecture supported by logstash

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.