I want to create a pipeline like Log files -> FileBeat -> Kafka -> Logstash -> Elastic -> Kibana

Elastic Stack Beats
1
  1. While sending data from Filebeat to Kafka, the server crashes continuously.
  2. While sending data from Kafka to Logstash, the server also crashes continuously.

I have installed kafka in one VM (Ubuntu 22.04, 4GB RAM, 4 Cores)
I have installed FileBeat in one VM (Ubuntu 22.04, 2GB RAM, 2 Cores)
I have installed ELK in one VM (Cent OS, 8GB RAM, 4 Cores)

Still facing the issue.

Please tell me how to resolve these issues.

2

Hello,

You need to provide more context of what is not working, you didn't share any evidence of your issues.

Which server is crashing? What do you have in Filebeat logs?

Same thing, which server is crashing? What do you have in Logstash logs?