Filebeat Logstash scaling

Elastic Stack Beats
1

I have a BELK cluster in Kubernetes. Recently I need to scale number of my Logstash instances. However, Filebeats just keep pushing logs to the older instances. How long will it take for Filebeats to detects the new instances?

2

@ntviet18 Currently Filebeat autodiscovery is only for module or prospector, it wont update the outputs configuration. Usually people get around that by one of the following:

  • Use a tool like ansible or puppets to update FB configuration
  • Use a queue like kafka
  • Use a proxy to hide the logstash behind it.

Thanks

3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.