I have few Filebeat containers and a single logstash container running on a paticular namespaces of a kubernetes cluster.
However, I see intermittent connectivity issues between Filebeat and Logstash. (Logs below)
Due to this I see that Filebeat repeatedly sends the same events to Logstash.
<>|2020-01-23T15:43:14.925Z|ERROR|logstash/sync.go:155|Failed to publish events caused by: read tcp 100.96.10.3:59614->100.68.143.9:5044: i/o timeout|
|---|---|---|---|
|2020-01-23T15:43:16.813Z|ERROR|pipeline/output.go:121|Failed to publish events: read tcp 100.96.10.3:59614->100.68.143.9:5044: i/o timeout|
|2020-01-23T15:43:16.814Z|INFO|pipeline/output.go:95|Connecting to backoff(tcp://local-logstash:5044)|
|2020-01-23T15:43:16.818Z|INFO|pipeline/output.go:105|Connection to backoff(tcp://local-logstash:5044) established|</>