Filebeat 5.3 to Logstash 6.3 and ElasticSearch 6.3

Elastic Stack Elasticsearch
1

Hi,

Our setup is :
filebeat 5.3
logstash 6.3
packetbeat 6.3
metricbeat 6.3

Packetbeat and metricbeat logs are fine and it is working smoothly with no lag at all.
But with filebeat there is a lag of 20-30 mins.

To elaborate, filebeat5.3 sends logs to logstash6.3 and logstash is sending these logs to ElasticSearch6.3. I'm seeing these logs in kibana after a delay of 30 mins. It started happening after we upgraded AWS ES from 5.3 to 6.3.

How do I debug this?
Please suggest.

2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.