VPC Flow Logs Lagging

Elastic Stack Beats

jhanvi (Jhanvi Jain) December 30, 2020, 8:22am #1

Hi,

I am trying to take vpc flow logs. They are getting ingested but there is a lag in the logs flowing i.e. for today, logs of yesterday are still being ingested.
What could possibly be the reason for the same and how can I mitigate this issue?

Thank you.

warkolm (Mark Walkom) December 30, 2020, 7:04am #2

Welcome to our community!
How are you ingesting them?

jhanvi (Jhanvi Jain) December 30, 2020, 7:10am #3

I am using the S3 input in AWS module of Filebeat.

© 2020. All Rights Reserved - Elasticsearch

Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S. and in other countries
Trademarks
Terms
Privacy
Brand
Code of Conduct

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.