# AWS VPC Flow Log integration

**URL:** <https://discuss.elastic.co/t/aws-vpc-flow-log-integration/301712>\
**Category:** SIEM\
**Created:** [April 6, 2022, 7:20am UTC](https://discuss.elastic.co/t/aws-vpc-flow-log-integration/301712 "2022-04-06T07:20:44Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![ame123](https://avatars.discourse-cdn.com/v4/letter/a/bbce88/32.png) [@ame123](https://discuss.elastic.co/u/ame123)\
**Post date:** [April 6, 2022, 7:20am UTC](https://discuss.elastic.co/t/aws-vpc-flow-log-integration/301712/1 "2022-04-06T07:20:44Z")

</div>

Hi all,

We have been trying since a month to stabilize the integration of vpc flow logs using elastic agent.  
There is always a lag of 2-3 days in the ingestion, the messages in the sqs queue never seems to do down because till the time a log file is processes by elastic agent another 2 files are received.  
My cluster is made up of 3 hot nodes 2 of them having 10 CPU cores, 64 GB memory and high io ELB disks and the 3rd hot node having a 32 cores graviton CPU, 64 GB memory and same disk as above. We also have 2 dedicated ingest only nodes, and 2 warm nodes. Any tips on how to improve the ingestion performance and delay the log delay will be very helpful.

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/7/8/78372c8cb41a396b324f591f58aad596b157ab73.png)  
 ![image](https://us1.discourse-cdn.com/elastic/original/3X/7/9/79af4fa8fb921777f48930cdda89a82fb70bf770.png)  
 ![image](https://us1.discourse-cdn.com/elastic/original/3X/0/d/0d16a150e98d8cb0457db98b735bb52a39b3d06e.png)

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [May 4, 2022, 7:21am UTC](https://discuss.elastic.co/t/aws-vpc-flow-log-integration/301712/2 "2022-05-04T07:21:24Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
