# Filebeat has big delay to send log to Kafka

**URL:** https://discuss.elastic.co/t/filebeat-has-big-delay-to-send-log-to-kafka/277589
**Category:** Beats
**Created:** [July 1, 2021, 6:43pm UTC](https://discuss.elastic.co/t/filebeat-has-big-delay-to-send-log-to-kafka/277589 "2021-07-01T18:43:03Z")
**Posts on this page:** 2
**Page:** 1

<div class="post-metadata">

### Author: ![cpotato](https://avatars.discourse-cdn.com/v4/letter/c/e47774/32.png) [@cpotato](https://discuss.elastic.co/u/cpotato)
#### Post date: [July 1, 2021, 6:43pm UTC](https://discuss.elastic.co/t/filebeat-has-big-delay-to-send-log-to-kafka/277589/1 "2021-07-01T18:43:03Z")

</div>

Hi,

We have log server running filebeat to send log data to Kafka. The log file is on NFS mounted filesystem. we do logrotate hourly, the size of the file is ~18G at the peak time. we have log time and the time received on Kafka. sometimes the delay is up to 5000 seconds.  
I tried update the filebeat.yml, like set 'max\_proc' to 5, increase the worker to '5', etc. it helps a little, but still see huge delay.  
Would anyone can help me with it?

Thanks,  
Lee

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 29, 2021, 6:43pm UTC](https://discuss.elastic.co/t/filebeat-has-big-delay-to-send-log-to-kafka/277589/2 "2021-07-29T18:43:46Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.