# Filebeat do not see file updates after a while

**URL:** https://discuss.elastic.co/t/filebeat-do-not-see-file-updates-after-a-while/34914
**Category:** Beats
**Tags:** filebeat
**Created:** [November 18, 2015, 10:08am UTC](https://discuss.elastic.co/t/filebeat-do-not-see-file-updates-after-a-while/34914 "2015-11-18T10:08:52Z")
**Posts on this page:** 14
**Page:** 2

<div class="post-metadata">

### Author: ![ruflin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ruflin/32/3116_2.png) [@ruflin](https://discuss.elastic.co/u/ruflin)
#### Post date: [November 23, 2015, 4:22pm UTC](https://discuss.elastic.co/t/filebeat-do-not-see-file-updates-after-a-while/34914/21 "2015-11-23T16:22:39Z")

</div>

It will work, as long as your file gets updated frequently enough (faster then every 5 minutes).

---

<div class="post-metadata">

### Author: ![ogauchard](https://avatars.discourse-cdn.com/v4/letter/o/3da27b/32.png) [@ogauchard](https://discuss.elastic.co/u/ogauchard)
#### Post date: [November 23, 2015, 4:26pm UTC](https://discuss.elastic.co/t/filebeat-do-not-see-file-updates-after-a-while/34914/22 "2015-11-23T16:26:56Z")

</div>

@ruflin Do you think the issue is related to file close due to ignore\_older configuration ? This is not a problem at other times of the day. The file is closed because it is not updated during 5 minutes but the next change is well detected.

---

<div class="post-metadata">

### Author: ![ruflin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ruflin/32/3116_2.png) [@ruflin](https://discuss.elastic.co/u/ruflin)
#### Post date: [November 23, 2015, 4:30pm UTC](https://discuss.elastic.co/t/filebeat-do-not-see-file-updates-after-a-while/34914/23 "2015-11-23T16:30:08Z")

</div>

@ogauchard Yes, the problem is that the next change is detected but the file pointer is potentially set to the end. Currently ignore\_older mixes two different functionalities into one: [https://github.com/elastic/filebeat/issues/181](https://github.com/elastic/filebeat/issues/181) Feel free to also comment here what your expectations would be.

We still have to think again through the different use cases etc. and what should happen in which case, but at the moment the best potential solution is to set ignore\_older to a much higher value.

---

<div class="post-metadata">

### Author: ![ogauchard](https://avatars.discourse-cdn.com/v4/letter/o/3da27b/32.png) [@ogauchard](https://discuss.elastic.co/u/ogauchard)
#### Post date: [November 23, 2015, 4:38pm UTC](https://discuss.elastic.co/t/filebeat-do-not-see-file-updates-after-a-while/34914/24 "2015-11-23T16:38:58Z")

</div>

@ruflin I understand. So I change the ignore\_older to a higher value and give you feedback tomorrow.

---

<div class="post-metadata">

### Author: ![ruflin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ruflin/32/3116_2.png) [@ruflin](https://discuss.elastic.co/u/ruflin)
#### Post date: [November 23, 2015, 8:10pm UTC](https://discuss.elastic.co/t/filebeat-do-not-see-file-updates-after-a-while/34914/25 "2015-11-23T20:10:12Z")

</div>

@ogauchard Thanks a lot for your help.

---

<div class="post-metadata">

### Author: ![ogauchard](https://avatars.discourse-cdn.com/v4/letter/o/3da27b/32.png) [@ogauchard](https://discuss.elastic.co/u/ogauchard)
#### Post date: [November 24, 2015, 8:09am UTC](https://discuss.elastic.co/t/filebeat-do-not-see-file-updates-after-a-while/34914/26 "2015-11-24T08:09:02Z")

</div>

@ruflin Everything is fine this morning. Hope it will be the same on following days !

---

<div class="post-metadata">

### Author: ![ruflin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ruflin/32/3116_2.png) [@ruflin](https://discuss.elastic.co/u/ruflin)
#### Post date: [November 24, 2015, 8:29am UTC](https://discuss.elastic.co/t/filebeat-do-not-see-file-updates-after-a-while/34914/27 "2015-11-24T08:29:16Z")

</div>

@ogauchard Good to hear. Keep us posted.

---

<div class="post-metadata">

### Author: ![ogauchard](https://avatars.discourse-cdn.com/v4/letter/o/3da27b/32.png) [@ogauchard](https://discuss.elastic.co/u/ogauchard)
#### Post date: [November 25, 2015, 7:57am UTC](https://discuss.elastic.co/t/filebeat-do-not-see-file-updates-after-a-while/34914/28 "2015-11-25T07:57:10Z")

</div>

@ruflin Another day in paradise ! Everything is fine this morning. Just wondering whether I update Filebeat with the GA version and restart all the stuff or leave it working a few more days to see what happens. What do you think ?

---

<div class="post-metadata">

### Author: ![ruflin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ruflin/32/3116_2.png) [@ruflin](https://discuss.elastic.co/u/ruflin)
#### Post date: [November 25, 2015, 7:59am UTC](https://discuss.elastic.co/t/filebeat-do-not-see-file-updates-after-a-while/34914/29 "2015-11-25T07:59:51Z")

</div>

@ogauchard I recommend to update to GA. GA is almost identical to the version you are using now. Using the GA will make it also on our side easier to track down a problem in case there is one as we know exactly the version in use.

---

<div class="post-metadata">

### Author: ![ogauchard](https://avatars.discourse-cdn.com/v4/letter/o/3da27b/32.png) [@ogauchard](https://discuss.elastic.co/u/ogauchard)
#### Post date: [November 25, 2015, 8:05am UTC](https://discuss.elastic.co/t/filebeat-do-not-see-file-updates-after-a-while/34914/30 "2015-11-25T08:05:37Z")

</div>

@ruflin You're right. I will also upgrade ES, Logstash and Kibana and keep you informed.

---

<div class="post-metadata">

### Author: ![ogauchard](https://avatars.discourse-cdn.com/v4/letter/o/3da27b/32.png) [@ogauchard](https://discuss.elastic.co/u/ogauchard)
#### Post date: [November 27, 2015, 7:42am UTC](https://discuss.elastic.co/t/filebeat-do-not-see-file-updates-after-a-while/34914/31 "2015-11-27T07:42:02Z")

</div>

@ruflin Still running well till wednesday with filebeat GA and other components in latest version. The problem seems to be fixed. Thanks for your support !

---

<div class="post-metadata">

### Author: ![ruflin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ruflin/32/3116_2.png) [@ruflin](https://discuss.elastic.co/u/ruflin)
#### Post date: [November 27, 2015, 7:55am UTC](https://discuss.elastic.co/t/filebeat-do-not-see-file-updates-after-a-while/34914/32 "2015-11-27T07:55:05Z")

</div>

@ogauchard Good to hear

---

<div class="post-metadata">

### Author: ![prakashkumar](https://avatars.discourse-cdn.com/v4/letter/p/b5ac83/32.png) [@prakashkumar](https://discuss.elastic.co/u/prakashkumar)
#### Post date: [May 26, 2016, 7:21am UTC](https://discuss.elastic.co/t/filebeat-do-not-see-file-updates-after-a-while/34914/33 "2016-05-26T07:21:43Z")

</div>

Hi,  
will you help me on my topic?

> [@One file come five times in output](https://discuss.elastic.co/t/one-file-come-five-times-in-output/50938):
>
> HI, I have 10 log files in folder. And i get output: 2016/05/25 12:53:11.061273 output.go:87: DBG output worker: publish 38 events 2016/05/25 12:53:11.267406 publish.go:104: INFO Events sent: 38 2016/05/25 12:53:11.268415 registrar.go:157: INFO Registry file updated. 10 states written. 38 events are send to log stash. and logstash output to elastic search: "hits": { "total": 42, "max\_score": 1 } But it has to be send 10 log file because i am having only 10 log file in a folder.why i…

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 5, 2017, 9:51pm UTC](https://discuss.elastic.co/t/filebeat-do-not-see-file-updates-after-a-while/34914/34 "2017-07-05T21:51:31Z")

</div>



[Previous page](https://discuss.elastic.co/t/filebeat-do-not-see-file-updates-after-a-while/34914.md?page=1)
