# Filebeat not harvesting newly added records

**URL:** https://discuss.elastic.co/t/filebeat-not-harvesting-newly-added-records/330603
**Category:** Beats
**Tags:** filebeat
**Created:** [April 24, 2023, 6:38am UTC](https://discuss.elastic.co/t/filebeat-not-harvesting-newly-added-records/330603 "2023-04-24T06:38:39Z")
**Posts on this page:** 3
**Page:** 1

<div class="post-metadata">

### Author: ![Dasher](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dasher/32/137841_2.png) [@Dasher](https://discuss.elastic.co/u/Dasher)
#### Post date: [April 24, 2023, 6:38am UTC](https://discuss.elastic.co/t/filebeat-not-harvesting-newly-added-records/330603/1 "2023-04-24T06:38:39Z")

</div>

Hi,I have a filebeat which is running on windows server 2019.The data is actively getting written to that log file but it's timestamp changes every 30 mins.I trying to reading log file,but for some reason the newly added records are not getting ingested?

this is the filebeat config:

type: filestream  
enabled: true  
paths : 'C:\Lotus\Domino\Data\IBM\_TECHNICAL\_SUPPORT\console.log'  
tags: ['console\_data']

filebeat debug logs

2023-04-24T06:19:33.495Z INFO [file\_watcher] filestream/fswatch.go:137 Start next scan  
2023-04-24T06:19:33.496Z DEBUG [file\_watcher] filestream/fswatch.go:204 Found 1 paths  
2023-04-24T06:19:33.496Z DEBUG [input.filestream] filestream/prospector.go:164 File C:\Lotus\Domino\Data\IBM\_TECHNICAL\_SUPPORT\console.log has been updated {"id": "41C27034C04F35E3", "prospector": "file\_prospector", "operation": "write", "source\_name": "native::153485312-87546-3234102977", "os\_id": "153485312-87546-3234102977", "new\_path": "C:\Lotus\Domino\Data\IBM\_TECHNICAL\_SUPPORT\console.log", "old\_path": "C:\Lotus\Domino\Data\IBM\_TECHNICAL\_SUPPORT\console.log"}  
2023-04-24T06:19:33.496Z DEBUG [input.filestream] input-logfile/harvester.go:145 Starting harvester for file {"id": "41C27034C04F35E3", "source": "filestream::.global::native::153485312-87546-3234102977"}  
2023-04-24T06:19:33.497Z DEBUG [input.filestream] input-logfile/harvester.go:181 Stopped harvester for file {"id": "41C27034C04F35E3", "source": "filestream::.global::native::153485312-87546-3234102977"}  
2023-04-24T06:19:43.322Z DEBUG [input.filestream] filestream/filestream.go:131 End of file reached: C:\Lotus\Domino\Data\IBM\_TECHNICAL\_SUPPORT\console.log; Backoff now. {"id": "41C27034C04F35E3", "source": "filestream::.global::native::153485312-87546-3234102977", "path": "C:\Lotus\Domino\Data\IBM\_TECHNICAL\_SUPPORT\console.log", "state-id": "native::153485312-87546-3234102977"}

---

<div class="post-metadata">

### Author: ![Wave](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/wave/32/117242_2.png) [@Wave](https://discuss.elastic.co/u/Wave)
#### Post date: [April 28, 2023, 4:52pm UTC](https://discuss.elastic.co/t/filebeat-not-harvesting-newly-added-records/330603/2 "2023-04-28T16:52:29Z")

</div>

Hi @Dasher

Are they getting ingested after the 30 minutes passes and they are no longer new? Or in other words does the new data eventually make it to the cluster, but is effectively on a 30 minute delay?

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [May 26, 2023, 6:53pm UTC](https://discuss.elastic.co/t/filebeat-not-harvesting-newly-added-records/330603/3 "2023-05-26T18:53:06Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
