# Spontaneously duplicated logs - need advice - thanks
**URL:** https://discuss.elastic.co/t/spontaneously-duplicated-logs-need-advice-thanks/265731
**Category:** Kibana
**Created:** [February 28, 2021, 4:12pm UTC](https://discuss.elastic.co/t/spontaneously-duplicated-logs-need-advice-thanks/265731 "2021-02-28T16:12:58Z")
**Posts on this page:** 5
**Page:** 1
### Author:  [@Datakids](https://discuss.elastic.co/u/Datakids)
#### Post date: [February 28, 2021, 4:12pm UTC](https://discuss.elastic.co/t/spontaneously-duplicated-logs-need-advice-thanks/265731/1 "2021-02-28T16:12:58Z")
Hi there,
I have following setup: version 7.3.1
A Live System logs into a csv
With xcopy.bat I copy this csv every 5 Minutes to my ES Server to a specific folder.
Beats is whatching to that csv file in that specific folder.
Logstash is listen to Beats and write to my index!
I know its better to have Beats installed within Live System but this setup has been going on for a very long time without any problem or duplicated entries!
But since a few days I got thousends of duplicated logs in my index
Wow, thats spooky!
What could have caused this? My Setup not changed!
Any suggestion ?
Thanks
---
### Author:  [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [February 28, 2021, 11:30pm UTC](https://discuss.elastic.co/t/spontaneously-duplicated-logs-need-advice-thanks/265731/2 "2021-02-28T23:30:06Z")
Have you looked at the documents in Kibana to verify they are diuplicated?
---
### Author:  [@Datakids](https://discuss.elastic.co/u/Datakids)
#### Post date: [March 1, 2021, 7:58am UTC](https://discuss.elastic.co/t/spontaneously-duplicated-logs-need-advice-thanks/265731/3 "2021-03-01T07:58:55Z")
Hi, yes I checked them in Kibana also generate csv report and doublechecked.
It is strange and I have no Idea why.
---
### Author:  [@stephenb](https://discuss.elastic.co/u/stephenb)
#### Post date: [March 1, 2021, 7:42pm UTC](https://discuss.elastic.co/t/spontaneously-duplicated-logs-need-advice-thanks/265731/4 "2021-03-01T19:42:15Z")
HI @Datakids
We always used to joke.. _when there is no change....there is always a change_ 🙂 ... it just the who, what, when, where that we do not know ... (of course it could be a latent bug)
Can you check the dates on the files I perhaps that the dates / timestamps on the files are being touched / updated so filebeat is reading multiple times.
Are the past files being removed?
FIlebeat keeps a track of what the data/registry/filebeat perhaps that has become corrupt or permissions have changed so it can no longer write. You can clean that up or just look in it is is all human readable.
Have you simply restarted each component filebeat and logstash?
How long was this been running has there been any kind of rollover in filenames etc.
Have any of the boxes been patched / rebooted lately?
---
### Author:  [@system](https://discuss.elastic.co/u/system)
#### Post date: [March 29, 2021, 7:42pm UTC](https://discuss.elastic.co/t/spontaneously-duplicated-logs-need-advice-thanks/265731/5 "2021-03-29T19:42:58Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.