# Duplicate items in elasticsearch

**URL:** <https://discuss.elastic.co/t/duplicate-items-in-elasticsearch/39765>\
**Category:** Logstash\
**Created:** [January 21, 2016, 12:51pm UTC](https://discuss.elastic.co/t/duplicate-items-in-elasticsearch/39765 "2016-01-21T12:51:30Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![nkoleff](https://avatars.discourse-cdn.com/v4/letter/n/d9b06d/32.png) [@nkoleff](https://discuss.elastic.co/u/nkoleff)\
**Post date:** [January 21, 2016, 12:51pm UTC](https://discuss.elastic.co/t/duplicate-items-in-elasticsearch/39765/1 "2016-01-21T12:51:30Z")

</div>

Hello,

I'm using logstash forwarder to ship logs from centralized location to logstash servers and then to elasticsearch.

Recently, I've found that I have the same documents but with different ids twice in my Kibana. its basically the exact event, indexed twice. Тhis is happening for all document types.

What are the most common reasons for this?

I know this could be coming from different sources, but what I can't imagine so far is how to recreate this issue. Any help would be appreciated.

---

<div class="post-metadata">

**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\
**Post date:** [January 21, 2016, 6:45pm UTC](https://discuss.elastic.co/t/duplicate-items-in-elasticsearch/39765/2 "2016-01-21T18:45:40Z")

</div>

Is logstash-forwarder for some reason rereading the same old files?

---

<div class="post-metadata">

**Author:** ![nkoleff](https://avatars.discourse-cdn.com/v4/letter/n/d9b06d/32.png) [@nkoleff](https://discuss.elastic.co/u/nkoleff)\
**Post date:** [January 27, 2016, 7:48am UTC](https://discuss.elastic.co/t/duplicate-items-in-elasticsearch/39765/3 "2016-01-27T07:48:46Z")

</div>

I am not sure, but I've noticed something - 2016/01/27 09:35:17.510424 registry rotate: rename of .logstash-forwarder.new to .logstash-forwarder - rename .logstash-forwarder.new .logstash-forwarder: no such file or directory

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 5:14am UTC](https://discuss.elastic.co/t/duplicate-items-in-elasticsearch/39765/4 "2017-07-06T05:14:10Z")

</div>


