Hello, I'm using logstash forwarder to ship logs from centralized location to logstash servers and then to elasticsearch. Recently, I've found that I have the same documents but with different ids twice in my Kibana. its basically the exact event, indexed twice. Тhis is happening for all document …

Duplicate items in elasticsearch

magnusbaeck (Magnus Bäck) January 21, 2016, 6:45pm 2

Is logstash-forwarder for some reason rereading the same old files?

Topic		Replies	Views
Duplicate documents in Elasticsearch? Elasticsearch	6	2892	October 1, 2017
Duplicate events with filebeat -> logstash -> elasticsearch pipeline Logstash	6	2427	November 28, 2017
Duplicate logs Elasticsearch	14	6871	July 10, 2018
Found duplicate records in elasticsearch Logstash	8	2522	December 25, 2017
Duplicate record exatly twice Logstash	8	860	April 20, 2018

Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S. and in other countries
Trademarks
Terms
Privacy
Brand
Code of Conduct

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.

Duplicate items in elasticsearch

Related topics