Hello All, I'm using logstash (5.3) to parse data and send it to elastic search. I currently have 3 configuration files under config.d which parses 3 different types of data (all data is being collected from a database and sent to elastic search after getting parsed) and each conf file has its own…

Duplicate entries for same data in multiple indices

a_kasireddy (Amarender Kasireddy) February 28, 2018, 10:14pm 3

Thank you for the response @magnusbaeck.
I added the document_id to give a unique id for the data instead of having default id and I don't see the duplicate entries now.

Topic		Replies	Views
Duplicate Events Logstash	3	1891	July 6, 2017
Problem with output elasticsearch data duplicate on index Logstash	5	2070	October 25, 2017
Same information in differents Indexes Elasticsearch	5	660	July 5, 2017
Logstash logs duplicates in different indexes despite else if conditions Logstash	7	2387	October 16, 2018
Multiple logstash indexes to be created from multiple application log files Logstash	3	801	May 16, 2022

Duplicate entries for same data in multiple indices

Related topics