Hi All, I'm trying to create a situation where I have the option of replaying logs with zero risk of duplication. It seems to me that a good way to do that would be to make a field, possibly UUID or _id, be a consistent has of the input. Data is a slightly modified apache log. Our environment is…

_id as a consistent hash to avoid duplication with replays

tomr June 26, 2015, 11:10am 2

Topic		Replies	Views
How to create unique id in logstash/elastic search for apache logs in a distributed server environment Logstash	10	3959	January 17, 2019
How to use document id to avoid duplication of logs? Logstash	8	1852	June 26, 2020
Duplicate _id docs and docs with multiple _id values - how is this possible? Logstash	3	1639	April 3, 2019
Duplicate messages when using custom document_id Logstash	1	752	March 12, 2018
Logstash adding duplicate rows for every run Logstash	11	14644	July 6, 2017