Hi All, I'm trying to create a situation where I have the option of replaying logs with zero risk of duplication. It seems to me that a good way to do that would be to make a field, possibly UUID or _id, be a consistent has of the input. Data is a slightly modified apache log. Our environment is…

_id as a consistent hash to avoid duplication with replays

tomr June 26, 2015, 11:10am 2

solved in How to create my own document_id in logstash?

Topic		Replies	Views
Using my own document_id - is there a faster way? Logstash	26	4193	December 27, 2017
How to create my own document_id in logstash? Logstash	19	26565	November 4, 2022
Duplicated date in my elastic Logstash	6	315	November 1, 2022
Logstash jdbc document_id => "%{uid}" problem Logstash	12	21179	July 6, 2017
How to add field "id" Logstash	3	491	November 19, 2021

Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S. and in other countries
Trademarks
Terms
Privacy
Brand
Code of Conduct

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.

_id as a consistent hash to avoid duplication with replays

Related Topics