How to create unique id in logstash/elastic search for apache logs in a distributed server environment so that when you reupload apache logs, logstash/es will update them instead of creating duplicate records.

How to create unique id in logstash/elastic search for apache logs in a distributed server environment

elk_dni_1 (elkuser_dni_1) December 20, 2018, 11:57am 11

Hi Christian Thanks a lot for the blogs.

Just want to know using logstash if we can parse only part of apache log file. More details are in the post.

Thanks

Topic		Replies	Views
How to use document id to avoid duplication of logs? Logstash	8	1871	June 26, 2020
Logstash adding duplicate rows for every run Logstash	11	14653	July 6, 2017
_id as a consistent hash to avoid duplication with replays Logstash	2	1075	July 6, 2017
Logstash generating duplicated index Logstash	1	466	September 5, 2017
ES query to check the existence of a document_id? Logstash	10	983	June 26, 2020