How to create unique id in logstash/elastic search for apache logs in a distributed server environment so that when you reupload apache logs, logstash/es will update them instead of creating duplicate records.

How to create unique id in logstash/elastic search for apache logs in a distributed server environment

elk_dni_1 (elkuser_dni_1) December 20, 2018, 11:57am 11

Hi Christian Thanks a lot for the blogs.

Just want to know using logstash if we can parse only part of apache log file. More details are in the post.

Thanks

Topic		Replies	Views
How to use document id to avoid duplication of logs? Logstash	8	1851	June 26, 2020
Logstash adding duplicate rows for every run Logstash	11	14638	July 6, 2017
_id as a consistent hash to avoid duplication with replays Logstash	2	1074	July 6, 2017
Logstash generating duplicated index Logstash	1	466	September 5, 2017
ES query to check the existence of a document_id? Logstash	10	982	June 26, 2020