I have multiple files, and multiple logstash nodes.
how to setup multiple logstash nodes read the same file without duplicate data
You can't. If you are writing to elasticsearch then you can set the document_id option on the output using a fingerprint filter, so that identical records will overwrite oneanother.
1 Like
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.