i import a lot of data in my ES Indexes with Logstash. If i import the same data twice (maybe a error or overlapping with the importer) , the documents are stored twice in ES.
Is there any possibility to update existing docs without watching the document_ID?
Because they are damn unique.
My first thought was, to create my own doc_id with the fingerprint-filter-plugin in Logstash. But the Performance is sooo bad with this configuration.
Thanks to all.