Insert all records of a table in mysql with no unique column in elastic without repitition

Elastic Stack Logstash
1

I want to send data from mysql table to elastic search .I am currently using jdbc plugin but it keep inserting same records again .I have no unique column in my mysql table.is there a way to send the records exactly once

2

You can set the document_id based on the contents of the event. You will still be processing data multiple times with no added value, but the resulting records will be unique.

3

Thanks @Badger

4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.