Use Field as Fingerprint Instead of Generating One

(Aralex) #1

since I have a field with a unique value for each of my csv entries, how can I use that field value as a fingerprint instead of generating one, to avoid duplicates?
I experimented with the csv filter for while, and was wondering about the above.

Thank you.

(Aralex) #2

Would using that field as the source value work? (and leave all other parameters out)

source => ["my_field"]

(Christian Dahlqvist) #3

If you have a unique ID in your data you can use this as document ID in Elasticsearch instead of a fingerprint.

(system) closed #4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.