Use Field as Fingerprint Instead of Generating One


(Aralex) #1

Hi,
since I have a field with a unique value for each of my csv entries, how can I use that field value as a fingerprint instead of generating one, to avoid duplicates?
I experimented with the csv filter for while, and was wondering about the above.

Thank you.


(Aralex) #2

Would using that field as the source value work? (and leave all other parameters out)

filtering
{
source => ["my_field"]
}


(Christian Dahlqvist) #3

If you have a unique ID in your data you can use this as document ID in Elasticsearch instead of a fingerprint.


(system) closed #4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.