Use Field as Fingerprint Instead of Generating One

Elastic Stack Logstash
1

Hi,
since I have a field with a unique value for each of my csv entries, how can I use that field value as a fingerprint instead of generating one, to avoid duplicates?
I experimented with the csv filter for while, and was wondering about the above.

Thank you.

2

Would using that field as the source value work? (and leave all other parameters out)

filtering
{
source => ["my_field"]
}

3

If you have a unique ID in your data you can use this as document ID in Elasticsearch instead of a fingerprint.

4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.