Get rid of duplicated items

Elastic Stack Logstash
1

Hello,

I've got some duplicated items in logstash which I want to get rid of in the future with implementing the fingerprint filter.

I've seen an example here - Logstash Duplicate message

which says:

filter {

uuid {
target => "@uuid"
overwrite => true
}
fingerprint {
source => ["message"]
target => "fingerprint"
key => "78787878"
method => "SHA1"
concatenate_sources => true
}

What I'm not sure is what is that key? Should it be random, and do I have to place it. Would this exmaple help me with this?

Thanks

2

Well the docs for key are kinda vague, so I can't help either :stuck_out_tongue:
I've asked the LS dev team to see if they can help!

3

indeed :slight_smile: thanks!

4

The feedback I received was;

in the context of the hashing algorithms, key is the hmac key used to generate to hash of the required value