Get rid of duplicated items

(Nikola Kolev) #1


I've got some duplicated items in logstash which I want to get rid of in the future with implementing the fingerprint filter.

I've seen an example here - Logstash Duplicate message

which says:

filter {

uuid {
target => "@uuid"
overwrite => true
fingerprint {
source => ["message"]
target => "fingerprint"
key => "78787878"
method => "SHA1"
concatenate_sources => true

What I'm not sure is what is that key? Should it be random, and do I have to place it. Would this exmaple help me with this?


(Mark Walkom) #2

Well the docs for key are kinda vague, so I can't help either :stuck_out_tongue:
I've asked the LS dev team to see if they can help!

(Nikola Kolev) #3

indeed :slight_smile: thanks!

(Mark Walkom) #4

The feedback I received was;

in the context of the hashing algorithms, key is the hmac key used to generate to hash of the required value

(system) #5