I use the fingerprint filter for my logstash filter as below and the output for elasticsearch to include the fingerprint as below
filter {
fingerprint {
source => "message"
target => "[@metadata][fingerprint]"
method => "MURMUR3"
}
}
output
{
document_id => "%{[@metadata][fingerprint]}"
}
However, while this prevents duplication in terms of new fields being added, it does not update existing fields in the CSV File. On an existing field changing values in the CSV file, it does not reflect in Kibana. Any solution for this?