Reduce similar log entries

Elastic Stack Logstash
1

I've read Reduce duplicate or similar log entries

how can i Reduce duplicate or similar log entries with collate?

I used it like that:

collate {
interval => "1s"
order => "ascending"
}

and my logs were collected - but the similiar logs were not removed.

I want to removed and dont index similiar logs.

Sometimes i have very many similiar logs with different time. How can i reduce count of them and dont index most of them?

They have different "_id".

I am using Kibana 3 with Logstash 2.1 and ES 1.4.2

2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.