# Reduce similar log entries

**URL:** https://discuss.elastic.co/t/reduce-similar-log-entries/74913
**Category:** Logstash
**Created:** [February 13, 2017, 5:50pm UTC](https://discuss.elastic.co/t/reduce-similar-log-entries/74913 "2017-02-13T17:50:16Z")
**Posts on this page:** 2
**Page:** 1

<div class="post-metadata">

### Author: ![yami](https://avatars.discourse-cdn.com/v4/letter/y/439d5e/32.png) [@yami](https://discuss.elastic.co/u/yami)
#### Post date: [February 13, 2017, 5:50pm UTC](https://discuss.elastic.co/t/reduce-similar-log-entries/74913/1 "2017-02-13T17:50:16Z")

</div>

I've read [Reduce duplicate or similar log entries](https://discuss.elastic.co/t/reduce-duplicate-or-similar-log-entries/29029)

how can i Reduce duplicate or similar log entries with collate?

I used it like that:

collate {  
interval =\> "1s"  
order =\> "ascending"  
}

and my logs were collected - but the similiar logs were not removed.

I want to removed and dont index similiar logs.

Sometimes i have very many similiar logs with different time. How can i reduce count of them and dont index most of them?

They have different "\_id".

I am using Kibana 3 with Logstash 2.1 and ES 1.4.2

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [March 13, 2017, 5:50pm UTC](https://discuss.elastic.co/t/reduce-similar-log-entries/74913/2 "2017-03-13T17:50:19Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
