# Question on Elastic Search Filtering

**URL:** https://discuss.elastic.co/t/question-on-elastic-search-filtering/260504
**Category:** Logstash
**Created:** [January 8, 2021, 7:18am UTC](https://discuss.elastic.co/t/question-on-elastic-search-filtering/260504 "2021-01-08T07:18:03Z")
**Posts on this page:** 3
**Page:** 1

<div class="post-metadata">

### Author: ![Sampson\_Light](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sampson_light/32/77283_2.png) [@Sampson\_Light](https://discuss.elastic.co/u/Sampson_Light)
#### Post date: [January 8, 2021, 7:18am UTC](https://discuss.elastic.co/t/question-on-elastic-search-filtering/260504/1 "2021-01-08T07:18:03Z")

</div>

Hi,

I have duplicates in my system but i intend to do some form of filtering on the logstash side to prevent any future duplicates from occurring (due to server restart incorrectly).

For reference, my current duplicates are the exact replica of each other with the exception of date/time.

How should I go about implementing duplicate filters.

Regards  
Sam

---

<div class="post-metadata">

### Author: ![Badger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/badger/32/25190_2.png) [@Badger](https://discuss.elastic.co/u/Badger)
#### Post date: [January 8, 2021, 3:17pm UTC](https://discuss.elastic.co/t/question-on-elastic-search-filtering/260504/2 "2021-01-08T15:17:04Z")

</div>

See [this](https://discuss.elastic.co/t/threat-intelligence-avoid-redundancy-of-information-in-the-same-index/260303/4) thread.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [February 5, 2021, 3:17pm UTC](https://discuss.elastic.co/t/question-on-elastic-search-filtering/260504/3 "2021-02-05T15:17:06Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
