# Remove duplicates by bag of word comparision

**URL:** <https://discuss.elastic.co/t/remove-duplicates-by-bag-of-word-comparision/71294>\
**Category:** Elasticsearch\
**Created:** [January 12, 2017, 12:06am UTC](https://discuss.elastic.co/t/remove-duplicates-by-bag-of-word-comparision/71294 "2017-01-12T00:06:14Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![21stio](https://avatars.discourse-cdn.com/v4/letter/2/49beb7/32.png) [@21stio](https://discuss.elastic.co/u/21stio)\
**Post date:** [January 12, 2017, 12:06am UTC](https://discuss.elastic.co/t/remove-duplicates-by-bag-of-word-comparision/71294/1 "2017-01-12T00:06:14Z")

</div>

Hi,

is there a way to remove search results by a bag of word comparison of all the results? Like once the similarity of a field of two documents pass a certain threshold?

Best regards

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [February 9, 2017, 12:06am UTC](https://discuss.elastic.co/t/remove-duplicates-by-bag-of-word-comparision/71294/2 "2017-02-09T00:06:32Z")

</div>

Closed on February 9, 2017, 12:06am UTC

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.