# Duplicate documents detection in Elasticsearch

**URL:** <https://discuss.elastic.co/t/duplicate-documents-detection-in-elasticsearch/37987>\
**Category:** Elasticsearch\
**Created:** [December 26, 2015, 4:48pm UTC](https://discuss.elastic.co/t/duplicate-documents-detection-in-elasticsearch/37987 "2015-12-26T16:48:08Z")\
**Posts on this page:** 1\
**Showing post:** 4

<div class="post-metadata">

**Author:** ![jprante](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jprante/32/44941_2.png) [@jprante](https://discuss.elastic.co/u/jprante)\
**Post date:** [December 27, 2015, 1:14am UTC](https://discuss.elastic.co/t/duplicate-documents-detection-in-elasticsearch/37987/4 "2015-12-27T01:14:25Z")

</div>

Yes, you can detect plagiarism, at client side. Use fingerprinting method and More-like-this to detect various degrees of document similarity.

You can easily detect duplicates, by just indexing checksum, like CRC-32 or Adler.

There is no plugin I know of and the reason is obvious, the scenarios and requirements are too difficult for a generic solution. You have to program the detection for yourself.

See [Plagiarism detection](https://discuss.elastic.co/t/plagiarism-detection/31906)

---

_[View the full topic](https://discuss.elastic.co/t/duplicate-documents-detection-in-elasticsearch/37987)._