# Entity/Identity resolution

**URL:** <https://discuss.elastic.co/t/entity-identity-resolution/11558>\
**Category:** Elasticsearch\
**Created:** [April 12, 2013, 7:51am UTC](https://discuss.elastic.co/t/entity-identity-resolution/11558 "2013-04-12T07:51:26Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Yann\_Barraud](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/yann_barraud/32/1108_2.png) [@Yann\_Barraud](https://discuss.elastic.co/u/Yann_Barraud)\
**Post date:** [April 12, 2013, 7:51am UTC](https://discuss.elastic.co/t/entity-identity-resolution/11558/1 "2013-04-12T07:51:26Z")

</div>

Hi,

I'm currently working on search engines, data cleaning and so on these last  
days. The challenge I'm facing right now is explaining that a search engine  
on its own can not be used for identity resolution. Lucene posts made  
things easier ([http://wiki.apache.org/lucene-java/ScoresAsPercentages](http://wiki.apache.org/lucene-java/ScoresAsPercentages)  
& [http://wiki.apache.org/lucene-java/LuceneFAQ#Can\_I\_filter\_by\_score.3F](http://wiki.apache.org/lucene-java/LuceneFAQ#Can_I_filter_by_score.3F)  
). [http://wiki.apache.org/lucene-java/LuceneFAQ#Can\_I\_filter\_by\_score.3F](http://wiki.apache.org/lucene-java/LuceneFAQ#Can_I_filter_by_score.3F)

I've been playing with Duke project also, for batch data deduplication.  
It's been very powerful, and covering requirements for batch needs.

Now I'm wondering if there is not an opportunity to merge at some points  
the two projets to get some fast live identity resolution service.

I'd say :

1. duke delegates data analysis & indexing to ES (as they both rely on  
Lucene indexes)
2. duke turns into an ES plugin to get records matching query with  
Bayesian probability as an output.

What do you guys think about it ?  
[http://wiki.apache.org/lucene-java/LuceneFAQ#Can\_I\_filter\_by\_score.3F](http://wiki.apache.org/lucene-java/LuceneFAQ#Can_I_filter_by_score.3F)

Regards,  
Yann Barraud

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 2:41am UTC](https://discuss.elastic.co/t/entity-identity-resolution/11558/2 "2017-07-06T02:41:28Z")

</div>