# Synonym filter results in term facet

**URL:** <https://discuss.elastic.co/t/synonym-filter-results-in-term-facet/18770>\
**Category:** Elasticsearch\
**Created:** [July 21, 2014, 5:51pm UTC](https://discuss.elastic.co/t/synonym-filter-results-in-term-facet/18770 "2014-07-21T17:51:58Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![ravi063](https://avatars.discourse-cdn.com/v4/letter/r/df705f/32.png) [@ravi063](https://discuss.elastic.co/u/ravi063)\
**Post date:** [July 21, 2014, 5:51pm UTC](https://discuss.elastic.co/t/synonym-filter-results-in-term-facet/18770/1 "2014-07-21T17:51:58Z")

</div>

Hi All,

I have a requirement in which I need to find distinct company names. I was  
using "Keyword" tokenizer for that field and through term facet I was able  
to get distinct company names. However terms facet treated company names  
like "ibm suisse", "ibm corporation", "ibm" as different companies.  
Online documentation suggested me to use "Synonym filter" to solve this. My  
settings is:

curl -XPUT '[http://localhost:9200/dataindex/](http://localhost:9200/dataindex/)' -d '{  
"settings": {  
"index": {  
"analysis": {  
"analyzer": {  
"customAnalyzer": {  
"type": "custom",  
"tokenizer": "whitespace",  
"filter": [  
"lowercase","synonym"  
]  
}  
},  
"filter": {  
"synonym" : {  
"type" : "synonym",  
"tokenizer": "keyword",  
"synonyms\_path" : "analysis/synonym.txt"  
}  
}  
}  
}  
}  
}'

My mapping is:

curl -XPUT '[http://localhost:9200/dataindex/tweet/\_mapping](http://localhost:9200/dataindex/tweet/_mapping)' -d '  
{  
"tweet" : {  
"properties" : {  
"company": {  
"type": "string",  
"analyzer": "customAnalyzer"  
}  
}  
}  
}'

In the synonym.txt file I have : ibm suisse, ibm corporation, ibm business,  
ibm =\> ibm corp ltd

Indexed data:  
curl -XPUT '[http://localhost:9200/dataindex/tweet/1](http://localhost:9200/dataindex/tweet/1)' -d '{  
"company" : "ibm"  
}'  
curl -XPUT '[http://localhost:9200/dataindex/tweet/2](http://localhost:9200/dataindex/tweet/2)' -d '{  
"company" : "ibm corporation"  
}'  
curl -XPUT '[http://localhost:9200/dataindex/tweet/3](http://localhost:9200/dataindex/tweet/3)' -d '{  
"company" : "ibm suisse"  
}'  
curl -XPUT '[http://localhost:9200/dataindex/tweet/4](http://localhost:9200/dataindex/tweet/4)' -d '{  
"company" : "ibm business"  
}'

If I run a terms facet:  
{  
"facets": {  
"loc\_facet": {  
"terms": {  
"field": "company"  
}  
}  
}  
}  
I get 3 terms ie {term: ibm corp ltd, count: 3} {term: suisse, count: 1}  
{term: corporation, count: 1}  
I want the facet result to return only one term: ibm corp ltd with count=3.  
This way i will get distinct company names and also map synonym names into  
single company name.  
Please correct me if I am using wrong tokenizer or my approach is not  
correct.

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/1ba32926-7015-4b8a-89ae-bf43a2561b71%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/1ba32926-7015-4b8a-89ae-bf43a2561b71%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![vineeth\_mohan\_2](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/vineeth_mohan_2/32/747_2.png) [@vineeth\_mohan\_2](https://discuss.elastic.co/u/vineeth_mohan_2)\
**Post date:** [July 21, 2014, 7:24pm UTC](https://discuss.elastic.co/t/synonym-filter-results-in-term-facet/18770/2 "2014-07-21T19:24:50Z")

</div>

Hello Ravi ,

Your approach is wrong.  
When you use synonym filter , it indexes all synonyms of that token hence  
and synonym will match against that term.  
So when you do a facet , you will get an aggregation of all synonyms rather  
than just one.

Better approach would be to store the unique name into some other field and  
take a facet of that field.

Thanks  
Vineeth

On Mon, Jul 21, 2014 at 11:21 PM, [ravi063@gmail.com](mailto:ravi063@gmail.com) wrote:

> Hi All,
> 
> I have a requirement in which I need to find distinct company names. I was  
> using "Keyword" tokenizer for that field and through term facet I was able  
> to get distinct company names. However terms facet treated company names  
> like "ibm suisse", "ibm corporation", "ibm" as different companies.  
> Online documentation suggested me to use "Synonym filter" to solve this.  
> My settings is:
> 
> curl -XPUT '[http://localhost:9200/dataindex/](http://localhost:9200/dataindex/)' -d '{  
> "settings": {  
> "index": {  
> "analysis": {  
> "analyzer": {  
> "customAnalyzer": {  
> "type": "custom",  
> "tokenizer": "whitespace",  
> "filter": [  
> "lowercase","synonym"  
> ]  
> }  
> },  
> "filter": {  
> "synonym" : {  
> "type" : "synonym",  
> "tokenizer": "keyword",  
> "synonyms\_path" : "analysis/synonym.txt"  
> }  
> }  
> }  
> }  
> }  
> }'
> 
> My mapping is:
> 
> curl -XPUT '[http://localhost:9200/dataindex/tweet/\_mapping](http://localhost:9200/dataindex/tweet/_mapping)' -d '  
> {  
> "tweet" : {  
> "properties" : {  
> "company": {  
> "type": "string",  
> "analyzer": "customAnalyzer"  
> }  
> }  
> }  
> }'
> 
> In the synonym.txt file I have : ibm suisse, ibm corporation, ibm  
> business, ibm =\> ibm corp ltd
> 
> Indexed data:  
> curl -XPUT '[http://localhost:9200/dataindex/tweet/1](http://localhost:9200/dataindex/tweet/1)' -d '{  
> "company" : "ibm"  
> }'  
> curl -XPUT '[http://localhost:9200/dataindex/tweet/2](http://localhost:9200/dataindex/tweet/2)' -d '{  
> "company" : "ibm corporation"  
> }'  
> curl -XPUT '[http://localhost:9200/dataindex/tweet/3](http://localhost:9200/dataindex/tweet/3)' -d '{  
> "company" : "ibm suisse"  
> }'  
> curl -XPUT '[http://localhost:9200/dataindex/tweet/4](http://localhost:9200/dataindex/tweet/4)' -d '{  
> "company" : "ibm business"  
> }'
> 
> If I run a terms facet:  
> {  
> "facets": {  
> "loc\_facet": {  
> "terms": {  
> "field": "company"  
> }  
> }  
> }  
> }  
> I get 3 terms ie {term: ibm corp ltd, count: 3} {term: suisse, count: 1}  
> {term: corporation, count: 1}  
> I want the facet result to return only one term: ibm corp ltd with  
> count=3. This way i will get distinct company names and also map synonym  
> names into single company name.  
> Please correct me if I am using wrong tokenizer or my approach is not  
> correct.
> 
> --  
> You received this message because you are subscribed to the Google Groups  
> "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an  
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> To view this discussion on the web visit  
> [https://groups.google.com/d/msgid/elasticsearch/1ba32926-7015-4b8a-89ae-bf43a2561b71%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/1ba32926-7015-4b8a-89ae-bf43a2561b71%40googlegroups.com)  
> [https://groups.google.com/d/msgid/elasticsearch/1ba32926-7015-4b8a-89ae-bf43a2561b71%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/1ba32926-7015-4b8a-89ae-bf43a2561b71%40googlegroups.com?utm_medium=email&utm_source=footer)  
> .  
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAGdPd5ny%3Di76CHwpbEoY-4nGaraQfz-Tmmm5MVJbiA%2B0nrgKZQ%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAGdPd5ny%3Di76CHwpbEoY-4nGaraQfz-Tmmm5MVJbiA%2B0nrgKZQ%40mail.gmail.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 1:14am UTC](https://discuss.elastic.co/t/synonym-filter-results-in-term-facet/18770/3 "2017-07-06T01:14:27Z")

</div>

Closed on July 6, 2017, 1:14am UTC