# Serbian analyzer setup **URL:** \ **Category:** Elasticsearch\ **Created:** [October 23, 2017, 12:31pm UTC](https://discuss.elastic.co/t/serbian-analyzer-setup/104893 "2017-10-23T12:31:13Z")\ **Posts on this page:** 5\ **Page:** 1
**Author:** ![srda1989](https://avatars.discourse-cdn.com/v4/letter/s/e36b37/32.png) [@srda1989](https://discuss.elastic.co/u/srda1989)\ **Post date:** [October 23, 2017, 12:31pm UTC](https://discuss.elastic.co/t/serbian-analyzer-setup/104893/1 "2017-10-23T12:31:13Z")
Hi guys, I am trying to implement elasticsearch on my website which has a lot of posts in Serbian language. The main problem occurs when people try to search words with our specific latin letters (šćž ... ). So I figured out how to solve that kind of issue with asciifolding filter (it works amazing). : But asciifolding filter translates letter "đ" to letter "d" and that doesn't work for me. People here when searching for example "Đoković", they type Djokovic not Dokovic. To solve this issue I tried to set pattern replace filter and replace words that has letter đ with dj. Bellow is my index analyzer configuration ``` curl -XPUT 'localhost:9200/my_index' -H 'Content-Type: application/json' -d' { "settings" : { "analysis" : { "analyzer" : { "default" : { "tokenizer" : "standard", "filter" : ["standard", "my_ascii_folding", "lowercase"], "char_filter" : [ "small_dj", "big_dj" ] } }, "filter" : { "my_ascii_folding" : { "type" : "asciifolding", "preserve_original" : true } }, "char_filter": { "small_dj": { "type": "pattern_replace", "pattern": "(\\S*)(đ)(\\S*)", "replacement": "$0 $1dj$3" }, "big_dj": { "type": "pattern_replace", "pattern": "(\\S*)(Đ)(\\S*)", "replacement": "$0 $1Dj$3" } } } } }'; ``` When analyzing index with string "đoković" I do get all the tokens: ``` "tokens" : [ { "token" : "dokovic", "start_offset" : 0, "end_offset" : 6, "type" : "", "position" : 0 }, { "token" : "đoković", "start_offset" : 0, "end_offset" : 6, "type" : "", "position" : 0 }, { "token" : "djokovic", "start_offset" : 6, "end_offset" : 7, "type" : "", "position" : 1 }, { "token" : "djoković", "start_offset" : 6, "end_offset" : 7, "type" : "", "position" : 1 } ] ``` This seems OK, so when i try to search i get following results: 1. Djokovic - FOUND 2. Đoković - NOT FOUND Why I can't find when typing Đoković ? Token is here ... ---
**Author:** ![Ivan](https://avatars.discourse-cdn.com/v4/letter/i/df788c/32.png) [@Ivan](https://discuss.elastic.co/u/Ivan)\ **Post date:** [October 23, 2017, 8:09pm UTC](https://discuss.elastic.co/t/serbian-analyzer-setup/104893/2 "2017-10-23T20:09:21Z")
What is your mapping and what kind of query? Perhaps something is not being mapped properly. Letters such as 'Đ' should be supported by the ASCII folding filter: > Živjeli, Ivan ---
**Author:** ![srda1989](https://avatars.discourse-cdn.com/v4/letter/s/e36b37/32.png) [@srda1989](https://discuss.elastic.co/u/srda1989)\ **Post date:** [October 24, 2017, 7:47am UTC](https://discuss.elastic.co/t/serbian-analyzer-setup/104893/3 "2017-10-24T07:47:52Z")
Hi Ivan ( Pozdrav 😃 ) Letter Đ is supported in asciifolding filter, but it is translated to letter d, and that is not what I want. I wont it to be translated to letter dj because that's how users will search for, right? I could use char mapping but I also want to keep original (like asciifolding filter does) Here is mapping of my\_index ``` { "my_index": { "mappings": { "post": { "properties": { "id": { "type": "long" }, "title": { "type": "text", "fields": { "keyword": { "type": "keyword", "ignore_above": 256 } } } } } } } } ``` And here is query (curl) ``` curl -XGET 'localhost:9200/my_index/_search?pretty' -H 'Content-Type: application/json' -d' { "query": { "query_string": { "default_field": "title", "query": "djokovic*" } } } ' ``` result: ``` { "took" : 2, "timed_out" : false, "_shards" : { "total" : 5, "successful" : 5, "failed" : 0 }, "hits" : { "total" : 1, "max_score" : 0.30138126, "hits" : [ { "_index" : "my_index", "_type" : "post", "_id" : "1", "_score" : 0.30138126, "_source" : { "id" : 1, "title" : "Novak Đoković ponovo prvak mastersa" } } ] } } ``` but when I search with "đ" (like many users would do) ``` curl -XGET 'localhost:9200/my_index/_search?pretty' -H 'Content-Type: application/json' -d' { "query": { "query_string": { "default_field": "title", "query": "đokovic*" } } } ' ``` I get no results ``` { "took" : 3, "timed_out" : false, "_shards" : { "total" : 5, "successful" : 5, "failed" : 0 }, "hits" : { "total" : 0, "max_score" : null, "hits" : [] } } ``` ---
**Author:** ![Ivan](https://avatars.discourse-cdn.com/v4/letter/i/df788c/32.png) [@Ivan](https://discuss.elastic.co/u/Ivan)\ **Post date:** [October 24, 2017, 6:44pm UTC](https://discuss.elastic.co/t/serbian-analyzer-setup/104893/4 "2017-10-24T18:44:38Z")
The original JSON was not formatted, so I missed the fact that you are setting the default analyzer. So it should not be a mapping issue. Searching for "đokovic" does return a correct result, but you are looking to apply a wildcard as well "đokovic\*". Enable analyze\_wildcard on the query\_string query to allow the term to go through the analysis process. I would also suggest looking into ICU analysis [1] since it goes beyond basic ASCII folding. ASCII folding is good for removing accents, but not for Serbian Latin since characters like đ are not simply d with an accent, but a whole other letter. [https://www.elastic.co/guide/en/elasticsearch/plugins/current/analysis-icu.html](https://www.elastic.co/guide/en/elasticsearch/plugins/current/analysis-icu.html) Cheers, Ivan ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [November 21, 2017, 6:45pm UTC](https://discuss.elastic.co/t/serbian-analyzer-setup/104893/5 "2017-11-21T18:45:01Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.