# Problem with uax\_url\_email tokenizer

**URL:** <https://discuss.elastic.co/t/problem-with-uax-url-email-tokenizer/7989>\
**Category:** Elasticsearch\
**Created:** [June 6, 2012, 4:37am UTC](https://discuss.elastic.co/t/problem-with-uax-url-email-tokenizer/7989 "2012-06-06T04:37:28Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Yuriy\_Vasilyev](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/yuriy_vasilyev/32/2854_2.png) [@Yuriy\_Vasilyev](https://discuss.elastic.co/u/Yuriy_Vasilyev)\
**Post date:** [June 6, 2012, 4:37am UTC](https://discuss.elastic.co/t/problem-with-uax-url-email-tokenizer/7989/1 "2012-06-06T04:37:28Z")

</div>

I have in my index cyrilic urls which looks like www.100тысячкниг.рф  
and prefix search on this entries work bad (  
If I try non-cyrilic url such as [www.yandex.ru](http://www.yandex.ru) all works fine

How I can solve this problem?

HTTP/1.1 200 OK  
Content-Type: application/json; charset=UTF-8  
Content-Length: 198

{"tokens":[{"token":"www","start\_offset":0,"end\_offset":  
3,"type":"","position":1},  
{"token":"100тысячкниг.рф","start\_offset":4,"end\_offset":  
19,"type":"","position":2}]}

HTTP/1.1 200 OK  
Access-Control-Allow-Origin: \*  
Content-Type: application/json; charset=UTF-8  
Content-Length: 104

{"tokens":[{"token":"[www.yandex.ru](http://www.yandex.ru)","start\_offset":0,"end\_offset":  
13,"type":"","position":1}]}

---

<div class="post-metadata">

**Author:** ![Yuriy\_Vasilyev](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/yuriy_vasilyev/32/2854_2.png) [@Yuriy\_Vasilyev](https://discuss.elastic.co/u/Yuriy_Vasilyev)\
**Post date:** [June 8, 2012, 2:19am UTC](https://discuss.elastic.co/t/problem-with-uax-url-email-tokenizer/7989/2 "2012-06-08T02:19:57Z")

</div>

UP

среда, 6 июня 2012 г., 11:37:28 UTC+7 пользователь Yuriy Vasilyev написал:

> I have in my index cyrilic urls which looks like www.100тысячкниг.рф  
> and prefix search on this entries work bad (  
> If I try non-cyrilic url such as [www.yandex.ru](http://www.yandex.ru) all works fine
> 
> How I can solve this problem?
> 
> HTTP/1.1 200 OK  
> Content-Type: application/json; charset=UTF-8  
> Content-Length: 198
> 
> {"tokens":[{"token":"www","start\_offset":0,"end\_offset":  
> 3,"type":"","position":1},  
> {"token":"100тысячкниг.рф","start\_offset":4,"end\_offset":  
> 19,"type":"","position":2}]}
> 
> HTTP/1.1 200 OK  
> Access-Control-Allow-Origin: \*  
> Content-Type: application/json; charset=UTF-8  
> Content-Length: 104
> 
> {"tokens":[{"token":"[www.yandex.ru](http://www.yandex.ru)","start\_offset":0,"end\_offset":  
> 13,"type":"","position":1}]}

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 3:25am UTC](https://discuss.elastic.co/t/problem-with-uax-url-email-tokenizer/7989/3 "2017-07-06T03:25:15Z")

</div>