# Multichar delimiter in path\_hierarchy tokenizer

**URL:** <https://discuss.elastic.co/t/multichar-delimiter-in-path-hierarchy-tokenizer/16203>\
**Category:** Elasticsearch\
**Created:** [March 6, 2014, 5:25pm UTC](https://discuss.elastic.co/t/multichar-delimiter-in-path-hierarchy-tokenizer/16203 "2014-03-06T17:25:56Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![damienclaveau](https://avatars.discourse-cdn.com/v4/letter/d/aca169/32.png) [@damienclaveau](https://discuss.elastic.co/u/damienclaveau)\
**Post date:** [March 6, 2014, 5:25pm UTC](https://discuss.elastic.co/t/multichar-delimiter-in-path-hierarchy-tokenizer/16203/1 "2014-03-06T17:25:56Z")

</div>

Hi,  
At the moment, the delimiter in a path\_hierarchy tokenizer must be a single  
char.

For example, something like this is not allowed :  
"tokenizer": {  
"arrow\_path\_tokenizer": {  
"type": "path\_hierarchy",  
"delimiter": "--\>"  
}  
}

Please, can some somebody give advice on which other tokenizer I could  
configure  
to obtain the same behaviour as the path\_hierarchy tokenizer but with my  
"--\>" delimiter ?

--  
View this message in context: [http://elasticsearch-users.115913.n3.nabble.com/multichar-delimiter-in-path-hierarchy-tokenizer-tp4051191.html](http://elasticsearch-users.115913.n3.nabble.com/multichar-delimiter-in-path-hierarchy-tokenizer-tp4051191.html)  
Sent from the ElasticSearch Users mailing list archive at [Nabble.com](http://Nabble.com).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/1394126756149-4051191.post%40n3.nabble.com](https://groups.google.com/d/msgid/elasticsearch/1394126756149-4051191.post%40n3.nabble.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![Clinton\_Gormley](https://avatars.discourse-cdn.com/v4/letter/c/50afbb/32.png) [@Clinton\_Gormley](https://discuss.elastic.co/u/Clinton_Gormley)\
**Post date:** [March 11, 2014, 12:00pm UTC](https://discuss.elastic.co/t/multichar-delimiter-in-path-hierarchy-tokenizer/16203/2 "2014-03-11T12:00:57Z")

</div>

You could fake it using the pattern\_replace character filter:

curl -XPUT "[http://localhost:9200/myindex](http://localhost:9200/myindex)" -d'  
{  
"settings": {  
"analysis": {  
"analyzer": {  
"arrow": {  
"tokenizer": "path\_hierarchy",  
"char\_filter": [  
"arrow\_to\_slash"  
]  
}  
},  
"char\_filter": {  
"arrow\_to\_slash": {  
"type": "pattern\_replace",  
"pattern": "--\>",  
"replacement": "/"  
}  
}  
}  
}  
}'

curl -XGET "[http://localhost:9200/myindex/\_analyze?analyzer=arrow](http://localhost:9200/myindex/_analyze?analyzer=arrow)" -d '  
foo--\>bar--\>baz  
'

{  
"tokens": [  
{  
"token": "foo",  
"start\_offset": 0,  
"end\_offset": 3,  
"type": "word",  
"position": 1  
},  
{  
"token": "foo/bar",  
"start\_offset": 0,  
"end\_offset": 9,  
"type": "word",  
"position": 1  
},  
{  
"token": "foo/bar/baz",  
"start\_offset": 0,  
"end\_offset": 15,  
"type": "word",  
"position": 1  
}  
]  
}

On 6 March 2014 18:25, damienclaveau [damien.claveau@gmail.com](mailto:damien.claveau@gmail.com) wrote:

> Hi,  
> At the moment, the delimiter in a path\_hierarchy tokenizer must be a single  
> char.
> 
> For example, something like this is not allowed :  
> "tokenizer": {  
> "arrow\_path\_tokenizer": {  
> "type": "path\_hierarchy",  
> "delimiter": "--\>"  
> }  
> }
> 
> Please, can some somebody give advice on which other tokenizer I could  
> configure  
> to obtain the same behaviour as the path\_hierarchy tokenizer but with my  
> "--\>" delimiter ?
> 
> --  
> View this message in context:  
> [http://elasticsearch-users.115913.n3.nabble.com/multichar-delimiter-in-path-hierarchy-tokenizer-tp4051191.html](http://elasticsearch-users.115913.n3.nabble.com/multichar-delimiter-in-path-hierarchy-tokenizer-tp4051191.html)  
> Sent from the Elasticsearch Users mailing list archive at [Nabble.com](http://Nabble.com).
> 
> --  
> You received this message because you are subscribed to the Google Groups  
> "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an  
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> To view this discussion on the web visit  
> [https://groups.google.com/d/msgid/elasticsearch/1394126756149-4051191.post%40n3.nabble.com](https://groups.google.com/d/msgid/elasticsearch/1394126756149-4051191.post%40n3.nabble.com)  
> .  
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAPt3XKQ91zvxp%3DrApq-fzMMg\_mQjCa6zuGM1UcL6zCByPTEk4Q%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAPt3XKQ91zvxp%3DrApq-fzMMg_mQjCa6zuGM1UcL6zCByPTEk4Q%40mail.gmail.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 1:44am UTC](https://discuss.elastic.co/t/multichar-delimiter-in-path-hierarchy-tokenizer/16203/3 "2017-07-06T01:44:16Z")

</div>


