Hi, we'r using icu_tokenizer to analyze text which may be in many languages. The problem is that text contains hastags like #dog #cat etc. and icu_tokenizer removes the '#' characters from tokens. So we'r not able to find documents which contains exactly the '#cat'. Is there a simple way to achiev…

Configuring icu_tokenizer to keep hashtag in token

Robert_Fiser1 (Robert Fišer) May 16, 2018, 12:15pm 2

Any idea?

Topic		Replies	Views
ICU Tokenizer to keep tags and hashtags in token Elasticsearch	1	211	March 19, 2023
Tokenizing a Hashtag containing underscores Elasticsearch	1	1427	July 5, 2017
Prevent thai tokenizer from tokenizing hashtag Elasticsearch	1	296	December 29, 2022
Tokenizing a hashtag Elasticsearch	2	1134	December 12, 2016
Asian characters and not words are tokenized - CJK Analysis and Tokenization Problems Elasticsearch	8	726	July 6, 2017

Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S. and in other countries
Trademarks
Terms
Privacy
Brand
Code of Conduct

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.

Configuring icu_tokenizer to keep hashtag in token

Related topics