I want a custom analyzer that can take a string like "((hello world!))" and give me a token list of: ["(", "(", "hello", "world", "!", ")", ")"] That is to say, I basically want the "letter" tokenizer, but I want to keep the non letter characters and tokenize them as a single character length toke…

Create an analyzer to tokenize non-alphanumeric characters

nik9000 (Nik Everett) September 23, 2016, 5:01pm 4

If you have an idea for improving the documentation for the tokenizer can you open an issue? I'd certainly be happy to review it.

Both UNICODE_CHAR_CLASS and UNICODE_CHARACTER_CLASS should work. What error are you seeing?

Topic		Replies	Views
Pattern Analyzer with separator tokens Elasticsearch	1	334	July 6, 2017
Custom tokenizer for letter and digits Elasticsearch	3	910	April 27, 2020
Phrases with special characters Elasticsearch	1	1408	July 6, 2017
Using PatternTokenizer Elasticsearch	5	293	July 6, 2017
Non-standart analizer/tokenizer Elasticsearch	2	468	July 5, 2017