# List of keywords which standard analyzer use to tokenize the input value

**URL:** <https://discuss.elastic.co/t/list-of-keywords-which-standard-analyzer-use-to-tokenize-the-input-value/13325>\
**Category:** Elasticsearch\
**Created:** [August 26, 2013, 11:26am UTC](https://discuss.elastic.co/t/list-of-keywords-which-standard-analyzer-use-to-tokenize-the-input-value/13325 "2013-08-26T11:26:27Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![Ankit\_Jain](https://avatars.discourse-cdn.com/v4/letter/a/96bed5/32.png) [@Ankit\_Jain](https://discuss.elastic.co/u/Ankit_Jain)\
**Post date:** [August 26, 2013, 11:26am UTC](https://discuss.elastic.co/t/list-of-keywords-which-standard-analyzer-use-to-tokenize-the-input-value/13325/1 "2013-08-26T11:26:27Z")

</div>

Hi All,

We have required list of keyword (like "+","@",..) on the basis of th which  
standard analyzer use to tokenize the input value.

Regards,  
Ankit

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![Ankit\_Jain](https://avatars.discourse-cdn.com/v4/letter/a/96bed5/32.png) [@Ankit\_Jain](https://discuss.elastic.co/u/Ankit_Jain)\
**Post date:** [August 26, 2013, 11:27am UTC](https://discuss.elastic.co/t/list-of-keywords-which-standard-analyzer-use-to-tokenize-the-input-value/13325/2 "2013-08-26T11:27:04Z")

</div>

Hi All,

Please read the above statement as:

We have required list of keyword (like "+","@",..) which standard analyzer  
use to tokenize the input value.

Regards,  
Ankit

On Monday, 26 August 2013 16:56:27 UTC+5:30, Ankit Jain wrote:

> Hi All,
> 
> We have required list of keyword (like "+","@",..) on the basis of th  
> which standard analyzer use to tokenize the input value.
> 
> Regards,  
> Ankit

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![brian\_yoder](https://avatars.discourse-cdn.com/v4/letter/b/f1d935/32.png) [@brian\_yoder](https://discuss.elastic.co/u/brian_yoder)\
**Post date:** [August 26, 2013, 2:28pm UTC](https://discuss.elastic.co/t/list-of-keywords-which-standard-analyzer-use-to-tokenize-the-input-value/13325/3 "2013-08-26T14:28:17Z")

</div>

Ankit,

It seems as though this might help:

> **[Elasticsearch Platform — Find real-time answers at scale](https://www.elastic.co)**
>
> Power insights and outcomes with the Elasticsearch Platform and AI. See into your data and find answers that matter with enterprise solutions designed to help you build, observe, and protect. Try Elasticsearch free today.

Of course, the regular expressions will be used to match the token  
separators, not the tokens themselves.

And, of course, it does involve regular expressions, which is the tool of  
very last resort 🙂 But in this case, it seems like the only option you  
have. To make your life easier, I highly recommend that you find a tool  
that can analyze an arbitrary string. This would let you change and  
fine-tune the analyzer. I wrote my own command-line interface and use it to  
develop and to regression-test custom analyzers, and it has been very  
helpful.

Brian

On Monday, August 26, 2013 7:27:04 AM UTC-4, Ankit Jain wrote:

> Hi All,
> 
> We have required list of keyword (like "+","@",..) which standard analyzer  
> use to tokenize the input value.
> 
> Regards,  
> Ankit

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 2:19am UTC](https://discuss.elastic.co/t/list-of-keywords-which-standard-analyzer-use-to-tokenize-the-input-value/13325/4 "2017-07-06T02:19:48Z")

</div>


