# Combining tokenizers

**URL:** <https://discuss.elastic.co/t/combining-tokenizers/13398>\
**Category:** Elasticsearch\
**Created:** [August 29, 2013, 7:31pm UTC](https://discuss.elastic.co/t/combining-tokenizers/13398 "2013-08-29T19:31:52Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![Maciej\_Dziardziel](https://avatars.discourse-cdn.com/v4/letter/m/d9b06d/32.png) [@Maciej\_Dziardziel](https://discuss.elastic.co/u/Maciej_Dziardziel)\
**Post date:** [August 29, 2013, 7:31pm UTC](https://discuss.elastic.co/t/combining-tokenizers/13398/1 "2013-08-29T19:31:52Z")

</div>

Is there way to combine lists of tokenizers? Say that I'd like to generate "by product", "by-product" and "byproduct" from "by Product". I can configure tokenizers to generate every variant, but not all of them at once.

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![mvg](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mvg/32/98890_2.png) [@mvg](https://discuss.elastic.co/u/mvg)\
**Post date:** [August 30, 2013, 12:55pm UTC](https://discuss.elastic.co/t/combining-tokenizers/13398/2 "2013-08-30T12:55:23Z")

</div>

You can't combine tokenizers. Perhaps the multi field is useful in your  
case?

> **[Elasticsearch Platform — Find real-time answers at scale](https://www.elastic.co)**
>
> Power insights and outcomes with the Elasticsearch Platform and AI. See into your data and find answers that matter with enterprise solutions designed to help you build, observe, and protect. Try Elasticsearch free today.

On 29 August 2013 21:31, Maciej Dziardziel [fiedzia@gmail.com](mailto:fiedzia@gmail.com) wrote:

> Is there way to combine lists of tokenizers? Say that I'd like to generate  
> "by product", "by-product" and "byproduct" from "by Product". I can  
> configure tokenizers to generate every variant, but not all of them at once.
> 
> --  
> You received this message because you are subscribed to the Google Groups  
> "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an  
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

--  
Met vriendelijke groet,

Martijn van Groningen

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![jprante](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jprante/32/44941_2.png) [@jprante](https://discuss.elastic.co/u/jprante)\
**Post date:** [August 31, 2013, 7:02pm UTC](https://discuss.elastic.co/t/combining-tokenizers/13398/3 "2013-08-31T19:02:31Z")

</div>

You can try the word delimiter token filter  
[http://www.elasticsearch.org/guide/reference/index-modules/analysis/word-delimiter-tokenfilter/](http://www.elasticsearch.org/guide/reference/index-modules/analysis/word-delimiter-tokenfilter/)

Jörg

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 2:18am UTC](https://discuss.elastic.co/t/combining-tokenizers/13398/4 "2017-07-06T02:18:39Z")

</div>


