# Custom tokenizer in .NET language, push already tokenized text into ES

**URL:** <https://discuss.elastic.co/t/custom-tokenizer-in-net-language-push-already-tokenized-text-into-es/11776>\
**Category:** Elasticsearch\
**Created:** [May 1, 2013, 10:48pm UTC](https://discuss.elastic.co/t/custom-tokenizer-in-net-language-push-already-tokenized-text-into-es/11776 "2013-05-01T22:48:41Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Victor\_B](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/victor_b/32/2352_2.png) [@Victor\_B](https://discuss.elastic.co/u/Victor_B)\
**Post date:** [May 1, 2013, 10:48pm UTC](https://discuss.elastic.co/t/custom-tokenizer-in-net-language-push-already-tokenized-text-into-es/11776/1 "2013-05-01T22:48:41Z")

</div>

Hi All,

I am from .NET world and I already have my custom tokenizer which is very  
specific to my knowledge domain. I understand how to use my own  
analyzer/tokenizer with a standalone [Lucene.NET](http://Lucene.NET). However I have recently  
discovered ElasticSearch with its great distributed features. This is so  
great that I either will have to port my tokenizer to Java or will have to  
find some tricks.

Could you please tell if it is possible to feed ElasticSearch with already  
tokenized fields from a different application? I could form a JSON document  
structure with all fields already tokenized by my own .NET application.

If the previous option is not possible, I could write a very simple  
Analyzer in Java that will just consume the JSON structure from the  
previous step and transform already tokenized fields to the internal format.

Do you think this is the simplest and good enough approach to marry a .NET  
tokenizer with ElasticSearch, or there are some other better options?

Thanks!  
Victor

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![Itamar\_Syn\_Hershko](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/itamar_syn_hershko/32/725_2.png) [@Itamar\_Syn\_Hershko](https://discuss.elastic.co/u/Itamar_Syn_Hershko)\
**Post date:** [May 2, 2013, 7:07am UTC](https://discuss.elastic.co/t/custom-tokenizer-in-net-language-push-already-tokenized-text-into-es/11776/2 "2013-05-02T07:07:32Z")

</div>

The best route is really to translate your .NET code into Java and run the  
analyzer normally within the ES context. Don't mess with the internals too  
much.

On Thu, May 2, 2013 at 1:48 AM, Victor B. [vbaybekov@gmail.com](mailto:vbaybekov@gmail.com) wrote:

> Hi All,
> 
> I am from .NET world and I already have my custom tokenizer which is very  
> specific to my knowledge domain. I understand how to use my own  
> analyzer/tokenizer with a standalone [Lucene.NET](http://Lucene.NET). However I have recently  
> discovered Elasticsearch with its great distributed features. This is so  
> great that I either will have to port my tokenizer to Java or will have  
> to find some tricks.
> 
> Could you please tell if it is possible to feed Elasticsearch with  
> already tokenized fields from a different application? I could form a JSON  
> document structure with all fields already tokenized by my own .NET  
> application.
> 
> If the previous option is not possible, I could write a very simple  
> Analyzer in Java that will just consume the JSON structure from the  
> previous step and transform already tokenized fields to the internal format.
> 
> Do you think this is the simplest and good enough approach to marry a .NET  
> tokenizer with Elasticsearch, or there are some other better options?
> 
> Thanks!  
> Victor
> 
> --  
> You received this message because you are subscribed to the Google Groups  
> "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an  
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 2:38am UTC](https://discuss.elastic.co/t/custom-tokenizer-in-net-language-push-already-tokenized-text-into-es/11776/3 "2017-07-06T02:38:42Z")

</div>


