# Index data - tokenizer

**URL:** <https://discuss.elastic.co/t/index-data-tokenizer/203133>\
**Category:** Elasticsearch\
**Created:** [October 11, 2019, 2:56am UTC](https://discuss.elastic.co/t/index-data-tokenizer/203133 "2019-10-11T02:56:40Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![abhishek.tripathi](https://avatars.discourse-cdn.com/v4/letter/a/43a26b/32.png) [@abhishek.tripathi](https://discuss.elastic.co/u/abhishek.tripathi)\
**Post date:** [October 11, 2019, 2:56am UTC](https://discuss.elastic.co/t/index-data-tokenizer/203133/1 "2019-10-11T02:56:40Z")

</div>

HI, I need to tokenize index data column into a new index. Please help me to achieve that

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [October 11, 2019, 5:18am UTC](https://discuss.elastic.co/t/index-data-tokenizer/203133/2 "2019-10-11T05:18:29Z")

</div>

Can you provide an example of what you are looking to achieve?

---

<div class="post-metadata">

**Author:** ![abhishek.tripathi](https://avatars.discourse-cdn.com/v4/letter/a/43a26b/32.png) [@abhishek.tripathi](https://discuss.elastic.co/u/abhishek.tripathi)\
**Post date:** [October 11, 2019, 5:55am UTC](https://discuss.elastic.co/t/index-data-tokenizer/203133/3 "2019-10-11T05:55:00Z")

</div>

Hi Christian,

Suppose that, this is my data in the index:

Index: data\_index  
[  
{  
"id": "123",  
"data": "This is data One"  
},  
{  
"id": "124",  
"data": "This is data Two"  
}  
]

Now I want to save my data on new index like:

Index: token\_index  
[  
{  
"id": "123",  
"data": [  
"This",  
"is",  
"data",  
"One"  
]  
},  
{  
"id": "124",  
"data": [  
"This",  
"is",  
"data",  
"Two"  
]  
}  
]

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [October 11, 2019, 6:34am UTC](https://discuss.elastic.co/t/index-data-tokenizer/203133/4 "2019-10-11T06:34:57Z")

</div>

If you map your data field as text it will be tokenised. If the default is not giving the correct results you can customise it.

---

<div class="post-metadata">

**Author:** ![abhishek.tripathi](https://avatars.discourse-cdn.com/v4/letter/a/43a26b/32.png) [@abhishek.tripathi](https://discuss.elastic.co/u/abhishek.tripathi)\
**Post date:** [October 11, 2019, 6:48am UTC](https://discuss.elastic.co/t/index-data-tokenizer/203133/5 "2019-10-11T06:48:44Z")

</div>

Actually I am new in elastic search. can you give me any example to achive this.

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [October 11, 2019, 7:13am UTC](https://discuss.elastic.co/t/index-data-tokenizer/203133/6 "2019-10-11T07:13:40Z")

</div>

I'm wondering if you should give a look at the \_analyze API.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [November 8, 2019, 7:13am UTC](https://discuss.elastic.co/t/index-data-tokenizer/203133/7 "2019-11-08T07:13:42Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.