# How do language analyzers work?

**URL:** <https://discuss.elastic.co/t/how-do-language-analyzers-work/8621>\
**Category:** Elasticsearch\
**Created:** [August 3, 2012, 5:01am UTC](https://discuss.elastic.co/t/how-do-language-analyzers-work/8621 "2012-08-03T05:01:27Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![ngocvo3103](https://avatars.discourse-cdn.com/v4/letter/n/aca169/32.png) [@ngocvo3103](https://discuss.elastic.co/u/ngocvo3103)\
**Post date:** [August 3, 2012, 5:01am UTC](https://discuss.elastic.co/t/how-do-language-analyzers-work/8621/1 "2012-08-03T05:01:27Z")

</div>

Hi all,

I'm newbie in Elastic Search. I'm interesting in the language analyzers and  
I would like to know how they work.

I tried analyze with the language analyzer for English and this is the  
result:

curl -XGET ' localhost:9200/\_analyze?analyzer=english' -d 'Testing language  
analyzer of Elastic Search: English'

And the tokens I received from ES are:

- test
- languag
- analyz
- elast
- search
- english

Are those tokens the expected result? I think the tokens should be the  
whole word, but there are some incomplete word (languag, analyz, elast)

Regards,  
Sam

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [August 3, 2012, 7:32am UTC](https://discuss.elastic.co/t/how-do-language-analyzers-work/8621/2 "2012-08-03T07:32:16Z")

</div>

Language analyzers extract radical from words.  
If you send languages, language, you will have the same result.

Analyzing, analyzers, analyze... will be considered as equals when analyzed.

HTH  
David

--

Le 3 août 2012 à 07:01, Ngoc Vo [ngoc.vo3103@gmail.com](mailto:ngoc.vo3103@gmail.com) a écrit :

> Hi all,
> 
> I'm newbie in Elastic Search. I'm interesting in the language analyzers and I would like to know how they work.
> 
> I tried analyze with the language analyzer for English and this is the result:
> 
> curl -XGET ' localhost:9200/\_analyze?analyzer=english' -d 'Testing language analyzer of Elastic Search: English'
> 
> And the tokens I received from ES are:
> 
> - test
> - languag
> - analyz
> - elast
> - search
> - english
> 
> Are those tokens the expected result? I think the tokens should be the whole word, but there are some incomplete word (languag, analyz, elast)
> 
> Regards,  
> Sam

---

<div class="post-metadata">

**Author:** ![Shaun\_Etherton](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/shaun_etherton/32/2540_2.png) [@Shaun\_Etherton](https://discuss.elastic.co/u/Shaun_Etherton)\
**Post date:** [August 3, 2012, 7:49am UTC](https://discuss.elastic.co/t/how-do-language-analyzers-work/8621/3 "2012-08-03T07:49:31Z")

</div>

Wikipedia has some general info on stemming that you may find somewhat helpful.

--  
Shaun

On Friday, 3 August 2012 at 17:02, David Pilato wrote:

> Language analyzers extract radical from words.  
> If you send languages, language, you will have the same result.
> 
> Analyzing, analyzers, analyze... will be considered as equals when analyzed.
> 
> HTH  
> David
> 
> --
> 
> Le 3 août 2012 à 07:01, Ngoc Vo [ngoc.vo3103@gmail.com](mailto:ngoc.vo3103@gmail.com) a écrit :
> 
> > Hi all,
> > 
> > I'm newbie in Elastic Search. I'm interesting in the language analyzers and I would like to know how they work.
> > 
> > I tried analyze with the language analyzer for English and this is the result:
> > 
> > curl -XGET ' localhost:9200/\_analyze?analyzer=english' -d 'Testing language analyzer of Elastic Search: English'
> > 
> > And the tokens I received from ES are:
> > 
> > - test
> > - languag
> > - analyz
> > - elast
> > - search
> > - english
> > 
> > Are those tokens the expected result? I think the tokens should be the whole word, but there are some incomplete word (languag, analyz, elast)
> > 
> > Regards,  
> > Sam

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 3:17am UTC](https://discuss.elastic.co/t/how-do-language-analyzers-work/8621/4 "2017-07-06T03:17:54Z")

</div>


