# Stemmer token filter result is different that it should be

**URL:** <https://discuss.elastic.co/t/stemmer-token-filter-result-is-different-that-it-should-be/17620>\
**Category:** Elasticsearch\
**Created:** [May 20, 2014, 12:03pm UTC](https://discuss.elastic.co/t/stemmer-token-filter-result-is-different-that-it-should-be/17620 "2014-05-20T12:03:24Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![adrienbigler](https://avatars.discourse-cdn.com/v4/letter/a/b4bc9f/32.png) [@adrienbigler](https://discuss.elastic.co/u/adrienbigler)\
**Post date:** [May 20, 2014, 12:03pm UTC](https://discuss.elastic.co/t/stemmer-token-filter-result-is-different-that-it-should-be/17620/1 "2014-05-20T12:03:24Z")

</div>

If I try to analyze the following text

GET \_analyze?analyzer=french&text=Ils maintenaient la machine

It results 2 tokens: "maintenaient", "machin".

Elasticsearch apply more options to the default snowball stemming  
algorithm. Without these options, the result for the first token should be  
"mainten" (approved by the  
documentation [http://snowball.tartarus.org/algorithms/french/stemmer.html](http://snowball.tartarus.org/algorithms/french/stemmer.html)).

What are these additional options that elasticsearch add to the standard  
snowball analyzer?

TIA

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/0522456e-f7c2-4f6b-907c-d4ee9f53b6b9%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/0522456e-f7c2-4f6b-907c-d4ee9f53b6b9%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![Robert\_Muir\_2](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/robert_muir_2/32/931_2.png) [@Robert\_Muir\_2](https://discuss.elastic.co/u/Robert_Muir_2)\
**Post date:** [May 20, 2014, 1:02pm UTC](https://discuss.elastic.co/t/stemmer-token-filter-result-is-different-that-it-should-be/17620/2 "2014-05-20T13:02:53Z")

</div>

When you use the "french" analyzer it uses the Lucene FrenchAnalyzer  
behind the scenes, which does not use the snowball algorithm.

It uses the Savoy stemmer, the same as specifying "light\_french"  
stemmer: [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/analysis-stemmer-tokenfilter.html)

On Tue, May 20, 2014 at 8:03 AM, [adrienbigler@gmail.com](mailto:adrienbigler@gmail.com) wrote:

> If I try to analyze the following text
> 
> GET \_analyze?analyzer=french&text=Ils maintenaient la machine
> 
> It results 2 tokens: "maintenaient", "machin".
> 
> Elasticsearch apply more options to the default snowball stemming algorithm.  
> Without these options, the result for the first token should be "mainten"  
> (approved by the documentation  
> [French stemming algorithm](http://snowball.tartarus.org/algorithms/french/stemmer.html)).
> 
> What are these additional options that elasticsearch add to the standard  
> snowball analyzer?
> 
> TIA
> 
> --  
> You received this message because you are subscribed to the Google Groups  
> "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an  
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> To view this discussion on the web visit  
> [https://groups.google.com/d/msgid/elasticsearch/0522456e-f7c2-4f6b-907c-d4ee9f53b6b9%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/0522456e-f7c2-4f6b-907c-d4ee9f53b6b9%40googlegroups.com).  
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAMUKNZWK5PyE%3DsrOr4SwMe91Ug%3D3BzVNOZkN5z8O-QY8DZHhRg%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAMUKNZWK5PyE%3DsrOr4SwMe91Ug%3D3BzVNOZkN5z8O-QY8DZHhRg%40mail.gmail.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 1:28am UTC](https://discuss.elastic.co/t/stemmer-token-filter-result-is-different-that-it-should-be/17620/3 "2017-07-06T01:28:08Z")

</div>


