# Not able to see whether data stemmed or not!

**URL:** <https://discuss.elastic.co/t/not-able-to-see-whether-data-stemmed-or-not/21823>\
**Category:** Elasticsearch\
**Created:** [January 26, 2015, 3:11am UTC](https://discuss.elastic.co/t/not-able-to-see-whether-data-stemmed-or-not/21823 "2015-01-26T03:11:45Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![Panzer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/panzer/32/927_2.png) [@Panzer](https://discuss.elastic.co/u/Panzer)\
**Post date:** [January 26, 2015, 3:11am UTC](https://discuss.elastic.co/t/not-able-to-see-whether-data-stemmed-or-not/21823/1 "2015-01-26T03:11:45Z")

</div>

I set up an index using those settings :

{  
"settings": {  
"index": {  
"type": "default"  
},  
"number\_of\_shards": 1,  
"number\_of\_replicas": 0,  
"analysis": {  
"filter": {  
"stopper": {  
"type": "stop",  
"stopwords": "_english_"  
},  
"stemmer\_light": {  
"type": "stemmer",  
"name": "light\_english"  
},  
"stemmer\_possessive": {  
"type": "stemmer",  
"name": "possessive\_english"  
}  
},  
"analyzer": {  
"new\_analyzer" : {  
"type": "custom",  
"tokenizer": "whitespace",  
"filter": ["stopper",  
"lowercase",  
"whitespace",  
"stemmer\_light",  
"stemmer\_possessive"]  
}  
}  
}  
}  
}

After I am done with indexing I run these:  
GET /index1/document/1101/\_source

GET /index1/\_mtermvectors/  
{  
"docs": [  
{  
"\_type": "news",  
"\_id": "1101",  
"fields": ["text"],  
"term\_statistics": true  
}  
]  
}

None of these show me stemmed words and moreover all still have the stop  
words in them!!! What am I doing wrong?

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/f5d6a6df-ca79-427a-9b1a-74fca04e8b40%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/f5d6a6df-ca79-427a-9b1a-74fca04e8b40%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [January 26, 2015, 4:42am UTC](https://discuss.elastic.co/t/not-able-to-see-whether-data-stemmed-or-not/21823/2 "2015-01-26T04:42:05Z")

</div>

I can't see any mapping set here. Could you GIST a full example?

May be you just forgot to use the analyzer you defined?

David

> Le 26 janv. 2015 à 04:11, Panzer [appythoncheck@gmail.com](mailto:appythoncheck@gmail.com) a écrit :
> 
> I set up an index using those settings :
> 
> {  
> "settings": {  
> "index": {  
> "type": "default"  
> },  
> "number\_of\_shards": 1,  
> "number\_of\_replicas": 0,  
> "analysis": {  
> "filter": {  
> "stopper": {  
> "type": "stop",  
> "stopwords": "_english_"  
> },  
> "stemmer\_light": {  
> "type": "stemmer",  
> "name": "light\_english"  
> },  
> "stemmer\_possessive": {  
> "type": "stemmer",  
> "name": "possessive\_english"  
> }  
> },  
> "analyzer": {  
> "new\_analyzer" : {  
> "type": "custom",  
> "tokenizer": "whitespace",  
> "filter": ["stopper",  
> "lowercase",  
> "whitespace",  
> "stemmer\_light",  
> "stemmer\_possessive"]  
> }  
> }  
> }  
> }  
> }
> 
> After I am done with indexing I run these:  
> GET /index1/document/1101/\_source
> 
> GET /index1/\_mtermvectors/  
> {  
> "docs": [  
> {  
> "\_type": "news",  
> "\_id": "1101",  
> "fields": ["text"],  
> "term\_statistics": true  
> }  
> ]  
> }
> 
> ## None of these show me stemmed words and moreover all still have the stop words in them!!! What am I doing wrong?
> 
> You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/f5d6a6df-ca79-427a-9b1a-74fca04e8b40%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/f5d6a6df-ca79-427a-9b1a-74fca04e8b40%40googlegroups.com).  
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/3E9F9B05-2114-4FF2-9A1F-4725F49AB566%40pilato.fr](https://groups.google.com/d/msgid/elasticsearch/3E9F9B05-2114-4FF2-9A1F-4725F49AB566%40pilato.fr).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![Panzer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/panzer/32/927_2.png) [@Panzer](https://discuss.elastic.co/u/Panzer)\
**Post date:** [January 26, 2015, 12:40pm UTC](https://discuss.elastic.co/t/not-able-to-see-whether-data-stemmed-or-not/21823/3 "2015-01-26T12:40:57Z")

</div>

"document": {  
"properties": {  
"text": {  
"type": "string",  
"store": true,  
"index": "analyzed",  
"term\_vector": "with\_positions\_offsets\_payloads",  
"filter": "stopper",  
"analyzer": "new\_analyzer"  
},  
"doc\_length": {  
"type": "long",  
"store": true,  
"index": "not\_analyzed"  
}  
}  
}

This was the mapping I was using.

On Sunday, January 25, 2015 at 11:42:14 PM UTC-5, David Pilato wrote:

> I can't see any mapping set here. Could you GIST a full example?
> 
> May be you just forgot to use the analyzer you defined?
> 
> David
> 
> Le 26 janv. 2015 à 04:11, Panzer \<[appyth...@gmail.com](mailto:appyth...@gmail.com) \<javascript:\>\> a  
> écrit :
> 
> I set up an index using those settings :
> 
> {  
> "settings": {  
> "index": {  
> "type": "default"  
> },  
> "number\_of\_shards": 1,  
> "number\_of\_replicas": 0,  
> "analysis": {  
> "filter": {  
> "stopper": {  
> "type": "stop",  
> "stopwords": "_english_"  
> },  
> "stemmer\_light": {  
> "type": "stemmer",  
> "name": "light\_english"  
> },  
> "stemmer\_possessive": {  
> "type": "stemmer",  
> "name": "possessive\_english"  
> }  
> },  
> "analyzer": {  
> "new\_analyzer" : {  
> "type": "custom",  
> "tokenizer": "whitespace",  
> "filter": ["stopper",  
> "lowercase",  
> "whitespace",  
> "stemmer\_light",  
> "stemmer\_possessive"]  
> }  
> }  
> }  
> }  
> }
> 
> After I am done with indexing I run these:  
> GET /index1/document/1101/\_source
> 
> GET /index1/\_mtermvectors/  
> {  
> "docs": [  
> {  
> "\_type": "news",  
> "\_id": "1101",  
> "fields": ["text"],  
> "term\_statistics": true  
> }  
> ]  
> }
> 
> None of these show me stemmed words and moreover all still have the stop  
> words in them!!! What am I doing wrong?
> 
> --  
> You received this message because you are subscribed to the Google Groups  
> "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an  
> email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \<javascript:\>.  
> To view this discussion on the web visit  
> [https://groups.google.com/d/msgid/elasticsearch/f5d6a6df-ca79-427a-9b1a-74fca04e8b40%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/f5d6a6df-ca79-427a-9b1a-74fca04e8b40%40googlegroups.com)  
> [https://groups.google.com/d/msgid/elasticsearch/f5d6a6df-ca79-427a-9b1a-74fca04e8b40%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/f5d6a6df-ca79-427a-9b1a-74fca04e8b40%40googlegroups.com?utm_medium=email&utm_source=footer)  
> .  
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/d202e963-fe2a-4d8f-a699-a80e610fa20f%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/d202e963-fe2a-4d8f-a699-a80e610fa20f%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 12:36am UTC](https://discuss.elastic.co/t/not-able-to-see-whether-data-stemmed-or-not/21823/4 "2017-07-06T00:36:40Z")

</div>


