# Custom search analyzer problem

**URL:** <https://discuss.elastic.co/t/custom-search-analyzer-problem/63584>\
**Category:** Elasticsearch\
**Created:** [October 21, 2016, 8:33am UTC](https://discuss.elastic.co/t/custom-search-analyzer-problem/63584 "2016-10-21T08:33:18Z")\
**Posts on this page:** 10\
**Page:** 1

<div class="post-metadata">

**Author:** ![cirot87](https://avatars.discourse-cdn.com/v4/letter/c/b782af/32.png) [@cirot87](https://discuss.elastic.co/u/cirot87)\
**Post date:** [October 21, 2016, 8:33am UTC](https://discuss.elastic.co/t/custom-search-analyzer-problem/63584/1 "2016-10-21T08:33:18Z")

</div>

Hi, i'm using es 5.0 rc1 and this is my use-case:

I have 2 custom analyzer that i want use only when i do a search but i don't want set them on field so:

mappings:

> ```
> {
> "settings": {
> "number_of_shards": 5,
> "number_of_replicas": 1,
> "index": {
> "refresh_interval": "1s",
> "mapper.dynamic": false,
> "analysis": {
> "filter": {
> "italian_elision": {
> "type": "elision",
> "articles": ["c","l","all","dall","dell","nell","sull","coll","pell","gl","agl","dagl","degl","negl","sugl","un","m","t","s","v","d"]
> },
> "italian_stop": {
> "type": "stop",
> "stopwords": "_italian_"
> },
> "italian_stemmer": {
> "type": "stemmer",
> "language": "italian"
> }
> },
> "analyzer": {
> "an": {
> "type": "standard"
> },
> "it": {
> "tokenizer": "standard",
> "filter":[
> "italian_elision",
> "lowercase",
> "italian_stop",
> "italian_stemmer"
> ]
> },
> "es":{...},
> "en":{...}
> }
> }
> }
> },
> "mappings": {
> "test": {
> "dynamic": "strict",
> "properties": {
> "iso": {
> "type": "keyword"
> },
> "title": {
> "type": "keyword",
> "fields": {
> "it": { "type": "text", "analyzer": "it"}
> }
> },
> "description": {
> "type": "keyword",
> "fields": {
> "an": { "type": "text", "analyzer": "an"}
> }
> }
> }
> }
> }
> }
> 
> ```

query:

> ```
> {
> "query": {
> "bool":{"must":[
> {"match": {
> "description":{
> "query":"addetto",
> "analyzer": "it"
> }}},
> {"match": {
> "iso": "IT"
> }}
> ]}},
> "highlight": {
> "fields": {
> "iso": {},
> "title": {}
> }
> }
> }
> 
> ```

if i launch the query i have no result, in the previous release i can do this.

if i search with title.it its work but i my case i want a dynamic call for analyzer.

I don't know why this not work for me now. I'm wrong? or what?

---

<div class="post-metadata">

**Author:** ![cbuescher](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/cbuescher/32/60402_2.png) [@cbuescher](https://discuss.elastic.co/u/cbuescher)\
**Post date:** [October 21, 2016, 8:55am UTC](https://discuss.elastic.co/t/custom-search-analyzer-problem/63584/2 "2016-10-21T08:55:40Z")

</div>

Hi,

there's a conceptual problem here. Your can change the "search\_analyzer" that is used to analyze the query itself, but the index time analysis that all documents have to go through cannot be changed dynamically. If you want your query to be able to work with different types of analyzers you need to set up something like [Multi Fields](https://www.elastic.co/guide/en/elasticsearch/reference/current/multi-fields.html) and then switch to whatever variant you need to at search time.

---

<div class="post-metadata">

**Author:** ![Mark\_Harwood](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mark_harwood/32/10538_2.png) [@Mark\_Harwood](https://discuss.elastic.co/u/Mark_Harwood)\
**Post date:** [October 21, 2016, 9:01am UTC](https://discuss.elastic.co/t/custom-search-analyzer-problem/63584/3 "2016-10-21T09:01:44Z")

</div>

Your query is targeting the untokenized `keyword` field "description" (why is this untokenized?)

Your search is using an analyzer that stems addetto to addett, hence no match.

I suspect you want to search a "[description.it](http://description.it)" field here.

---

<div class="post-metadata">

**Author:** ![cirot87](https://avatars.discourse-cdn.com/v4/letter/c/b782af/32.png) [@cirot87](https://discuss.elastic.co/u/cirot87)\
**Post date:** [October 21, 2016, 9:07am UTC](https://discuss.elastic.co/t/custom-search-analyzer-problem/63584/4 "2016-10-21T09:07:07Z")

</div>

hi, i know what you mean and i don't want set analyzer on field, but i want to set analyzer on index and than use it only on search time like this [query](https://www.elastic.co/guide/en/elasticsearch/reference/5.0/query-dsl-match-query-phrase.html)

---

<div class="post-metadata">

**Author:** ![cirot87](https://avatars.discourse-cdn.com/v4/letter/c/b782af/32.png) [@cirot87](https://discuss.elastic.co/u/cirot87)\
**Post date:** [October 21, 2016, 9:11am UTC](https://discuss.elastic.co/t/custom-search-analyzer-problem/63584/5 "2016-10-21T09:11:02Z")

</div>

i need keyword as default becouse i have two basic query for this file one without analyzer and one with analyzer, yes, i want somethings like "[description.it](http://description.it)". If i use another analyzer as my "an" -\>standard analyzer i have no result

---

<div class="post-metadata">

**Author:** ![Mark\_Harwood](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mark_harwood/32/10538_2.png) [@Mark\_Harwood](https://discuss.elastic.co/u/Mark_Harwood)\
**Post date:** [October 21, 2016, 9:17am UTC](https://discuss.elastic.co/t/custom-search-analyzer-problem/63584/6 "2016-10-21T09:17:19Z")

</div>

Here's my reproduction with some debug hints thrown in:

```
DELETE test

//Note added description.it field and using fielddata:true on this small index so I can debug contents.
PUT test
{
	"settings": {
		"number_of_shards": 1,
		"number_of_replicas": 0,
		"index": {
			"refresh_interval": "1s",
			"mapper.dynamic": false,
			"analysis": {
				"filter": {
					"italian_elision": {
						"type": "elision",
						"articles": ["c","l","all","dall","dell","nell","sull","coll","pell","gl","agl","dagl","degl","negl","sugl","un","m","t","s","v","d"]
					},
					"italian_stop": {
						"type": "stop",
						"stopwords": "_italian_"
					},
					"italian_stemmer": {
						"type": "stemmer",
						"language": "italian"
					}
				},
				"analyzer": {
					"an": {
						"type": "standard"
					},
					"it": {
						"tokenizer": "standard",
						"filter":[
							"italian_elision",
							"lowercase",
							"italian_stop",
							"italian_stemmer"
						]
					}
				}
			}
		}
	},
	"mappings": {
		"test": {
			"dynamic": "strict",
			"properties": {
				"iso": {
					"type": "keyword"
				},
				"title": {
					"type": "keyword",
					"fields": {
						"it": { "type": "text", "analyzer": "it"}
					}
				},
				"description": {
					"type": "keyword",
					"fields": {
						"an": { "type": "text", "analyzer": "an"},
						"it": { "type": "text", "analyzer": "it", "fielddata": true}                        
					}
				}
			}
		}
	}
}

//Index one doc	
POST test/test
{
	"iso":"IT",
	"description":"addetto"
}

//Show index contents
GET test/_search
{
	"aggs":{
		"terms":{
			"terms":{
			"field":"description.it"}
		}
	}
}

//Run search, note use of explain API
GET test/_search
{
   "explain": true, 
  "query": {
	"bool":{"must":[
	{"match": {
	  "description.it":{
		"query":"addetto"
	}}},
	{"match": {
	  "iso": "IT"
	}}
  ]}},
  "highlight": {
	"fields": {
	  "iso": {},
	  "title": {}
	}
  }
}
```

---

<div class="post-metadata">

**Author:** ![cirot87](https://avatars.discourse-cdn.com/v4/letter/c/b782af/32.png) [@cirot87](https://discuss.elastic.co/u/cirot87)\
**Post date:** [October 21, 2016, 9:35am UTC](https://discuss.elastic.co/t/custom-search-analyzer-problem/63584/7 "2016-10-21T09:35:32Z")

</div>

yes, all correct....but i don't want this:

```
> "description": {
> "type": "keyword",
> "fields": {
> "an": { "type": "text", "analyzer": "an"},
> "it": { "type": "text", "analyzer": "it", "fielddata": true}                        
> }
> }

```

I have about 25 field on this index and about 13 analyzer, i can't set all analyzer for all field at index time....but i want call one analyzer only on query...this code is on the documentation:

```
{
    "query": {
        "match_phrase" : {
            "message" : {
                "query" : "this is a test",
                "analyzer" : "my_analyzer"
            }
        }
    }
}

```

so i can set analyzer on settings, and call it when querying...but now on this version of es don't work

---

<div class="post-metadata">

**Author:** ![Mark\_Harwood](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mark_harwood/32/10538_2.png) [@Mark\_Harwood](https://discuss.elastic.co/u/Mark_Harwood)\
**Post date:** [October 21, 2016, 9:47am UTC](https://discuss.elastic.co/t/custom-search-analyzer-problem/63584/8 "2016-10-21T09:47:19Z")

</div>

> [@cirot87](#):
>
> but now on this version of es don't work

Sorry, I'm unclear as to what used to work and is now broken.  
Can you provide the before and after commands to demonstrate the issue?

---

<div class="post-metadata">

**Author:** ![cirot87](https://avatars.discourse-cdn.com/v4/letter/c/b782af/32.png) [@cirot87](https://discuss.elastic.co/u/cirot87)\
**Post date:** [October 21, 2016, 10:00am UTC](https://discuss.elastic.co/t/custom-search-analyzer-problem/63584/9 "2016-10-21T10:00:27Z")

</div>

mmm now i have only one server with the last version of elastic....i'll try to do something for this.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 5, 2017, 10:10pm UTC](https://discuss.elastic.co/t/custom-search-analyzer-problem/63584/10 "2017-07-05T22:10:36Z")

</div>