Question about multi_field and edge ngram

quain · March 5, 2012, 7:07am

I'm having some trouble with multi_field, perhaps some of you guys
could shed some light on what I'm doing wrong. After I inserted some
documents, I get 0 hits for any searches of the field name.untouched
or name.ngram. I am successful with the main field just searching on
name. For example, the following returns nothing even though i know
the term is there exactly:

curl -XGET 'http://127.0.0.1:9200/test/_search?pretty=1' -d '
{
"query" : {
"text" : {
"name.ngram" : {
"query" : "xyz"
}
}
}
}
'

Here's my mapping:

curl -XPUT 'http://127.0.0.1:9200/test/?pretty=1' -d '
{
"mappings" : {
"member" : {
"properties" : {
"name" : {
"type": "multi_field",
"fields" : {
"untouched": {
"type": "string",
"index": "not_analyzed"
},
"name": {
"type": "string",
"analyzer": "standard_name"
},
"ngram" : {
"search_analyzer": "standard_name",
"index_analyzer": "partial_name",
"type": "string"
}
}
}
}
}
},
"settings" : {
"analysis" : {
"filter" : {
"name_ngrams" : {
"side" : "front",
"max_gram" : 10,
"min_gram" : 1,
"type" : "edgeNGram"
}
},
"analyzer" : {
"standard_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding"
],
"type" : "custom",
"tokenizer" : "standard"
},
"partial_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding",
"name_ngrams"
],
"type" : "custom",
"tokenizer" : "standard"
}
}
}
}
}
'

Can anyone give me some help to identify what might be wrong?

kimchy · March 5, 2012, 3:19pm

Can you gist a sample with setting up the index, the mappings, indexing sample doc(s) and then showing the search request that do not work for you? It would help a lot. (see Elasticsearch Platform — Find real-time answers at scale | Elastic).

On Monday, March 5, 2012 at 9:07 AM, quain wrote:

I'm having some trouble with multi_field, perhaps some of you guys
could shed some light on what I'm doing wrong. After I inserted some
documents, I get 0 hits for any searches of the field name.untouched
or name.ngram. I am successful with the main field just searching on
name. For example, the following returns nothing even though i know
the term is there exactly:

curl -XGET 'http://127.0.0.1:9200/test/_search?pretty=1' -d '
{
"query" : {
"text" : {
"name.ngram" : {
"query" : "xyz"
}
}
}
}
'

Here's my mapping:

curl -XPUT 'http://127.0.0.1:9200/test/?pretty=1' -d '
{
"mappings" : {
"member" : {
"properties" : {
"name" : {
"type": "multi_field",
"fields" : {
"untouched": {
"type": "string",
"index": "not_analyzed"
},
"name": {
"type": "string",
"analyzer": "standard_name"
},
"ngram" : {
"search_analyzer": "standard_name",
"index_analyzer": "partial_name",
"type": "string"
}
}
}
}
}
},
"settings" : {
"analysis" : {
"filter" : {
"name_ngrams" : {
"side" : "front",
"max_gram" : 10,
"min_gram" : 1,
"type" : "edgeNGram"
}
},
"analyzer" : {
"standard_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding"
],
"type" : "custom",
"tokenizer" : "standard"
},
"partial_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding",
"name_ngrams"
],
"type" : "custom",
"tokenizer" : "standard"
}
}
}
}
}
'

Can anyone give me some help to identify what might be wrong?

quain · March 5, 2012, 4:31pm

gist.github.com

https://gist.github.com/jwyuan/1979125

gistfile1.json

curl -XPUT 'http://127.0.0.1:9200/test/?pretty=1'  -d '
{
   "mappings" : {
      "member" : {
         "properties" : {
            "name" : {
               "type": "multi_field",
               "fields" : {
                  "untouched": {
                     "type": "string",

This file has been truncated. show original

Here is the gist. Thanks very much for any help that can be
provided. I'm mostly interested in if I'm setting up the mapping
incorrectly, or using the multi_field or ngram types incorrectly.

On Mar 5, 7:19 am, Shay Banon kim...@gmail.com wrote:

Can you gist a sample with setting up the index, the mappings, indexing sample doc(s) and then showing the search request that do not work for you? It would help a lot. (seehttp://www.elasticsearch.org/help).

On Monday, March 5, 2012 at 9:07 AM, quain wrote:

I'm having some trouble with multi_field, perhaps some of you guys
could shed some light on what I'm doing wrong. After I inserted some
documents, I get 0 hits for any searches of the field name.untouched
or name.ngram. I am successful with the main field just searching on
name. For example, the following returns nothing even though i know
the term is there exactly:

curl -XGET 'http://127.0.0.1:9200/test/_search?pretty=1'-d '
{
"query" : {
"text" : {
"name.ngram" : {
"query" : "xyz"
}
}
}
}
'

Here's my mapping:

curl -XPUT 'http://127.0.0.1:9200/test/?pretty=1'-d '
{
"mappings" : {
"member" : {
"properties" : {
"name" : {
"type": "multi_field",
"fields" : {
"untouched": {
"type": "string",
"index": "not_analyzed"
},
"name": {
"type": "string",
"analyzer": "standard_name"
},
"ngram" : {
"search_analyzer": "standard_name",
"index_analyzer": "partial_name",
"type": "string"
}
}
}
}
}
},
"settings" : {
"analysis" : {
"filter" : {
"name_ngrams" : {
"side" : "front",
"max_gram" : 10,
"min_gram" : 1,
"type" : "edgeNGram"
}
},
"analyzer" : {
"standard_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding"
],
"type" : "custom",
"tokenizer" : "standard"
},
"partial_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding",
"name_ngrams"
],
"type" : "custom",
"tokenizer" : "standard"
}
}
}
}
}
'

Can anyone give me some help to identify what might be wrong?

Garrick_Evans · March 5, 2012, 6:35pm

What if you

"query":{"text":{"name.ngram":"xyz"}}}

?

On Sunday, March 4, 2012 11:07:04 PM UTC-8, quain wrote:

I'm having some trouble with multi_field, perhaps some of you guys
could shed some light on what I'm doing wrong. After I inserted some
documents, I get 0 hits for any searches of the field name.untouched
or name.ngram. I am successful with the main field just searching on
name. For example, the following returns nothing even though i know
the term is there exactly:

curl -XGET 'http://127.0.0.1:9200/test/_search?pretty=1' -d '
{
"query" : {
"text" : {
"name.ngram" : {
"query" : "xyz"
}
}
}
}
'

Here's my mapping:

curl -XPUT 'http://127.0.0.1:9200/test/?pretty=1' -d '
{
"mappings" : {
"member" : {
"properties" : {
"name" : {
"type": "multi_field",
"fields" : {
"untouched": {
"type": "string",
"index": "not_analyzed"
},
"name": {
"type": "string",
"analyzer": "standard_name"
},
"ngram" : {
"search_analyzer": "standard_name",
"index_analyzer": "partial_name",
"type": "string"
}
}
}
}
}
},
"settings" : {
"analysis" : {
"filter" : {
"name_ngrams" : {
"side" : "front",
"max_gram" : 10,
"min_gram" : 1,
"type" : "edgeNGram"
}
},
"analyzer" : {
"standard_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding"
],
"type" : "custom",
"tokenizer" : "standard"
},
"partial_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding",
"name_ngrams"
],
"type" : "custom",
"tokenizer" : "standard"
}
}
}
}
}
'

Can anyone give me some help to identify what might be wrong?

quain · March 5, 2012, 7:10pm

Thanks, but I got the same result, still 0 hits. I didn't get a
syntax error the first time either, so not sure this is the problem.

I thought I pretty much followed the documentation on this, not sure
why it doesn't work.

On Mar 5, 10:35 am, Garrick Evans buk...@gmail.com wrote:

What if you

"query":{"text":{"name.ngram":"xyz"}}}

?

On Sunday, March 4, 2012 11:07:04 PM UTC-8, quain wrote:

I'm having some trouble with multi_field, perhaps some of you guys
could shed some light on what I'm doing wrong. After I inserted some
documents, I get 0 hits for any searches of the field name.untouched
or name.ngram. I am successful with the main field just searching on
name. For example, the following returns nothing even though i know
the term is there exactly:

curl -XGET 'http://127.0.0.1:9200/test/_search?pretty=1' -d '
{
"query" : {
"text" : {
"name.ngram" : {
"query" : "xyz"
}
}
}
}
'

Here's my mapping:

curl -XPUT 'http://127.0.0.1:9200/test/?pretty=1' -d '
{
"mappings" : {
"member" : {
"properties" : {
"name" : {
"type": "multi_field",
"fields" : {
"untouched": {
"type": "string",
"index": "not_analyzed"
},
"name": {
"type": "string",
"analyzer": "standard_name"
},
"ngram" : {
"search_analyzer": "standard_name",
"index_analyzer": "partial_name",
"type": "string"
}
}
}
}
}
},
"settings" : {
"analysis" : {
"filter" : {
"name_ngrams" : {
"side" : "front",
"max_gram" : 10,
"min_gram" : 1,
"type" : "edgeNGram"
}
},
"analyzer" : {
"standard_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding"
],
"type" : "custom",
"tokenizer" : "standard"
},
"partial_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding",
"name_ngrams"
],
"type" : "custom",
"tokenizer" : "standard"
}
}
}
}
}
'

Can anyone give me some help to identify what might be wrong?

Garrick_Evans · March 5, 2012, 8:33pm

You are posting to a "test" type but you created the mapping for "member".
Try:

curl - POST 'http://localhost:9200/test/member?pretty=true' -d '{ "name" :
"The Office" }'
curl - POST 'http://localhost:9200/test/member?pretty=true' -d '{ "name" :
"The Office (UK)" }'

You should then be able to query like:

curl -XGET http://localhost:9200/test/_search?pretty=1 -d
'{"query":{"text":{"name.ngram":"th"}}}'
{
"took" : 1,
"timed_out" : false,
"_shards" : {
"total" : 5,
"successful" : 5,
"failed" : 0
},
"hits" : {
"total" : 2,
"max_score" : 0.25,
"hits" : [ {
"_index" : "test",
"_type" : "member",
"_id" : "MLleoK0pR8eBGhY9pkm0ig",
"_score" : 0.25, "_source" : { "name" : "The Office (UK)" }
}, {
"_index" : "test",
"_type" : "member",
"_id" : "nzY1KZ6mRuqrzxosJBi9IQ",
"_score" : 0.095891505, "_source" : { "name" : "The Office" }
} ]
}

On Monday, March 5, 2012 11:10:51 AM UTC-8, quain wrote:

Thanks, but I got the same result, still 0 hits. I didn't get a
syntax error the first time either, so not sure this is the problem.

I thought I pretty much followed the documentation on this, not sure
why it doesn't work.

On Mar 5, 10:35 am, Garrick Evans buk...@gmail.com wrote:

What if you

"query":{"text":{"name.ngram":"xyz"}}}

?

On Sunday, March 4, 2012 11:07:04 PM UTC-8, quain wrote:

I'm having some trouble with multi_field, perhaps some of you guys
could shed some light on what I'm doing wrong. After I inserted some
documents, I get 0 hits for any searches of the field name.untouched
or name.ngram. I am successful with the main field just searching on
name. For example, the following returns nothing even though i know
the term is there exactly:

curl -XGET 'http://127.0.0.1:9200/test/_search?pretty=1' -d '
{
"query" : {
"text" : {
"name.ngram" : {
"query" : "xyz"
}
}
}
}
'

Here's my mapping:

curl -XPUT 'http://127.0.0.1:9200/test/?pretty=1' -d '
{
"mappings" : {
"member" : {
"properties" : {
"name" : {
"type": "multi_field",
"fields" : {
"untouched": {
"type": "string",
"index": "not_analyzed"
},
"name": {
"type": "string",
"analyzer": "standard_name"
},
"ngram" : {
"search_analyzer": "standard_name",
"index_analyzer": "partial_name",
"type": "string"
}
}
}
}
}
},
"settings" : {
"analysis" : {
"filter" : {
"name_ngrams" : {
"side" : "front",
"max_gram" : 10,
"min_gram" : 1,
"type" : "edgeNGram"
}
},
"analyzer" : {
"standard_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding"
],
"type" : "custom",
"tokenizer" : "standard"
},
"partial_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding",
"name_ngrams"
],
"type" : "custom",
"tokenizer" : "standard"
}
}
}
}
}
'

Can anyone give me some help to identify what might be wrong?

On Monday, March 5, 2012 11:10:51 AM UTC-8, quain wrote:

Thanks, but I got the same result, still 0 hits. I didn't get a
syntax error the first time either, so not sure this is the problem.

I thought I pretty much followed the documentation on this, not sure
why it doesn't work.

On Mar 5, 10:35 am, Garrick Evans buk...@gmail.com wrote:

What if you

"query":{"text":{"name.ngram":"xyz"}}}

?

On Sunday, March 4, 2012 11:07:04 PM UTC-8, quain wrote:

I'm having some trouble with multi_field, perhaps some of you guys
could shed some light on what I'm doing wrong. After I inserted some
documents, I get 0 hits for any searches of the field name.untouched
or name.ngram. I am successful with the main field just searching on
name. For example, the following returns nothing even though i know
the term is there exactly:

curl -XGET 'http://127.0.0.1:9200/test/_search?pretty=1' -d '
{
"query" : {
"text" : {
"name.ngram" : {
"query" : "xyz"
}
}
}
}
'

Here's my mapping:

curl -XPUT 'http://127.0.0.1:9200/test/?pretty=1' -d '
{
"mappings" : {
"member" : {
"properties" : {
"name" : {
"type": "multi_field",
"fields" : {
"untouched": {
"type": "string",
"index": "not_analyzed"
},
"name": {
"type": "string",
"analyzer": "standard_name"
},
"ngram" : {
"search_analyzer": "standard_name",
"index_analyzer": "partial_name",
"type": "string"
}
}
}
}
}
},
"settings" : {
"analysis" : {
"filter" : {
"name_ngrams" : {
"side" : "front",
"max_gram" : 10,
"min_gram" : 1,
"type" : "edgeNGram"
}
},
"analyzer" : {
"standard_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding"
],
"type" : "custom",
"tokenizer" : "standard"
},
"partial_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding",
"name_ngrams"
],
"type" : "custom",
"tokenizer" : "standard"
}
}
}
}
}
'

Can anyone give me some help to identify what might be wrong?

quain · March 5, 2012, 11:35pm

Thanks a lot for pointing this out. This was the problem.

I was wondering, is it possible to apply this mapping to all types
within an index? For example, if I wanted to set the mapping for the
"name" field for all types of the index "test", can I do that?

On Mar 5, 12:33 pm, Garrick Evans buk...@gmail.com wrote:

You are posting to a "test" type but you created the mapping for "member".
Try:

curl - POST 'http://localhost:9200/test/member?pretty=true'-d '{ "name" :
"The Office" }'
curl - POST 'http://localhost:9200/test/member?pretty=true'-d '{ "name" :
"The Office (UK)" }'

You should then be able to query like:

curl -XGEThttp://localhost:9200/test/_search?pretty=1-d
'{"query":{"text":{"name.ngram":"th"}}}'
{
"took" : 1,
"timed_out" : false,
"_shards" : {
"total" : 5,
"successful" : 5,
"failed" : 0
},
"hits" : {
"total" : 2,
"max_score" : 0.25,
"hits" : [ {
"_index" : "test",
"_type" : "member",
"_id" : "MLleoK0pR8eBGhY9pkm0ig",
"_score" : 0.25, "_source" : { "name" : "The Office (UK)" }
}, {
"_index" : "test",
"_type" : "member",
"_id" : "nzY1KZ6mRuqrzxosJBi9IQ",
"_score" : 0.095891505, "_source" : { "name" : "The Office" }
} ]
}
On Monday, March 5, 2012 11:10:51 AM UTC-8, quain wrote:

Thanks, but I got the same result, still 0 hits. I didn't get a
syntax error the first time either, so not sure this is the problem.

I thought I pretty much followed the documentation on this, not sure
why it doesn't work.

On Mar 5, 10:35 am, Garrick Evans buk...@gmail.com wrote:

What if you

"query":{"text":{"name.ngram":"xyz"}}}

?

On Sunday, March 4, 2012 11:07:04 PM UTC-8, quain wrote:

I'm having some trouble with multi_field, perhaps some of you guys
could shed some light on what I'm doing wrong. After I inserted some
documents, I get 0 hits for any searches of the field name.untouched
or name.ngram. I am successful with the main field just searching on
name. For example, the following returns nothing even though i know
the term is there exactly:

curl -XGET 'http://127.0.0.1:9200/test/_search?pretty=1'-d '
{
"query" : {
"text" : {
"name.ngram" : {
"query" : "xyz"
}
}
}
}
'

Here's my mapping:

curl -XPUT 'http://127.0.0.1:9200/test/?pretty=1'-d '
{
"mappings" : {
"member" : {
"properties" : {
"name" : {
"type": "multi_field",
"fields" : {
"untouched": {
"type": "string",
"index": "not_analyzed"
},
"name": {
"type": "string",
"analyzer": "standard_name"
},
"ngram" : {
"search_analyzer": "standard_name",
"index_analyzer": "partial_name",
"type": "string"
}
}
}
}
}
},
"settings" : {
"analysis" : {
"filter" : {
"name_ngrams" : {
"side" : "front",
"max_gram" : 10,
"min_gram" : 1,
"type" : "edgeNGram"
}
},
"analyzer" : {
"standard_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding"
],
"type" : "custom",
"tokenizer" : "standard"
},
"partial_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding",
"name_ngrams"
],
"type" : "custom",
"tokenizer" : "standard"
}
}
}
}
}
'

Can anyone give me some help to identify what might be wrong?
On Monday, March 5, 2012 11:10:51 AM UTC-8, quain wrote:

Thanks, but I got the same result, still 0 hits. I didn't get a
syntax error the first time either, so not sure this is the problem.

I thought I pretty much followed the documentation on this, not sure
why it doesn't work.

On Mar 5, 10:35 am, Garrick Evans buk...@gmail.com wrote:

What if you

"query":{"text":{"name.ngram":"xyz"}}}

?

On Sunday, March 4, 2012 11:07:04 PM UTC-8, quain wrote:

I'm having some trouble with multi_field, perhaps some of you guys
could shed some light on what I'm doing wrong. After I inserted some
documents, I get 0 hits for any searches of the field name.untouched
or name.ngram. I am successful with the main field just searching on
name. For example, the following returns nothing even though i know
the term is there exactly:

curl -XGET 'http://127.0.0.1:9200/test/_search?pretty=1'-d '
{
"query" : {
"text" : {
"name.ngram" : {
"query" : "xyz"
}
}
}
}
'

Here's my mapping:

curl -XPUT 'http://127.0.0.1:9200/test/?pretty=1'-d '
{
"mappings" : {
"member" : {
"properties" : {
"name" : {
"type": "multi_field",
"fields" : {
"untouched": {
"type": "string",
"index": "not_analyzed"
},
"name": {
"type": "string",
"analyzer": "standard_name"
},
"ngram" : {
"search_analyzer": "standard_name",
"index_analyzer": "partial_name",
"type": "string"
}
}
}
}
}
},
"settings" : {
"analysis" : {
"filter" : {
"name_ngrams" : {
"side" : "front",
"max_gram" : 10,
"min_gram" : 1,
"type" : "edgeNGram"
}
},
"analyzer" : {
"standard_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding"
],
"type" : "custom",
"tokenizer" : "standard"
},
"partial_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding",
"name_ngrams"
],
"type" : "custom",
"tokenizer" : "standard"
}
}
}
}
}
'

Can anyone give me some help to identify what might be wrong?

mattweber · March 6, 2012, 12:28am

I think you would use the default mapping:

--
Matt Weber
Sent with Sparrow (http://www.sparrowmailapp.com/?sig)

On Monday, March 5, 2012 at 3:35 PM, quain wrote:

Thanks a lot for pointing this out. This was the problem.

I was wondering, is it possible to apply this mapping to all types
within an index? For example, if I wanted to set the mapping for the
"name" field for all types of the index "test", can I do that?

On Mar 5, 12:33 pm, Garrick Evans <buk...@gmail.com (http://gmail.com)> wrote:

You are posting to a "test" type but you created the mapping for "member".
Try:

curl - POST 'http://localhost:9200/test/member?pretty=true'-d '{ "name" :
"The Office" }'
curl - POST 'http://localhost:9200/test/member?pretty=true'-d '{ "name" :
"The Office (UK)" }'

You should then be able to query like:

curl -XGEThttp://localhost:9200/test/_search?pretty=1-d
'{"query":{"text":{"name.ngram":"th"}}}'
{
"took" : 1,
"timed_out" : false,
"_shards" : {
"total" : 5,
"successful" : 5,
"failed" : 0
},
"hits" : {
"total" : 2,
"max_score" : 0.25,
"hits" : [ {
"_index" : "test",
"_type" : "member",
"_id" : "MLleoK0pR8eBGhY9pkm0ig",
"_score" : 0.25, "_source" : { "name" : "The Office (UK)" }
}, {
"_index" : "test",
"_type" : "member",
"_id" : "nzY1KZ6mRuqrzxosJBi9IQ",
"_score" : 0.095891505, "_source" : { "name" : "The Office" }
} ]
}

On Monday, March 5, 2012 11:10:51 AM UTC-8, quain wrote:

Thanks, but I got the same result, still 0 hits. I didn't get a
syntax error the first time either, so not sure this is the problem.

I thought I pretty much followed the documentation on this, not sure
why it doesn't work.

On Mar 5, 10:35 am, Garrick Evans <buk...@gmail.com (http://gmail.com)> wrote:

What if you

"query":{"text":{"name.ngram":"xyz"}}}

?

On Sunday, March 4, 2012 11:07:04 PM UTC-8, quain wrote:

I'm having some trouble with multi_field, perhaps some of you guys
could shed some light on what I'm doing wrong. After I inserted some
documents, I get 0 hits for any searches of the field name.untouched
or name.ngram. I am successful with the main field just searching on
name. For example, the following returns nothing even though i know
the term is there exactly:

curl -XGET 'http://127.0.0.1:9200/test/_search?pretty=1'-d '
{
"query" : {
"text" : {
"name.ngram" : {
"query" : "xyz"
}
}
}
}
'

Here's my mapping:

curl -XPUT 'http://127.0.0.1:9200/test/?pretty=1'-d '
{
"mappings" : {
"member" : {
"properties" : {
"name" : {
"type": "multi_field",
"fields" : {
"untouched": {
"type": "string",
"index": "not_analyzed"
},
"name": {
"type": "string",
"analyzer": "standard_name"
},
"ngram" : {
"search_analyzer": "standard_name",
"index_analyzer": "partial_name",
"type": "string"
}
}
}
}
}
},
"settings" : {
"analysis" : {
"filter" : {
"name_ngrams" : {
"side" : "front",
"max_gram" : 10,
"min_gram" : 1,
"type" : "edgeNGram"
}
},
"analyzer" : {
"standard_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding"
],
"type" : "custom",
"tokenizer" : "standard"
},
"partial_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding",
"name_ngrams"
],
"type" : "custom",
"tokenizer" : "standard"
}
}
}
}
}
'

Can anyone give me some help to identify what might be wrong?
On Monday, March 5, 2012 11:10:51 AM UTC-8, quain wrote:

Thanks, but I got the same result, still 0 hits. I didn't get a
syntax error the first time either, so not sure this is the problem.

I thought I pretty much followed the documentation on this, not sure
why it doesn't work.

On Mar 5, 10:35 am, Garrick Evans <buk...@gmail.com (http://gmail.com)> wrote:

What if you

"query":{"text":{"name.ngram":"xyz"}}}

?

On Sunday, March 4, 2012 11:07:04 PM UTC-8, quain wrote:

I'm having some trouble with multi_field, perhaps some of you guys
could shed some light on what I'm doing wrong. After I inserted some
documents, I get 0 hits for any searches of the field name.untouched
or name.ngram. I am successful with the main field just searching on
name. For example, the following returns nothing even though i know
the term is there exactly:

curl -XGET 'http://127.0.0.1:9200/test/_search?pretty=1'-d '
{
"query" : {
"text" : {
"name.ngram" : {
"query" : "xyz"
}
}
}
}
'

Here's my mapping:

curl -XPUT 'http://127.0.0.1:9200/test/?pretty=1'-d '
{
"mappings" : {
"member" : {
"properties" : {
"name" : {
"type": "multi_field",
"fields" : {
"untouched": {
"type": "string",
"index": "not_analyzed"
},
"name": {
"type": "string",
"analyzer": "standard_name"
},
"ngram" : {
"search_analyzer": "standard_name",
"index_analyzer": "partial_name",
"type": "string"
}
}
}
}
}
},
"settings" : {
"analysis" : {
"filter" : {
"name_ngrams" : {
"side" : "front",
"max_gram" : 10,
"min_gram" : 1,
"type" : "edgeNGram"
}
},
"analyzer" : {
"standard_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding"
],
"type" : "custom",
"tokenizer" : "standard"
},
"partial_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding",
"name_ngrams"
],
"type" : "custom",
"tokenizer" : "standard"
}
}
}
}
}
'

Can anyone give me some help to identify what might be wrong?

kimchy · March 6, 2012, 7:28pm

Another option is to use dynamic templates: Elasticsearch Platform — Find real-time answers at scale | Elastic, and set it on a mapping called default (which will apply to all types in the index).

On Tuesday, March 6, 2012 at 2:28 AM, Matt Weber wrote:

I think you would use the default mapping:

Elasticsearch Platform — Find real-time answers at scale | Elastic

--
Matt Weber
Sent with Sparrow (http://www.sparrowmailapp.com/?sig)

On Monday, March 5, 2012 at 3:35 PM, quain wrote:

Thanks a lot for pointing this out. This was the problem.

I was wondering, is it possible to apply this mapping to all types
within an index? For example, if I wanted to set the mapping for the
"name" field for all types of the index "test", can I do that?

On Mar 5, 12:33 pm, Garrick Evans <buk...@gmail.com (http://gmail.com)> wrote:

You are posting to a "test" type but you created the mapping for "member".
Try:

curl - POST 'http://localhost:9200/test/member?pretty=true'-d '{ "name" :
"The Office" }'
curl - POST 'http://localhost:9200/test/member?pretty=true'-d '{ "name" :
"The Office (UK)" }'

You should then be able to query like:

curl -XGEThttp://localhost:9200/test/_search?pretty=1-d
'{"query":{"text":{"name.ngram":"th"}}}'
{
"took" : 1,
"timed_out" : false,
"_shards" : {
"total" : 5,
"successful" : 5,
"failed" : 0
},
"hits" : {
"total" : 2,
"max_score" : 0.25,
"hits" : [ {
"_index" : "test",
"_type" : "member",
"_id" : "MLleoK0pR8eBGhY9pkm0ig",
"_score" : 0.25, "_source" : { "name" : "The Office (UK)" }
}, {
"_index" : "test",
"_type" : "member",
"_id" : "nzY1KZ6mRuqrzxosJBi9IQ",
"_score" : 0.095891505, "_source" : { "name" : "The Office" }
} ]
}

On Monday, March 5, 2012 11:10:51 AM UTC-8, quain wrote:

Thanks, but I got the same result, still 0 hits. I didn't get a
syntax error the first time either, so not sure this is the problem.

I thought I pretty much followed the documentation on this, not sure
why it doesn't work.

On Mar 5, 10:35 am, Garrick Evans <buk...@gmail.com (http://gmail.com)> wrote:

What if you

"query":{"text":{"name.ngram":"xyz"}}}

?

On Sunday, March 4, 2012 11:07:04 PM UTC-8, quain wrote:

I'm having some trouble with multi_field, perhaps some of you guys
could shed some light on what I'm doing wrong. After I inserted some
documents, I get 0 hits for any searches of the field name.untouched
or name.ngram. I am successful with the main field just searching on
name. For example, the following returns nothing even though i know
the term is there exactly:

curl -XGET 'http://127.0.0.1:9200/test/_search?pretty=1'-d '
{
"query" : {
"text" : {
"name.ngram" : {
"query" : "xyz"
}
}
}
}
'

Here's my mapping:

curl -XPUT 'http://127.0.0.1:9200/test/?pretty=1'-d '
{
"mappings" : {
"member" : {
"properties" : {
"name" : {
"type": "multi_field",
"fields" : {
"untouched": {
"type": "string",
"index": "not_analyzed"
},
"name": {
"type": "string",
"analyzer": "standard_name"
},
"ngram" : {
"search_analyzer": "standard_name",
"index_analyzer": "partial_name",
"type": "string"
}
}
}
}
}
},
"settings" : {
"analysis" : {
"filter" : {
"name_ngrams" : {
"side" : "front",
"max_gram" : 10,
"min_gram" : 1,
"type" : "edgeNGram"
}
},
"analyzer" : {
"standard_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding"
],
"type" : "custom",
"tokenizer" : "standard"
},
"partial_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding",
"name_ngrams"
],
"type" : "custom",
"tokenizer" : "standard"
}
}
}
}
}
'

Can anyone give me some help to identify what might be wrong?
On Monday, March 5, 2012 11:10:51 AM UTC-8, quain wrote:

Thanks, but I got the same result, still 0 hits. I didn't get a
syntax error the first time either, so not sure this is the problem.

I thought I pretty much followed the documentation on this, not sure
why it doesn't work.

On Mar 5, 10:35 am, Garrick Evans <buk...@gmail.com (http://gmail.com)> wrote:

What if you

"query":{"text":{"name.ngram":"xyz"}}}

?

On Sunday, March 4, 2012 11:07:04 PM UTC-8, quain wrote:

I'm having some trouble with multi_field, perhaps some of you guys
could shed some light on what I'm doing wrong. After I inserted some
documents, I get 0 hits for any searches of the field name.untouched
or name.ngram. I am successful with the main field just searching on
name. For example, the following returns nothing even though i know
the term is there exactly:

curl -XGET 'http://127.0.0.1:9200/test/_search?pretty=1'-d '
{
"query" : {
"text" : {
"name.ngram" : {
"query" : "xyz"
}
}
}
}
'

Here's my mapping:

curl -XPUT 'http://127.0.0.1:9200/test/?pretty=1'-d '
{
"mappings" : {
"member" : {
"properties" : {
"name" : {
"type": "multi_field",
"fields" : {
"untouched": {
"type": "string",
"index": "not_analyzed"
},
"name": {
"type": "string",
"analyzer": "standard_name"
},
"ngram" : {
"search_analyzer": "standard_name",
"index_analyzer": "partial_name",
"type": "string"
}
}
}
}
}
},
"settings" : {
"analysis" : {
"filter" : {
"name_ngrams" : {
"side" : "front",
"max_gram" : 10,
"min_gram" : 1,
"type" : "edgeNGram"
}
},
"analyzer" : {
"standard_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding"
],
"type" : "custom",
"tokenizer" : "standard"
},
"partial_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding",
"name_ngrams"
],
"type" : "custom",
"tokenizer" : "standard"
}
}
}
}
}
'

Can anyone give me some help to identify what might be wrong?

quain · April 12, 2012, 1:22am

Bring back this old thread, but I have a followup question. Does edge
ngram filtered fields support prefix or phrase-prefix queries? My goal is
to prefer results which have the same word ordering as the query, ie if I
search "Jack John" prefer "Jack Johnson" over "John Jackson". Can this be
done via a query type/parameter, or custom scoring?

On Sunday, March 4, 2012 11:07:04 PM UTC-8, quain wrote:

I'm having some trouble with multi_field, perhaps some of you guys
could shed some light on what I'm doing wrong. After I inserted some
documents, I get 0 hits for any searches of the field name.untouched
or name.ngram. I am successful with the main field just searching on
name. For example, the following returns nothing even though i know
the term is there exactly:

curl -XGET 'http://127.0.0.1:9200/test/_search?pretty=1' -d '
{
"query" : {
"text" : {
"name.ngram" : {
"query" : "xyz"
}
}
}
}
'

Here's my mapping:

curl -XPUT 'http://127.0.0.1:9200/test/?pretty=1' -d '
{
"mappings" : {
"member" : {
"properties" : {
"name" : {
"type": "multi_field",
"fields" : {
"untouched": {
"type": "string",
"index": "not_analyzed"
},
"name": {
"type": "string",
"analyzer": "standard_name"
},
"ngram" : {
"search_analyzer": "standard_name",
"index_analyzer": "partial_name",
"type": "string"
}
}
}
}
}
},
"settings" : {
"analysis" : {
"filter" : {
"name_ngrams" : {
"side" : "front",
"max_gram" : 10,
"min_gram" : 1,
"type" : "edgeNGram"
}
},
"analyzer" : {
"standard_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding"
],
"type" : "custom",
"tokenizer" : "standard"
},
"partial_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding",
"name_ngrams"
],
"type" : "custom",
"tokenizer" : "standard"
}
}
}
}
}
'

Can anyone give me some help to identify what might be wrong?

kimchy · April 13, 2012, 12:14pm

You can execute a phrase query and boost it.

On Thu, Apr 12, 2012 at 4:22 AM, quain quaintenance@gmail.com wrote:

Bring back this old thread, but I have a followup question. Does edge
ngram filtered fields support prefix or phrase-prefix queries? My goal is
to prefer results which have the same word ordering as the query, ie if I
search "Jack John" prefer "Jack Johnson" over "John Jackson". Can this be
done via a query type/parameter, or custom scoring?

On Sunday, March 4, 2012 11:07:04 PM UTC-8, quain wrote:

I'm having some trouble with multi_field, perhaps some of you guys
could shed some light on what I'm doing wrong. After I inserted some
documents, I get 0 hits for any searches of the field name.untouched
or name.ngram. I am successful with the main field just searching on
name. For example, the following returns nothing even though i know
the term is there exactly:

curl -XGET 'http://127.0.0.1:9200/test/_**search?pretty=1 http://127.0.0.1:9200/test/_search?pretty=1'
-d '
{
"query" : {
"text" : {
"name.ngram" : {
"query" : "xyz"
}
}
}
}
'

Here's my mapping:

curl -XPUT 'http://127.0.0.1:9200/test/?**pretty=1 http://127.0.0.1:9200/test/?pretty=1'
-d '
{
"mappings" : {
"member" : {
"properties" : {
"name" : {
"type": "multi_field",
"fields" : {
"untouched": {
"type": "string",
"index": "not_analyzed"
},
"name": {
"type": "string",
"analyzer": "standard_name"
},
"ngram" : {
"search_analyzer": "standard_name",
"index_analyzer": "partial_name",
"type": "string"
}
}
}
}
}
},
"settings" : {
"analysis" : {
"filter" : {
"name_ngrams" : {
"side" : "front",
"max_gram" : 10,
"min_gram" : 1,
"type" : "edgeNGram"
}
},
"analyzer" : {
"standard_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding"
],
"type" : "custom",
"tokenizer" : "standard"
},
"partial_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding",
"name_ngrams"
],
"type" : "custom",
"tokenizer" : "standard"
}
}
}
}
}
'

Can anyone give me some help to identify what might be wrong?

Topic		Replies	Views
Search on fields with Multi field mapping and Ngram Analyzer Elasticsearch	1	716	July 6, 2017
Ngram not working for multivalued field Elasticsearch	6	1047	July 6, 2017
Ngram not workign for multivalued field Elasticsearch	1	323	July 6, 2017
Ngram and edgeNgram combined for _all field; or different token filters per field for _all Elasticsearch	1	582	July 6, 2017
Can't query an edge_ngram field in _all Elasticsearch	2	794	July 5, 2017

Question about multi_field and edge ngram

Related topics