Question about multi_field and edge ngram

quain · March 5, 2012, 7:07am

I'm having some trouble with multi_field, perhaps some of you guys
could shed some light on what I'm doing wrong. After I inserted some
documents, I get 0 hits for any searches of the field name.untouched
or name.ngram. I am successful with the main field just searching on
name. For example, the following returns nothing even though i know
the term is there exactly:

curl -XGET 'http://127.0.0.1:9200/test/_search?pretty=1' -d '
{
"query" : {
"text" : {
"name.ngram" : {
"query" : "xyz"
}
}
}
}
'

Here's my mapping:

curl -XPUT 'http://127.0.0.1:9200/test/?pretty=1' -d '
{
"mappings" : {
"member" : {
"properties" : {
"name" : {
"type": "multi_field",
"fields" : {
"untouched": {
"type": "string",
"index": "not_analyzed"
},
"name": {
"type": "string",
"analyzer": "standard_name"
},
"ngram" : {
"search_analyzer": "standard_name",
"index_analyzer": "partial_name",
"type": "string"
}
}
}
}
}
},
"settings" : {
"analysis" : {
"filter" : {
"name_ngrams" : {
"side" : "front",
"max_gram" : 10,
"min_gram" : 1,
"type" : "edgeNGram"
}
},
"analyzer" : {
"standard_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding"
],
"type" : "custom",
"tokenizer" : "standard"
},
"partial_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding",
"name_ngrams"
],
"type" : "custom",
"tokenizer" : "standard"
}
}
}
}
}
'

Can anyone give me some help to identify what might be wrong?

kimchy · March 5, 2012, 3:19pm

Can you gist a sample with setting up the index, the mappings, indexing sample doc(s) and then showing the search request that do not work for you? It would help a lot. (see Elasticsearch Platform — Find real-time answers at scale | Elastic).

On Monday, March 5, 2012 at 9:07 AM, quain wrote:

I'm having some trouble with multi_field, perhaps some of you guys
could shed some light on what I'm doing wrong. After I inserted some
documents, I get 0 hits for any searches of the field name.untouched
or name.ngram. I am successful with the main field just searching on
name. For example, the following returns nothing even though i know
the term is there exactly:

curl -XGET 'http://127.0.0.1:9200/test/_search?pretty=1' -d '
{
"query" : {
"text" : {
"name.ngram" : {
"query" : "xyz"
}
}
}
}
'

Here's my mapping:

curl -XPUT 'http://127.0.0.1:9200/test/?pretty=1' -d '
{
"mappings" : {
"member" : {
"properties" : {
"name" : {
"type": "multi_field",
"fields" : {
"untouched": {
"type": "string",
"index": "not_analyzed"
},
"name": {
"type": "string",
"analyzer": "standard_name"
},
"ngram" : {
"search_analyzer": "standard_name",
"index_analyzer": "partial_name",
"type": "string"
}
}
}
}
}
},
"settings" : {
"analysis" : {
"filter" : {
"name_ngrams" : {
"side" : "front",
"max_gram" : 10,
"min_gram" : 1,
"type" : "edgeNGram"
}
},
"analyzer" : {
"standard_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding"
],
"type" : "custom",
"tokenizer" : "standard"
},
"partial_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding",
"name_ngrams"
],
"type" : "custom",
"tokenizer" : "standard"
}
}
}
}
}
'

Can anyone give me some help to identify what might be wrong?

quain · March 5, 2012, 4:31pm

gist.github.com

https://gist.github.com/jwyuan/1979125

gistfile1.json

curl -XPUT 'http://127.0.0.1:9200/test/?pretty=1'  -d '
{
   "mappings" : {
      "member" : {
         "properties" : {
            "name" : {
               "type": "multi_field",
               "fields" : {
                  "untouched": {
                     "type": "string",

This file has been truncated. show original

Here is the gist. Thanks very much for any help that can be
provided. I'm mostly interested in if I'm setting up the mapping
incorrectly, or using the multi_field or ngram types incorrectly.

On Mar 5, 7:19 am, Shay Banon kim...@gmail.com wrote:

Can you gist a sample with setting up the index, the mappings, indexing sample doc(s) and then showing the search request that do not work for you? It would help a lot. (seehttp://www.elasticsearch.org/help).

On Monday, March 5, 2012 at 9:07 AM, quain wrote:

I'm having some trouble with multi_field, perhaps some of you guys
could shed some light on what I'm doing wrong. After I inserted some
documents, I get 0 hits for any searches of the field name.untouched
or name.ngram. I am successful with the main field just searching on
name. For example, the following returns nothing even though i know
the term is there exactly:

curl -XGET 'http://127.0.0.1:9200/test/_search?pretty=1'-d '
{
"query" : {
"text" : {
"name.ngram" : {
"query" : "xyz"
}
}
}
}
'

Here's my mapping:

curl -XPUT 'http://127.0.0.1:9200/test/?pretty=1'-d '
{
"mappings" : {
"member" : {
"properties" : {
"name" : {
"type": "multi_field",
"fields" : {
"untouched": {
"type": "string",
"index": "not_analyzed"
},
"name": {
"type": "string",
"analyzer": "standard_name"
},
"ngram" : {
"search_analyzer": "standard_name",
"index_analyzer": "partial_name",
"type": "string"
}
}
}
}
}
},
"settings" : {
"analysis" : {
"filter" : {
"name_ngrams" : {
"side" : "front",
"max_gram" : 10,
"min_gram" : 1,
"type" : "edgeNGram"
}
},
"analyzer" : {
"standard_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding"
],
"type" : "custom",
"tokenizer" : "standard"
},
"partial_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding",
"name_ngrams"
],
"type" : "custom",
"tokenizer" : "standard"
}
}
}
}
}
'

Can anyone give me some help to identify what might be wrong?

Garrick_Evans · March 5, 2012, 6:35pm

What if you

"query":{"text":{"name.ngram":"xyz"}}}

?

On Sunday, March 4, 2012 11:07:04 PM UTC-8, quain wrote:

I'm having some trouble with multi_field, perhaps some of you guys
could shed some light on what I'm doing wrong. After I inserted some
documents, I get 0 hits for any searches of the field name.untouched
or name.ngram. I am successful with the main field just searching on
name. For example, the following returns nothing even though i know
the term is there exactly:

curl -XGET 'http://127.0.0.1:9200/test/_search?pretty=1' -d '
{
"query" : {
"text" : {
"name.ngram" : {
"query" : "xyz"
}
}
}
}
'

Here's my mapping:

curl -XPUT 'http://127.0.0.1:9200/test/?pretty=1' -d '
{
"mappings" : {
"member" : {
"properties" : {
"name" : {
"type": "multi_field",
"fields" : {
"untouched": {
"type": "string",
"index": "not_analyzed"
},
"name": {
"type": "string",
"analyzer": "standard_name"
},
"ngram" : {
"search_analyzer": "standard_name",
"index_analyzer": "partial_name",
"type": "string"
}
}
}
}
}
},
"settings" : {
"analysis" : {
"filter" : {
"name_ngrams" : {
"side" : "front",
"max_gram" : 10,
"min_gram" : 1,
"type" : "edgeNGram"
}
},
"analyzer" : {
"standard_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding"
],
"type" : "custom",
"tokenizer" : "standard"
},
"partial_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding",
"name_ngrams"
],
"type" : "custom",
"tokenizer" : "standard"
}
}
}
}
}
'

Can anyone give me some help to identify what might be wrong?

quain · March 5, 2012, 7:10pm

Thanks, but I got the same result, still 0 hits. I didn't get a
syntax error the first time either, so not sure this is the problem.

I thought I pretty much followed the documentation on this, not sure
why it doesn't work.

On Mar 5, 10:35 am, Garrick Evans buk...@gmail.com wrote:

What if you

"query":{"text":{"name.ngram":"xyz"}}}

?

On Sunday, March 4, 2012 11:07:04 PM UTC-8, quain wrote:

I'm having some trouble with multi_field, perhaps some of you guys
could shed some light on what I'm doing wrong. After I inserted some
documents, I get 0 hits for any searches of the field name.untouched
or name.ngram. I am successful with the main field just searching on
name. For example, the following returns nothing even though i know
the term is there exactly:

curl -XGET 'http://127.0.0.1:9200/test/_search?pretty=1' -d '
{
"query" : {
"text" : {
"name.ngram" : {
"query" : "xyz"
}
}
}
}
'

Here's my mapping:

curl -XPUT 'http://127.0.0.1:9200/test/?pretty=1' -d '
{
"mappings" : {
"member" : {
"properties" : {
"name" : {
"type": "multi_field",
"fields" : {
"untouched": {
"type": "string",
"index": "not_analyzed"
},
"name": {
"type": "string",
"analyzer": "standard_name"
},
"ngram" : {
"search_analyzer": "standard_name",
"index_analyzer": "partial_name",
"type": "string"
}
}
}
}
}
},
"settings" : {
"analysis" : {
"filter" : {
"name_ngrams" : {
"side" : "front",
"max_gram" : 10,
"min_gram" : 1,
"type" : "edgeNGram"
}
},
"analyzer" : {
"standard_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding"
],
"type" : "custom",
"tokenizer" : "standard"
},
"partial_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding",
"name_ngrams"
],
"type" : "custom",
"tokenizer" : "standard"
}
}
}
}
}
'

Can anyone give me some help to identify what might be wrong?

Garrick_Evans · March 5, 2012, 8:33pm

You are posting to a "test" type but you created the mapping for "member".
Try:

curl - POST 'http://localhost:9200/test/member?pretty=true' -d '{ "name" :
"The Office" }'
curl - POST 'http://localhost:9200/test/member?pretty=true' -d '{ "name" :
"The Office (UK)" }'

You should then be able to query like:

curl -XGET http://localhost:9200/test/_search?pretty=1 -d
'{"query":{"text":{"name.ngram":"th"}}}'
{
"took" : 1,
"timed_out" : false,
"_shards" : {
"total" : 5,
"successful" : 5,
"failed" : 0
},
"hits" : {
"total" : 2,
"max_score" : 0.25,
"hits" : [ {
"_index" : "test",
"_type" : "member",
"_id" : "MLleoK0pR8eBGhY9pkm0ig",
"_score" : 0.25, "_source" : { "name" : "The Office (UK)" }
}, {
"_index" : "test",
"_type" : "member",
"_id" : "nzY1KZ6mRuqrzxosJBi9IQ",
"_score" : 0.095891505, "_source" : { "name" : "The Office" }
} ]
}

On Monday, March 5, 2012 11:10:51 AM UTC-8, quain wrote:

Thanks, but I got the same result, still 0 hits. I didn't get a
syntax error the first time either, so not sure this is the problem.

I thought I pretty much followed the documentation on this, not sure
why it doesn't work.

On Mar 5, 10:35 am, Garrick Evans buk...@gmail.com wrote:

What if you

"query":{"text":{"name.ngram":"xyz"}}}

?

On Sunday, March 4, 2012 11:07:04 PM UTC-8, quain wrote:

I'm having some trouble with multi_field, perhaps some of you guys
could shed some light on what I'm doing wrong. After I inserted some
documents, I get 0 hits for any searches of the field name.untouched
or name.ngram. I am successful with the main field just searching on
name. For example, the following returns nothing even though i know
the term is there exactly:

curl -XGET 'http://127.0.0.1:9200/test/_search?pretty=1' -d '
{
"query" : {
"text" : {
"name.ngram" : {
"query" : "xyz"
}
}
}
}
'

Here's my mapping:

curl -XPUT 'http://127.0.0.1:9200/test/?pretty=1' -d '
{
"mappings" : {
"member" : {
"properties" : {
"name" : {
"type": "multi_field",
"fields" : {
"untouched": {
"type": "string",
"index": "not_analyzed"
},
"name": {
"type": "string",
"analyzer": "standard_name"
},
"ngram" : {
"search_analyzer": "standard_name",
"index_analyzer": "partial_name",
"type": "string"
}
}
}
}
}
},
"settings" : {
"analysis" : {
"filter" : {
"name_ngrams" : {
"side" : "front",
"max_gram" : 10,
"min_gram" : 1,
"type" : "edgeNGram"
}
},
"analyzer" : {
"standard_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding"
],
"type" : "custom",
"tokenizer" : "standard"
},
"partial_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding",
"name_ngrams"
],
"type" : "custom",
"tokenizer" : "standard"
}
}
}
}
}
'

Can anyone give me some help to identify what might be wrong?

On Monday, March 5, 2012 11:10:51 AM UTC-8, quain wrote:

Thanks, but I got the same result, still 0 hits. I didn't get a
syntax error the first time either, so not sure this is the problem.

I thought I pretty much followed the documentation on this, not sure
why it doesn't work.

On Mar 5, 10:35 am, Garrick Evans buk...@gmail.com wrote:

What if you

"query":{"text":{"name.ngram":"xyz"}}}

?

On Sunday, March 4, 2012 11:07:04 PM UTC-8, quain wrote:

I'm having some trouble with multi_field, perhaps some of you guys
could shed some light on what I'm doing wrong. After I inserted some
documents, I get 0 hits for any searches of the field name.untouched
or name.ngram. I am successful with the main field just searching on
name. For example, the following returns nothing even though i know
the term is there exactly:

curl -XGET 'http://127.0.0.1:9200/test/_search?pretty=1' -d '
{
"query" : {
"text" : {
"name.ngram" : {
"query" : "xyz"
}
}
}
}
'

Here's my mapping:

curl -XPUT 'http://127.0.0.1:9200/test/?pretty=1' -d '
{
"mappings" : {
"member" : {
"properties" : {
"name" : {
"type": "multi_field",
"fields" : {
"untouched": {
"type": "string",
"index": "not_analyzed"
},
"name": {
"type": "string",
"analyzer": "standard_name"
},
"ngram" : {
"search_analyzer": "standard_name",
"index_analyzer": "partial_name",
"type": "string"
}
}
}
}
}
},
"settings" : {
"analysis" : {
"filter" : {
"name_ngrams" : {
"side" : "front",
"max_gram" : 10,
"min_gram" : 1,
"type" : "edgeNGram"
}
},
"analyzer" : {
"standard_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding"
],
"type" : "custom",
"tokenizer" : "standard"
},
"partial_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding",
"name_ngrams"
],
"type" : "custom",
"tokenizer" : "standard"
}
}
}
}
}
'

Can anyone give me some help to identify what might be wrong?

quain · March 5, 2012, 11:35pm

Thanks a lot for pointing this out. This was the problem.

I was wondering, is it possible to apply this mapping to all types
within an index? For example, if I wanted to set the mapping for the
"name" field for all types of the index "test", can I do that?

On Mar 5, 12:33 pm, Garrick Evans buk...@gmail.com wrote:

You are posting to a "test" type but you created the mapping for "member".
Try:

curl - POST 'http://localhost:9200/test/member?pretty=true'-d '{ "name" :
"The Office" }'
curl - POST 'http://localhost:9200/test/member?pretty=true'-d '{ "name" :
"The Office (UK)" }'

You should then be able to query like:

curl -XGEThttp://localhost:9200/test/_search?pretty=1-d
'{"query":{"text":{"name.ngram":"th"}}}'
{
"took" : 1,
"timed_out" : false,
"_shards" : {
"total" : 5,
"successful" : 5,
"failed" : 0
},
"hits" : {
"total" : 2,
"max_score" : 0.25,
"hits" : [ {
"_index" : "test",
"_type" : "member",
"_id" : "MLleoK0pR8eBGhY9pkm0ig",
"_score" : 0.25, "_source" : { "name" : "The Office (UK)" }
}, {
"_index" : "test",
"_type" : "member",
"_id" : "nzY1KZ6mRuqrzxosJBi9IQ",
"_score" : 0.095891505, "_source" : { "name" : "The Office" }
} ]
}
On Monday, March 5, 2012 11:10:51 AM UTC-8, quain wrote:

Thanks, but I got the same result, still 0 hits. I didn't get a
syntax error the first time either, so not sure this is the problem.

I thought I pretty much followed the documentation on this, not sure
why it doesn't work.

On Mar 5, 10:35 am, Garrick Evans buk...@gmail.com wrote:

What if you

"query":{"text":{"name.ngram":"xyz"}}}

?

On Sunday, March 4, 2012 11:07:04 PM UTC-8, quain wrote:

I'm having some trouble with multi_field, perhaps some of you guys
could shed some light on what I'm doing wrong. After I inserted some
documents, I get 0 hits for any searches of the field name.untouched
or name.ngram. I am successful with the main field just searching on
name. For example, the following returns nothing even though i know
the term is there exactly:

curl -XGET 'http://127.0.0.1:9200/test/_search?pretty=1'-d '
{
"query" : {
"text" : {
"name.ngram" : {
"query" : "xyz"
}
}
}
}
'

Here's my mapping:

curl -XPUT 'http://127.0.0.1:9200/test/?pretty=1'-d '
{
"mappings" : {
"member" : {
"properties" : {
"name" : {
"type": "multi_field",
"fields" : {
"untouched": {
"type": "string",
"index": "not_analyzed"
},
"name": {
"type": "string",
"analyzer": "standard_name"
},
"ngram" : {
"search_analyzer": "standard_name",
"index_analyzer": "partial_name",
"type": "string"
}
}
}
}
}
},
"settings" : {
"analysis" : {
"filter" : {
"name_ngrams" : {
"side" : "front",
"max_gram" : 10,
"min_gram" : 1,
"type" : "edgeNGram"
}
},
"analyzer" : {
"standard_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding"
],
"type" : "custom",
"tokenizer" : "standard"
},
"partial_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding",
"name_ngrams"
],
"type" : "custom",
"tokenizer" : "standard"
}
}
}
}
}
'

Can anyone give me some help to identify what might be wrong?
On Monday, March 5, 2012 11:10:51 AM UTC-8, quain wrote:

Thanks, but I got the same result, still 0 hits. I didn't get a
syntax error the first time either, so not sure this is the problem.

I thought I pretty much followed the documentation on this, not sure
why it doesn't work.

On Mar 5, 10:35 am, Garrick Evans buk...@gmail.com wrote:

What if you

"query":{"text":{"name.ngram":"xyz"}}}

?

On Sunday, March 4, 2012 11:07:04 PM UTC-8, quain wrote:

I'm having some trouble with multi_field, perhaps some of you guys
could shed some light on what I'm doing wrong. After I inserted some
documents, I get 0 hits for any searches of the field name.untouched
or name.ngram. I am successful with the main field just searching on
name. For example, the following returns nothing even though i know
the term is there exactly:

curl -XGET 'http://127.0.0.1:9200/test/_search?pretty=1'-d '
{
"query" : {
"text" : {
"name.ngram" : {
"query" : "xyz"
}
}
}
}
'

Here's my mapping:

curl -XPUT 'http://127.0.0.1:9200/test/?pretty=1'-d '
{
"mappings" : {
"member" : {
"properties" : {
"name" : {
"type": "multi_field",
"fields" : {
"untouched": {
"type": "string",
"index": "not_analyzed"
},
"name": {
"type": "string",
"analyzer": "standard_name"
},
"ngram" : {
"search_analyzer": "standard_name",
"index_analyzer": "partial_name",
"type": "string"
}
}
}
}
}
},
"settings" : {
"analysis" : {
"filter" : {
"name_ngrams" : {
"side" : "front",
"max_gram" : 10,
"min_gram" : 1,
"type" : "edgeNGram"
}
},
"analyzer" : {
"standard_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding"
],
"type" : "custom",
"tokenizer" : "standard"
},
"partial_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding",
"name_ngrams"
],
"type" : "custom",
"tokenizer" : "standard"
}
}
}
}
}
'

Can anyone give me some help to identify what might be wrong?

mattweber · March 6, 2012, 12:28am

I think you would use the default mapping:

--
Matt Weber
Sent with Sparrow (http://www.sparrowmailapp.com/?sig)

On Monday, March 5, 2012 at 3:35 PM, quain wrote:

Thanks a lot for pointing this out. This was the problem.

I was wondering, is it possible to apply this mapping to all types
within an index? For example, if I wanted to set the mapping for the
"name" field for all types of the index "test", can I do that?

On Mar 5, 12:33 pm, Garrick Evans <buk...@gmail.com (http://gmail.com)> wrote:

You are posting to a "test" type but you created the mapping for "member".
Try:

curl - POST 'http://localhost:9200/test/member?pretty=true'-d '{ "name" :
"The Office" }'
curl - POST 'http://localhost:9200/test/member?pretty=true'-d '{ "name" :
"The Office (UK)" }'

You should then be able to query like:

curl -XGEThttp://localhost:9200/test/_search?pretty=1-d
'{"query":{"text":{"name.ngram":"th"}}}'
{
"took" : 1,
"timed_out" : false,
"_shards" : {
"total" : 5,
"successful" : 5,
"failed" : 0
},
"hits" : {
"total" : 2,
"max_score" : 0.25,
"hits" : [ {
"_index" : "test",
"_type" : "member",
"_id" : "MLleoK0pR8eBGhY9pkm0ig",
"_score" : 0.25, "_source" : { "name" : "The Office (UK)" }
}, {
"_index" : "test",
"_type" : "member",
"_id" : "nzY1KZ6mRuqrzxosJBi9IQ",
"_score" : 0.095891505, "_source" : { "name" : "The Office" }
} ]
}

On Monday, March 5, 2012 11:10:51 AM UTC-8, quain wrote:

Thanks, but I got the same result, still 0 hits. I didn't get a
syntax error the first time either, so not sure this is the problem.

I thought I pretty much followed the documentation on this, not sure
why it doesn't work.

On Mar 5, 10:35 am, Garrick Evans <buk...@gmail.com (http://gmail.com)> wrote:

What if you

"query":{"text":{"name.ngram":"xyz"}}}

?

On Sunday, March 4, 2012 11:07:04 PM UTC-8, quain wrote:

I'm having some trouble with multi_field, perhaps some of you guys
could shed some light on what I'm doing wrong. After I inserted some
documents, I get 0 hits for any searches of the field name.untouched
or name.ngram. I am successful with the main field just searching on
name. For example, the following returns nothing even though i know
the term is there exactly:

curl -XGET 'http://127.0.0.1:9200/test/_search?pretty=1'-d '
{
"query" : {
"text" : {
"name.ngram" : {
"query" : "xyz"
}
}
}
}
'

Here's my mapping:

curl -XPUT 'http://127.0.0.1:9200/test/?pretty=1'-d '
{
"mappings" : {
"member" : {
"properties" : {
"name" : {
"type": "multi_field",
"fields" : {
"untouched": {
"type": "string",
"index": "not_analyzed"
},
"name": {
"type": "string",
"analyzer": "standard_name"
},
"ngram" : {
"search_analyzer": "standard_name",
"index_analyzer": "partial_name",
"type": "string"
}
}
}
}
}
},
"settings" : {
"analysis" : {
"filter" : {
"name_ngrams" : {
"side" : "front",
"max_gram" : 10,
"min_gram" : 1,
"type" : "edgeNGram"
}
},
"analyzer" : {
"standard_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding"
],
"type" : "custom",
"tokenizer" : "standard"
},
"partial_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding",
"name_ngrams"
],
"type" : "custom",
"tokenizer" : "standard"
}
}
}
}
}
'

Can anyone give me some help to identify what might be wrong?
On Monday, March 5, 2012 11:10:51 AM UTC-8, quain wrote:

Thanks, but I got the same result, still 0 hits. I didn't get a
syntax error the first time either, so not sure this is the problem.

I thought I pretty much followed the documentation on this, not sure
why it doesn't work.

On Mar 5, 10:35 am, Garrick Evans <buk...@gmail.com (http://gmail.com)> wrote:

What if you

"query":{"text":{"name.ngram":"xyz"}}}

?

On Sunday, March 4, 2012 11:07:04 PM UTC-8, quain wrote:

I'm having some trouble with multi_field, perhaps some of you guys
could shed some light on what I'm doing wrong. After I inserted some
documents, I get 0 hits for any searches of the field name.untouched
or name.ngram. I am successful with the main field just searching on
name. For example, the following returns nothing even though i know
the term is there exactly:

curl -XGET 'http://127.0.0.1:9200/test/_search?pretty=1'-d '
{
"query" : {
"text" : {
"name.ngram" : {
"query" : "xyz"
}
}
}
}
'

Here's my mapping:

curl -XPUT 'http://127.0.0.1:9200/test/?pretty=1'-d '
{
"mappings" : {
"member" : {
"properties" : {
"name" : {
"type": "multi_field",
"fields" : {
"untouched": {
"type": "string",
"index": "not_analyzed"
},
"name": {
"type": "string",
"analyzer": "standard_name"
},
"ngram" : {
"search_analyzer": "standard_name",
"index_analyzer": "partial_name",
"type": "string"
}
}
}
}
}
},
"settings" : {
"analysis" : {
"filter" : {
"name_ngrams" : {
"side" : "front",
"max_gram" : 10,
"min_gram" : 1,
"type" : "edgeNGram"
}
},
"analyzer" : {
"standard_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding"
],
"type" : "custom",
"tokenizer" : "standard"
},
"partial_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding",
"name_ngrams"
],
"type" : "custom",
"tokenizer" : "standard"
}
}
}
}
}
'

Can anyone give me some help to identify what might be wrong?

kimchy · March 6, 2012, 7:28pm

Another option is to use dynamic templates: Elasticsearch Platform — Find real-time answers at scale | Elastic, and set it on a mapping called default (which will apply to all types in the index).

On Tuesday, March 6, 2012 at 2:28 AM, Matt Weber wrote:

I think you would use the default mapping:

Elasticsearch Platform — Find real-time answers at scale | Elastic

--
Matt Weber
Sent with Sparrow (http://www.sparrowmailapp.com/?sig)

On Monday, March 5, 2012 at 3:35 PM, quain wrote:

Thanks a lot for pointing this out. This was the problem.

I was wondering, is it possible to apply this mapping to all types
within an index? For example, if I wanted to set the mapping for the
"name" field for all types of the index "test", can I do that?

On Mar 5, 12:33 pm, Garrick Evans <buk...@gmail.com (http://gmail.com)> wrote:

You are posting to a "test" type but you created the mapping for "member".
Try:

curl - POST 'http://localhost:9200/test/member?pretty=true'-d '{ "name" :
"The Office" }'
curl - POST 'http://localhost:9200/test/member?pretty=true'-d '{ "name" :
"The Office (UK)" }'

You should then be able to query like:

curl -XGEThttp://localhost:9200/test/_search?pretty=1-d
'{"query":{"text":{"name.ngram":"th"}}}'
{
"took" : 1,
"timed_out" : false,
"_shards" : {
"total" : 5,
"successful" : 5,
"failed" : 0
},
"hits" : {
"total" : 2,
"max_score" : 0.25,
"hits" : [ {
"_index" : "test",
"_type" : "member",
"_id" : "MLleoK0pR8eBGhY9pkm0ig",
"_score" : 0.25, "_source" : { "name" : "The Office (UK)" }
}, {
"_index" : "test",
"_type" : "member",
"_id" : "nzY1KZ6mRuqrzxosJBi9IQ",
"_score" : 0.095891505, "_source" : { "name" : "The Office" }
} ]
}

On Monday, March 5, 2012 11:10:51 AM UTC-8, quain wrote:

Thanks, but I got the same result, still 0 hits. I didn't get a
syntax error the first time either, so not sure this is the problem.

I thought I pretty much followed the documentation on this, not sure
why it doesn't work.

On Mar 5, 10:35 am, Garrick Evans <buk...@gmail.com (http://gmail.com)> wrote:

What if you

"query":{"text":{"name.ngram":"xyz"}}}

?

On Sunday, March 4, 2012 11:07:04 PM UTC-8, quain wrote:

I'm having some trouble with multi_field, perhaps some of you guys
could shed some light on what I'm doing wrong. After I inserted some
documents, I get 0 hits for any searches of the field name.untouched
or name.ngram. I am successful with the main field just searching on
name. For example, the following returns nothing even though i know
the term is there exactly:

curl -XGET 'http://127.0.0.1:9200/test/_search?pretty=1'-d '
{
"query" : {
"text" : {
"name.ngram" : {
"query" : "xyz"
}
}
}
}
'

Here's my mapping:

curl -XPUT 'http://127.0.0.1:9200/test/?pretty=1'-d '
{
"mappings" : {
"member" : {
"properties" : {
"name" : {
"type": "multi_field",
"fields" : {
"untouched": {
"type": "string",
"index": "not_analyzed"
},
"name": {
"type": "string",
"analyzer": "standard_name"
},
"ngram" : {
"search_analyzer": "standard_name",
"index_analyzer": "partial_name",
"type": "string"
}
}
}
}
}
},
"settings" : {
"analysis" : {
"filter" : {
"name_ngrams" : {
"side" : "front",
"max_gram" : 10,
"min_gram" : 1,
"type" : "edgeNGram"
}
},
"analyzer" : {
"standard_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding"
],
"type" : "custom",
"tokenizer" : "standard"
},
"partial_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding",
"name_ngrams"
],
"type" : "custom",
"tokenizer" : "standard"
}
}
}
}
}
'

Can anyone give me some help to identify what might be wrong?
On Monday, March 5, 2012 11:10:51 AM UTC-8, quain wrote:

Thanks, but I got the same result, still 0 hits. I didn't get a
syntax error the first time either, so not sure this is the problem.

I thought I pretty much followed the documentation on this, not sure
why it doesn't work.

On Mar 5, 10:35 am, Garrick Evans <buk...@gmail.com (http://gmail.com)> wrote:

What if you

"query":{"text":{"name.ngram":"xyz"}}}

?

On Sunday, March 4, 2012 11:07:04 PM UTC-8, quain wrote:

I'm having some trouble with multi_field, perhaps some of you guys
could shed some light on what I'm doing wrong. After I inserted some
documents, I get 0 hits for any searches of the field name.untouched
or name.ngram. I am successful with the main field just searching on
name. For example, the following returns nothing even though i know
the term is there exactly:

curl -XGET 'http://127.0.0.1:9200/test/_search?pretty=1'-d '
{
"query" : {
"text" : {
"name.ngram" : {
"query" : "xyz"
}
}
}
}
'

Here's my mapping:

curl -XPUT 'http://127.0.0.1:9200/test/?pretty=1'-d '
{
"mappings" : {
"member" : {
"properties" : {
"name" : {
"type": "multi_field",
"fields" : {
"untouched": {
"type": "string",
"index": "not_analyzed"
},
"name": {
"type": "string",
"analyzer": "standard_name"
},
"ngram" : {
"search_analyzer": "standard_name",
"index_analyzer": "partial_name",
"type": "string"
}
}
}
}
}
},
"settings" : {
"analysis" : {
"filter" : {
"name_ngrams" : {
"side" : "front",
"max_gram" : 10,
"min_gram" : 1,
"type" : "edgeNGram"
}
},
"analyzer" : {
"standard_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding"
],
"type" : "custom",
"tokenizer" : "standard"
},
"partial_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding",
"name_ngrams"
],
"type" : "custom",
"tokenizer" : "standard"
}
}
}
}
}
'

Can anyone give me some help to identify what might be wrong?

quain · April 12, 2012, 1:22am

Bring back this old thread, but I have a followup question. Does edge
ngram filtered fields support prefix or phrase-prefix queries? My goal is
to prefer results which have the same word ordering as the query, ie if I
search "Jack John" prefer "Jack Johnson" over "John Jackson". Can this be
done via a query type/parameter, or custom scoring?

On Sunday, March 4, 2012 11:07:04 PM UTC-8, quain wrote:

I'm having some trouble with multi_field, perhaps some of you guys
could shed some light on what I'm doing wrong. After I inserted some
documents, I get 0 hits for any searches of the field name.untouched
or name.ngram. I am successful with the main field just searching on
name. For example, the following returns nothing even though i know
the term is there exactly:

curl -XGET 'http://127.0.0.1:9200/test/_search?pretty=1' -d '
{
"query" : {
"text" : {
"name.ngram" : {
"query" : "xyz"
}
}
}
}
'

Here's my mapping:

curl -XPUT 'http://127.0.0.1:9200/test/?pretty=1' -d '
{
"mappings" : {
"member" : {
"properties" : {
"name" : {
"type": "multi_field",
"fields" : {
"untouched": {
"type": "string",
"index": "not_analyzed"
},
"name": {
"type": "string",
"analyzer": "standard_name"
},
"ngram" : {
"search_analyzer": "standard_name",
"index_analyzer": "partial_name",
"type": "string"
}
}
}
}
}
},
"settings" : {
"analysis" : {
"filter" : {
"name_ngrams" : {
"side" : "front",
"max_gram" : 10,
"min_gram" : 1,
"type" : "edgeNGram"
}
},
"analyzer" : {
"standard_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding"
],
"type" : "custom",
"tokenizer" : "standard"
},
"partial_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding",
"name_ngrams"
],
"type" : "custom",
"tokenizer" : "standard"
}
}
}
}
}
'

Can anyone give me some help to identify what might be wrong?

kimchy · April 13, 2012, 12:14pm

You can execute a phrase query and boost it.

On Thu, Apr 12, 2012 at 4:22 AM, quain quaintenance@gmail.com wrote:

Bring back this old thread, but I have a followup question. Does edge
ngram filtered fields support prefix or phrase-prefix queries? My goal is
to prefer results which have the same word ordering as the query, ie if I
search "Jack John" prefer "Jack Johnson" over "John Jackson". Can this be
done via a query type/parameter, or custom scoring?

On Sunday, March 4, 2012 11:07:04 PM UTC-8, quain wrote:

I'm having some trouble with multi_field, perhaps some of you guys
could shed some light on what I'm doing wrong. After I inserted some
documents, I get 0 hits for any searches of the field name.untouched
or name.ngram. I am successful with the main field just searching on
name. For example, the following returns nothing even though i know
the term is there exactly:

curl -XGET 'http://127.0.0.1:9200/test/_**search?pretty=1 http://127.0.0.1:9200/test/_search?pretty=1'
-d '
{
"query" : {
"text" : {
"name.ngram" : {
"query" : "xyz"
}
}
}
}
'

Here's my mapping:

curl -XPUT 'http://127.0.0.1:9200/test/?**pretty=1 http://127.0.0.1:9200/test/?pretty=1'
-d '
{
"mappings" : {
"member" : {
"properties" : {
"name" : {
"type": "multi_field",
"fields" : {
"untouched": {
"type": "string",
"index": "not_analyzed"
},
"name": {
"type": "string",
"analyzer": "standard_name"
},
"ngram" : {
"search_analyzer": "standard_name",
"index_analyzer": "partial_name",
"type": "string"
}
}
}
}
}
},
"settings" : {
"analysis" : {
"filter" : {
"name_ngrams" : {
"side" : "front",
"max_gram" : 10,
"min_gram" : 1,
"type" : "edgeNGram"
}
},
"analyzer" : {
"standard_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding"
],
"type" : "custom",
"tokenizer" : "standard"
},
"partial_name" : {
"filter" : [
"standard",
"lowercase",
"asciifolding",
"name_ngrams"
],
"type" : "custom",
"tokenizer" : "standard"
}
}
}
}
}
'

Can anyone give me some help to identify what might be wrong?

Topic		Replies	Views
Ngram and edgeNgram combined for _all field; or different token filters per field for _all Elasticsearch	1	581	July 6, 2017
Accessing multi fields Elasticsearch	4	452	July 6, 2017
Searching on multi-field fields Elasticsearch	8	1370	July 6, 2017
Edge-ngram not working for single edge case! Elasticsearch	2	176	August 4, 2022
0.90.9 in elasticsearch - indexing with ngrams, search returns 0 results Elasticsearch	5	372	July 6, 2017

Question about multi_field and edge ngram

Related Topics