Phrase suggester not delivering any results


(Klaus Stadler) #1

I've been trying to get the phrase suggester up and running, but something
is wrong. I don't get any results.

The search query looks like this:
{
"suggest": {
"text": "schoko",
"simple_phrase": {
"phrase": {
"analyzer": "simple",
"field": "title",
"size": 4,
"real_word_error_likelihood": 0.95,
"confidence": 2,
"gram_size": 1,
"direct_generator": [
{
"field": "title",
"suggest_mode": "always",
"min_word_len": 1
}
]
}
}
}
}

The type mapping looks like this:
{
"products": {
"properties": {
"message": {
"type": "string"
},
"image": {
"type": "string"
},
"price": {
"type": "string"
},
"source": {
"type": "string"
},
"title": {
"type": "multi_field",
"fields": {
"title": {
"type": "string"
},
"suggest": {
"type": "string",
"analyzer": "shingle_analyzer",
"store": true,
"term_vector": "with_positions_offsets"
}
}
},
"@timestamp": {
"type": "date",
"format": "dateOptionalTime"
},
"@version": {
"type": "string"
},
"deeplink": {
"type": "string"
},
"host": {
"type": "string"
},
"logstash_checksum": {
"type": "string"
},
"path": {
"type": "string"
}
}
}
}

And index settings look like this:
{
"settings": {
"analysis": {
"filter": {
"shingle_filter": {
"type": "shingle",
"min_shingle_size": 2,
"max_shingle_size": 5
}
},
"analyzer": {
"shingle_analyzer": {
"type": "custom",
"tokenizer": "standard",
"filter": [
"lowercase",
"shingle_filter"
]
}
}
}
}
}

Any ideas on what's wrong?
I'd be really grateful for any hints!

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/ede1d487-11e8-4267-8c56-37cf82e10335%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(Klaus Stadler) #2

I've now tried to setup a Play Gist showing the problems:
https://www.found.no/play/gist/3fd142f32eb42cb0730d
When I search for "schwar" I get the suggestion "schwarz" as expected.

However, if I search for "iP" I don't get any suggestions.
I'd want ES to suggest "iPad" and "iPhone" in this case.

How can this be achieved?

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/80eee31c-a94b-47ce-973a-45718c9c7fdc%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(Nik Everett) #3

Try setting
max_term_freq to .99, prefix_length to 1, and confidence to 0. See what
that gives you.

Nik

On Mon, Jun 23, 2014 at 9:55 AM, Klaus Stadler <
klaus.stadler@united-internet-media.de> wrote:

I've now tried to setup a Play Gist showing the problems:
https://www.found.no/play/gist/3fd142f32eb42cb0730d
When I search for "schwar" I get the suggestion "schwarz" as expected.

However, if I search for "iP" I don't get any suggestions.
I'd want ES to suggest "iPad" and "iPhone" in this case.

How can this be achieved?

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/80eee31c-a94b-47ce-973a-45718c9c7fdc%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/80eee31c-a94b-47ce-973a-45718c9c7fdc%40googlegroups.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAPmjWd2ffrwwt0h14Cko%2BtO3KGjYLjYMUCvA5OTA44_tepnOjw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


(Klaus Stadler) #4

Thanks for your suggestion. I've tried it immediately, but the only
suggestion I get is "ip".

Am Montag, 23. Juni 2014 16:08:20 UTC+2 schrieb Nikolas Everett:

Try setting
max_term_freq to .99, prefix_length to 1, and confidence to 0. See what
that gives you.

Nik

On Mon, Jun 23, 2014 at 9:55 AM, Klaus Stadler <
klaus....@united-internet-media.de <javascript:>> wrote:

I've now tried to setup a Play Gist showing the problems:
https://www.found.no/play/gist/3fd142f32eb42cb0730d
When I search for "schwar" I get the suggestion "schwarz" as expected.

However, if I search for "iP" I don't get any suggestions.
I'd want ES to suggest "iPad" and "iPhone" in this case.

How can this be achieved?

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/80eee31c-a94b-47ce-973a-45718c9c7fdc%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/80eee31c-a94b-47ce-973a-45718c9c7fdc%40googlegroups.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/2a82c214-7720-4026-90a1-b263d6ec5b7c%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(Nik Everett) #5

Huh. Sorry, I'm not sure beyond that.

Nik

On Mon, Jun 23, 2014 at 10:16 AM, Klaus Stadler <
klaus.stadler@united-internet-media.de> wrote:

Thanks for your suggestion. I've tried it immediately, but the only
suggestion I get is "ip".

Am Montag, 23. Juni 2014 16:08:20 UTC+2 schrieb Nikolas Everett:

Try setting
max_term_freq to .99, prefix_length to 1, and confidence to 0. See what
that gives you.

Nik

On Mon, Jun 23, 2014 at 9:55 AM, Klaus Stadler <klaus....@united-
internet-media.de> wrote:

I've now tried to setup a Play Gist showing the problems:
https://www.found.no/play/gist/3fd142f32eb42cb0730d
When I search for "schwar" I get the suggestion "schwarz" as expected.

However, if I search for "iP" I don't get any suggestions.
I'd want ES to suggest "iPad" and "iPhone" in this case.

How can this be achieved?

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/80eee31c-a94b-47ce-973a-45718c9c7fdc%
40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/80eee31c-a94b-47ce-973a-45718c9c7fdc%40googlegroups.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/2a82c214-7720-4026-90a1-b263d6ec5b7c%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/2a82c214-7720-4026-90a1-b263d6ec5b7c%40googlegroups.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAPmjWd1ZVAZuua3Hwu5xoJ2C_v7%3DA47222yFapYeAhX1pk7Lsw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


(Klaus Stadler) #6

I've experimented with a method suggested by a website:
query:
prefix:
title.title_shingle:
value: ip
facets:
suggestion:
terms:
field: title.title_shingle
regex: ^ip.*
size: 10

The result looks good, but the website also mentions the performance isn't
good with big indexes.

So I'm still looking for an alternative.

Am Montag, 23. Juni 2014 16:19:37 UTC+2 schrieb Nikolas Everett:

Huh. Sorry, I'm not sure beyond that.

Nik

On Mon, Jun 23, 2014 at 10:16 AM, Klaus Stadler <
klaus....@united-internet-media.de <javascript:>> wrote:

Thanks for your suggestion. I've tried it immediately, but the only
suggestion I get is "ip".

Am Montag, 23. Juni 2014 16:08:20 UTC+2 schrieb Nikolas Everett:

Try setting
max_term_freq to .99, prefix_length to 1, and confidence to 0. See what
that gives you.

Nik

On Mon, Jun 23, 2014 at 9:55 AM, Klaus Stadler <klaus....@united-
internet-media.de> wrote:

I've now tried to setup a Play Gist showing the problems:
https://www.found.no/play/gist/3fd142f32eb42cb0730d
When I search for "schwar" I get the suggestion "schwarz" as expected.

However, if I search for "iP" I don't get any suggestions.
I'd want ES to suggest "iPad" and "iPhone" in this case.

How can this be achieved?

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/80eee31c-a94b-47ce-973a-45718c9c7fdc%
40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/80eee31c-a94b-47ce-973a-45718c9c7fdc%40googlegroups.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/2a82c214-7720-4026-90a1-b263d6ec5b7c%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/2a82c214-7720-4026-90a1-b263d6ec5b7c%40googlegroups.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/bf9aef40-208b-4d94-85d7-f97dd7cdce71%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(system) #7