Phrase suggester with suggest_mode: missing across multiple indexes yields suggestions even when results exist in one index

Elastic Stack Elasticsearch
1

I'm running 1.1.1. I have found a few odd cases where the phrase suggester
with suggest_mode: missing generates a suggestion even though the query
returns results. I am querying across two indexes (and two types), and in
the cases I have found, the query term only exists in one of the indexes.
When I re-run the query across just one of the indexes/types and then the
other, the suggester behaves as expected.

I am trying to come up with a curl recreation but I haven't been able to
reproduce it yet in a smaller corpus. Meanwhile, is it possible that there
is a bug in the suggester for suggest_mode: missing where it incorrectly
judges that a term is missing from all indexes in the query just because
it's missing from one index in the query?

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/6a83656b-6232-468c-bb14-9076aa6b8a05%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

2

On Wed, May 7, 2014 at 2:10 PM, Loren loren@siebert.org wrote:

I'm running 1.1.1. I have found a few odd cases where the phrase suggester
with suggest_mode: missing generates a suggestion even though the query
returns results. I am querying across two indexes (and two types), and in
the cases I have found, the query term only exists in one of the indexes.
When I re-run the query across just one of the indexes/types and then the
other, the suggester behaves as expected.

I am trying to come up with a curl recreation but I haven't been able to
reproduce it yet in a smaller corpus. Meanwhile, is it possible that there
is a bug in the suggester for suggest_mode: missing where it incorrectly
judges that a term is missing from all indexes in the query just
because it's missing from one index in the query?

Sure!

To get the phrase suggester to spit things out with smaller corpus try
setting the shards to 1 and set max_term_freq to .99 or something closer to
one the the default.

Nik

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAPmjWd0N4G91%3DKG4d%2B53o6mp8RUi_iTBoR4Oh40CrCb-9wMJUQ%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

3

I am already using 1 shard per index, so the query is executing across 2
shards. I tried setting max_term_freq to 0.999 but was still unable to
reproduce it in a small corpus.

On Wednesday, May 7, 2014 11:19:24 AM UTC-7, Nikolas Everett wrote:

On Wed, May 7, 2014 at 2:10 PM, Loren <lo...@siebert.org <javascript:>>wrote:

I'm running 1.1.1. I have found a few odd cases where the phrase
suggester with suggest_mode: missing generates a suggestion even though the
query returns results. I am querying across two indexes (and two types),
and in the cases I have found, the query term only exists in one of the
indexes. When I re-run the query across just one of the indexes/types and
then the other, the suggester behaves as expected.

I am trying to come up with a curl recreation but I haven't been able to
reproduce it yet in a smaller corpus. Meanwhile, is it possible that there
is a bug in the suggester for suggest_mode: missing where it incorrectly
judges that a term is missing from all indexes in the query just
because it's missing from one index in the query?

Sure!

To get the phrase suggester to spit things out with smaller corpus try
setting the shards to 1 and set max_term_freq to .99 or something closer to
one the the default.

Nik

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/fd3278f0-c633-4105-a447-89427d1ace16%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.