# Highlighter problem **URL:** \ **Category:** Elasticsearch\ **Created:** [December 16, 2013, 6:28am UTC](https://discuss.elastic.co/t/highlighter-problem/14879 "2013-12-16T06:28:31Z")\ **Posts on this page:** 6\ **Page:** 1
**Author:** ![paul1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/paul1/32/46819_2.png) [@paul1](https://discuss.elastic.co/u/paul1)\ **Post date:** [December 16, 2013, 6:28am UTC](https://discuss.elastic.co/t/highlighter-problem/14879/1 "2013-12-16T06:28:31Z")
I am trying out Highlighter feature of elastic-search. the text marked in yellow is expected but why did it match the text marked in green ? elastic-search = 0.90.0 java = 1.7 analyzer on that filed is "autocomplete" below is the configuration "autocomplete":{ "type":"custom", "tokenizer":"standard", "filter":[ "standard", "lowercase", "syns\_filter", "my\_edgeNgram" ] }, My query: { "fields": [ "name" ], "query": { "match": { "name": "univ" } }, "highlight": { "pre\_tags": [ "" ], "post\_tags": [ "" ], "fields": { "name": {} } } } Results: { fields:{ name:SUNY Binghamton University } highlight:{ name:[ SUNY Binghamton University ] } } { fields:{ name:Arizona State University } highlight:{ name:[ Arizona State University ] } } { fields:{ name:Ohio State University } highlight:{ name:[ Ohio State University ] } } -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/5d4a683f-a208-4a17-bce1-0248f43dbcd6%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/5d4a683f-a208-4a17-bce1-0248f43dbcd6%40googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![jpountz](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jpountz/32/45836_2.png) [@jpountz](https://discuss.elastic.co/u/jpountz)\ **Post date:** [December 16, 2013, 10:00am UTC](https://discuss.elastic.co/t/highlighter-problem/14879/2 "2013-12-16T10:00:47Z")
Hi Paul, Can you also paste your definitions of "syns\_filter" and "my\_edgeNgram"? On Mon, Dec 16, 2013 at 7:28 AM, paul [avinashpaul85@gmail.com](mailto:avinashpaul85@gmail.com) wrote: > I am trying out Highlighter feature of elastic-search. the text marked in > yellow is expected but why did it match the text marked in green ? > > elastic-search = 0.90.0 > java = 1.7 > > analyzer on that filed is "autocomplete" below is the configuration > > "autocomplete":{ > "type":"custom", > "tokenizer":"standard", > "filter":[ > "standard", > "lowercase", > "syns\_filter", > "my\_edgeNgram" > ] > }, > > My query: > { > "fields": [ > "name" > ], > "query": { > "match": { > "name": "univ" > } > }, > "highlight": { > "pre\_tags": [ > "" > ], > "post\_tags": [ > "" > ], > "fields": { > "name": {} > } > } > } > > Results: > > { > fields:{ > name:SUNY Binghamton University > } highlight:{ > name:[ > SUNY Binghamton University > ] > } > } > > { > fields:{ > name:Arizona State University > } highlight:{ > name:[ > Arizona State University > ] > } > } > > { > fields:{ > name:Ohio State University > } highlight:{ > name:[ > Ohio State University > ] > } > } > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/5d4a683f-a208-4a17-bce1-0248f43dbcd6%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/5d4a683f-a208-4a17-bce1-0248f43dbcd6%40googlegroups.com) > . > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- Adrien Grand -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAL6Z4j48z-DWMmN3cRgNva93WZjxyRj1d-G%3D9fkTkd\_Zn1Koaw%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAL6Z4j48z-DWMmN3cRgNva93WZjxyRj1d-G%3D9fkTkd_Zn1Koaw%40mail.gmail.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![paul1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/paul1/32/46819_2.png) [@paul1](https://discuss.elastic.co/u/paul1)\ **Post date:** [December 17, 2013, 5:03am UTC](https://discuss.elastic.co/t/highlighter-problem/14879/3 "2013-12-17T05:03:24Z")
Sure Adrien below is my definitions , "filter":{ "syns\_filter":{ "synonyms\_path":"synonyms/synonym\_collegename.txt", "type":"synonym", "ignore\_case":true }, "my\_edgeNgram":{ "type":"edgeNGram", "min\_gram":3, "max\_gram":10 } } } Regards Paul On Monday, 16 December 2013 15:30:47 UTC+5:30, Adrien Grand wrote: > Hi Paul, > > Can you also paste your definitions of "syns\_filter" and "my\_edgeNgram"? > > On Mon, Dec 16, 2013 at 7:28 AM, paul \<[avinas...@gmail.com](mailto:avinas...@gmail.com) \\>wrote: > > > I am trying out Highlighter feature of elastic-search. the text marked in > > yellow is expected but why did it match the text marked in green ? > > > > elastic-search = 0.90.0 > > java = 1.7 > > > > analyzer on that filed is "autocomplete" below is the configuration > > > > "autocomplete":{ > > "type":"custom", > > "tokenizer":"standard", > > "filter":[ > > "standard", > > "lowercase", > > "syns\_filter", > > "my\_edgeNgram" > > ] > > }, > > > > My query: > > { > > "fields": [ > > "name" > > ], > > "query": { > > "match": { > > "name": "univ" > > } > > }, > > "highlight": { > > "pre\_tags": [ > > "" > > ], > > "post\_tags": [ > > "" > > ], > > "fields": { > > "name": {} > > } > > } > > } > > > > Results: > > > > { > > fields:{ > > name:SUNY Binghamton University > > } highlight:{ > > name:[ > > SUNY Binghamton University > > ] > > } > > } > > > > { > > fields:{ > > name:Arizona State University > > } highlight:{ > > name:[ > > Arizona State University > > ] > > } > > } > > > > { > > fields:{ > > name:Ohio State University > > } highlight:{ > > name:[ > > Ohio State University > > ] > > } > > } > > > > -- > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/5d4a683f-a208-4a17-bce1-0248f43dbcd6%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/5d4a683f-a208-4a17-bce1-0248f43dbcd6%40googlegroups.com) > > . > > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). > > -- > Adrien Grand -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/7ab57905-1533-4c4a-81e3-b370d0dced7e%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/7ab57905-1533-4c4a-81e3-b370d0dced7e%40googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![jpountz](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jpountz/32/45836_2.png) [@jpountz](https://discuss.elastic.co/u/jpountz)\ **Post date:** [December 17, 2013, 7:24am UTC](https://discuss.elastic.co/t/highlighter-problem/14879/4 "2013-12-17T07:24:05Z")
I think the answer is in the content the content of the synonyms file. For example if there is an entry in this file that looks like "Binghamton, Binghamton University", in the end the analyzer is going to produce something like "b", "bi", ..., "bing", ..., "u", "un", ..., "univ", ... for a token whose term is "Binghamton". So if you search for "univ", it is actually going to highlight the "bing" of "Binghamton". I don't think there is a simple solution to your problem. Since you seem to be using this index for auto-completion purposes, maybe a better option would be to not use synonyms in the analyzer but to add a separate document for every synonym. On a side note, since you are doing auto-completion, maybe you could have a look at the completion suggester[1]. Although it doesn't support highlighting, I would expect it to be an order of magnitude faster than index-based autocompletion so this might be worth checking out. [1] > **[Elasticsearch Platform — Find real-time answers at scale](https://www.elastic.co)** > > Power insights and outcomes with the Elasticsearch Platform and AI. See into your data and find answers that matter with enterprise solutions designed to help you build, observe, and protect. Try Elasticsearch free today. On Tue, Dec 17, 2013 at 6:03 AM, paul [avinashpaul85@gmail.com](mailto:avinashpaul85@gmail.com) wrote: > Sure Adrien below is my definitions , > > "filter":{ > "syns\_filter":{ > "synonyms\_path":"synonyms/synonym\_collegename.txt", > "type":"synonym", > "ignore\_case":true > }, > "my\_edgeNgram":{ > "type":"edgeNGram", > "min\_gram":3, > "max\_gram":10 > } > } > } > > Regards > Paul > > On Monday, 16 December 2013 15:30:47 UTC+5:30, Adrien Grand wrote: > > > Hi Paul, > > > > Can you also paste your definitions of "syns\_filter" and "my\_edgeNgram"? > > > > On Mon, Dec 16, 2013 at 7:28 AM, paul [avinas...@gmail.com](mailto:avinas...@gmail.com) wrote: > > > > > I am trying out Highlighter feature of elastic-search. the text marked > > > in yellow is expected but why did it match the text marked in green ? > > > > > > elastic-search = 0.90.0 > > > java = 1.7 > > > > > > analyzer on that filed is "autocomplete" below is the configuration > > > > > > "autocomplete":{ > > > "type":"custom", > > > "tokenizer":"standard", > > > "filter":[ > > > "standard", > > > "lowercase", > > > "syns\_filter", > > > "my\_edgeNgram" > > > ] > > > }, > > > > > > My query: > > > { > > > "fields": [ > > > "name" > > > ], > > > "query": { > > > "match": { > > > "name": "univ" > > > } > > > }, > > > "highlight": { > > > "pre\_tags": [ > > > "" > > > ], > > > "post\_tags": [ > > > "" > > > ], > > > "fields": { > > > "name": {} > > > } > > > } > > > } > > > > > > Results: > > > > > > { > > > fields:{ > > > name:SUNY Binghamton University > > > } highlight:{ > > > name:[ > > > SUNY Binghamton University > > > ] > > > } > > > } > > > > > > { > > > fields:{ > > > name:Arizona State University > > > } highlight:{ > > > name:[ > > > Arizona State University > > > ] > > > } > > > } > > > > > > { > > > fields:{ > > > name:Ohio State University > > > } highlight:{ > > > name:[ > > > Ohio State University > > > ] > > > } > > > } > > > > > > -- > > > You received this message because you are subscribed to the Google > > > Groups "elasticsearch" group. > > > To unsubscribe from this group and stop receiving emails from it, send > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > > > > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/) > > > msgid/elasticsearch/5d4a683f-a208-4a17-bce1-0248f43dbcd6% > > > [40googlegroups.com](http://40googlegroups.com). > > > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). > > > > -- > > Adrien Grand > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/7ab57905-1533-4c4a-81e3-b370d0dced7e%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/7ab57905-1533-4c4a-81e3-b370d0dced7e%40googlegroups.com) > . > > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- Adrien Grand -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAL6Z4j7L3r%2BSYQV8YPJa0DRDShBR8cd8u687K0HD%3DYmtg981YQ%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAL6Z4j7L3r%2BSYQV8YPJa0DRDShBR8cd8u687K0HD%3DYmtg981YQ%40mail.gmail.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![paul1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/paul1/32/46819_2.png) [@paul1](https://discuss.elastic.co/u/paul1)\ **Post date:** [December 17, 2013, 8:04am UTC](https://discuss.elastic.co/t/highlighter-problem/14879/5 "2013-12-17T08:04:25Z")
Thank you Adrien , will read search-suggesters-completion and see whether it suits my requirement. Regards Paul On Tue, Dec 17, 2013 at 12:54 PM, Adrien Grand \< [adrien.grand@elasticsearch.com](mailto:adrien.grand@elasticsearch.com)\> wrote: > I think the answer is in the content the content of the synonyms file. For > example if there is an entry in this file that looks like "Binghamton, > Binghamton University", in the end the analyzer is going to produce > something like "b", "bi", ..., "bing", ..., "u", "un", ..., "univ", ... for > a token whose term is "Binghamton". So if you search for "univ", it is > actually going to highlight the "bing" of "Binghamton". > > I don't think there is a simple solution to your problem. Since you seem > to be using this index for auto-completion purposes, maybe a better option > would be to not use synonyms in the analyzer but to add a separate document > for every synonym. > > On a side note, since you are doing auto-completion, maybe you could have > a look at the completion suggester[1]. Although it doesn't support > highlighting, I would expect it to be an order of magnitude faster than > index-based autocompletion so this might be worth checking out. > > [1] > [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/search-suggesters-completion.html) > > On Tue, Dec 17, 2013 at 6:03 AM, paul [avinashpaul85@gmail.com](mailto:avinashpaul85@gmail.com) wrote: > > > Sure Adrien below is my definitions , > > > > "filter":{ > > "syns\_filter":{ > > "synonyms\_path":"synonyms/synonym\_collegename.txt", > > "type":"synonym", > > "ignore\_case":true > > }, > > "my\_edgeNgram":{ > > "type":"edgeNGram", > > "min\_gram":3, > > "max\_gram":10 > > } > > } > > } > > > > Regards > > Paul > > > > On Monday, 16 December 2013 15:30:47 UTC+5:30, Adrien Grand wrote: > > > > > Hi Paul, > > > > > > Can you also paste your definitions of "syns\_filter" and "my\_edgeNgram"? > > > > > > On Mon, Dec 16, 2013 at 7:28 AM, paul [avinas...@gmail.com](mailto:avinas...@gmail.com) wrote: > > > > > > > I am trying out Highlighter feature of elastic-search. the text marked > > > > in yellow is expected but why did it match the text marked in green ? > > > > > > > > elastic-search = 0.90.0 > > > > java = 1.7 > > > > > > > > analyzer on that filed is "autocomplete" below is the configuration > > > > > > > > "autocomplete":{ > > > > "type":"custom", > > > > "tokenizer":"standard", > > > > "filter":[ > > > > "standard", > > > > "lowercase", > > > > "syns\_filter", > > > > "my\_edgeNgram" > > > > ] > > > > }, > > > > > > > > My query: > > > > { > > > > "fields": [ > > > > "name" > > > > ], > > > > "query": { > > > > "match": { > > > > "name": "univ" > > > > } > > > > }, > > > > "highlight": { > > > > "pre\_tags": [ > > > > "" > > > > ], > > > > "post\_tags": [ > > > > "" > > > > ], > > > > "fields": { > > > > "name": {} > > > > } > > > > } > > > > } > > > > > > > > Results: > > > > > > > > { > > > > fields:{ > > > > name:SUNY Binghamton University > > > > } highlight:{ > > > > name:[ > > > > SUNY Binghamton University > > > > ] > > > > } > > > > } > > > > > > > > { > > > > fields:{ > > > > name:Arizona State University > > > > } highlight:{ > > > > name:[ > > > > Arizona State University > > > > ] > > > > } > > > > } > > > > > > > > { > > > > fields:{ > > > > name:Ohio State University > > > > } highlight:{ > > > > name:[ > > > > Ohio State University > > > > ] > > > > } > > > > } > > > > > > > > -- > > > > You received this message because you are subscribed to the Google > > > > Groups "elasticsearch" group. > > > > To unsubscribe from this group and stop receiving emails from it, send > > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > > > > > > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/) > > > > msgid/elasticsearch/5d4a683f-a208-4a17-bce1-0248f43dbcd6% > > > > [40googlegroups.com](http://40googlegroups.com). > > > > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). > > > > > > -- > > > Adrien Grand > > > > -- > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/7ab57905-1533-4c4a-81e3-b370d0dced7e%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/7ab57905-1533-4c4a-81e3-b370d0dced7e%40googlegroups.com) > > . > > > > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). > > -- > Adrien Grand > > -- > You received this message because you are subscribed to a topic in the > Google Groups "elasticsearch" group. > To unsubscribe from this topic, visit > [https://groups.google.com/d/topic/elasticsearch/\_AGDR-z6glM/unsubscribe](https://groups.google.com/d/topic/elasticsearch/_AGDR-z6glM/unsubscribe). > To unsubscribe from this group and all its topics, send an email to > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/CAL6Z4j7L3r%2BSYQV8YPJa0DRDShBR8cd8u687K0HD%3DYmtg981YQ%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAL6Z4j7L3r%2BSYQV8YPJa0DRDShBR8cd8u687K0HD%3DYmtg981YQ%40mail.gmail.com) > . > > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAO066G3LzSu\_Avt4fg731Yunm-fqzhEhyUbYHPVDPj8NrUfYSw%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAO066G3LzSu_Avt4fg731Yunm-fqzhEhyUbYHPVDPj8NrUfYSw%40mail.gmail.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 2:00am UTC](https://discuss.elastic.co/t/highlighter-problem/14879/6 "2017-07-06T02:00:42Z")