# Highlights not matching between annotated\_text and other fields **URL:** \ **Category:** Elasticsearch\ **Created:** [November 23, 2021, 10:20am UTC](https://discuss.elastic.co/t/highlights-not-matching-between-annotated-text-and-other-fields/289937 "2021-11-23T10:20:00Z")\ **Posts on this page:** 6\ **Page:** 1
**Author:** ![evoluc](https://avatars.discourse-cdn.com/v4/letter/e/e95f7d/32.png) [@evoluc](https://discuss.elastic.co/u/evoluc)\ **Post date:** [November 23, 2021, 10:20am UTC](https://discuss.elastic.co/t/highlights-not-matching-between-annotated-text-and-other-fields/289937/1 "2021-11-23T10:20:00Z")
Executing a query\_string search on an index the returned matched highlights sometimes don't really match (this is needed to get the annotated metadata). From what I've seen there is not much support for this kind of features, but I guess asking doesn't hurt. Starting from the result: ```auto "highlight" : { "annotatedText" : [ "[Grazie](976200) [Presidente](_hit_term=annotatedText%3Apresi*&976200) [buongiorno](_hit_term=buongiorno&976200) [a](976200) [tutte](976200) [buongiorno](_hit_term=buongiorno&978720) [a](978720) [tutti.](978720)", "[Grazie](3357160) [Presidente](_hit_term=annotatedText%3Apresi*&3357160) [e](3357160) [buongiorno](_hit_term=buongiorno&3357160) [colleghi.](3357160)", "[Grazie](3893600) [Presidente](_hit_term=annotatedText%3Apresi*&3893600) [buongiorno](_hit_term=buongiorno&3893600) [all'aula](3896880) [e](3896880)", "[Grazie](4248920) [presidente](_hit_term=annotatedText%3Apresi*&4248920) [e](4248920) [un](4248920) [buongiorno](_hit_term=buongiorno&4248920) [colleghe](4248920) [e](4248920)", "[Grazie](6168080) [presidente](_hit_term=annotatedText%3Apresi*). [Buongiorno](_hit_term=buongiorno&6169280) [a](6169280) [tutti.](6169280)" ], "text" : [ "Buongiorno buongiorno a tutti possiamo iniziare chiedo al consigliere segretario Jordan di procedere all'appello. ", "Grazie Presidente buongiorno a tutte buongiorno a tutti.", "Grazie Presidente e buongiorno colleghi. Bisogna evidenziare che in questi ultimi anni la situazione", "Consigliere Cretier ne ha facoltà. Grazie Presidente buongiorno all'aula e ai colleghi consiglieri e alla giunta compresa. ", "Grazie presidente e un buongiorno colleghe e colleghi. " ] } ``` The first annotated text highlight matches the second text highlight, the second annotated matches the third text, and so on until the fifth doesn't really match anything. Other results are correct and others diverge at some other point. The POST \_search is like this: ```auto { "query": { "query_string": { "query": "presi* buongiorno", "fields": ["textItalian","text","annotatedText"], "default_operator": "AND", "type": "phrase", "analyze_wildcard": true } }, "_source": { "excludes": ["text","annotatedText","textItalian"] }, "highlight": { "fields": { "text": {}, "annotatedText": { "type":"annotated", "matched_fields": ["text","textItalian"] } } ,"type": "fvh" ,"boundary_scanner": "sentence" } ,"sort": [{"referenceDate": { "order": "asc" }}] } ``` And the index is like this: ```auto { "mappings" : { "properties" : { "$type" : { "type" : "text" }, "annotatedText" : { "type" : "annotated_text", "term_vector" : "with_positions_offsets" }, "contentId" : { "type" : "long" }, "id" : { "type" : "text", "fields" : { "keyword" : { "type" : "keyword", "ignore_above" : 256 } } }, "inserted" : { "type" : "date" }, "language" : { "type" : "text", "fields" : { "keyword" : { "type" : "keyword", "ignore_above" : 256 } } }, "referenceDate" : { "type" : "date" }, "text" : { "type" : "text", "term_vector" : "with_positions_offsets", "index_prefixes" : { "min_chars" : 2, "max_chars" : 5 } }, "textItalian" : { "type" : "text", "term_vector" : "with_positions_offsets", "analyzer" : "italian", "index_prefixes" : { "min_chars" : 2, "max_chars" : 5 } }, "trackId" : { "type" : "long" } } } } ``` EDIT Apparently `"require_field_match":false` helps a little. I'm using Elasticsearch 7.14. ---
**Author:** ![Mark\_Harwood](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mark_harwood/32/10538_2.png) [@Mark\_Harwood](https://discuss.elastic.co/u/Mark_Harwood)\ **Post date:** [November 23, 2021, 11:27am UTC](https://discuss.elastic.co/t/highlights-not-matching-between-annotated-text-and-other-fields/289937/2 "2021-11-23T11:27:13Z")
Hi evoluc > [@evoluc](#): > > The first annotated text highlight matches the second text highlight, the second annotated matches the third text, and so on until the fifth doesn't really match anything. I'm not sure I understand the problem. All 5 highlighted snippets include a hit on the term `presidente` so I don't get the comment "the fifth doesn't really match anything" ---
**Author:** ![evoluc](https://avatars.discourse-cdn.com/v4/letter/e/e95f7d/32.png) [@evoluc](https://discuss.elastic.co/u/evoluc)\ **Post date:** [November 23, 2021, 11:39am UTC](https://discuss.elastic.co/t/highlights-not-matching-between-annotated-text-and-other-fields/289937/3 "2021-11-23T11:39:06Z")
All the fields contain the same text, so by using matched\_fields I sort of expected that the highlights in annotatedText should correspond to the highlights of the other field(s). ---
**Author:** ![Mark\_Harwood](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mark_harwood/32/10538_2.png) [@Mark\_Harwood](https://discuss.elastic.co/u/Mark_Harwood)\ **Post date:** [November 23, 2021, 11:45am UTC](https://discuss.elastic.co/t/highlights-not-matching-between-annotated-text-and-other-fields/289937/4 "2021-11-23T11:45:25Z")
> [@evoluc](#): > > I sort of expected that the highlights in annotatedText should correspond to the highlights of the other field(s). The text and and the annotated\_text field in your request use different highlighter implementations which will behave differently. I see, for example, that the plain text field has not highlighted any of the `presi*` search terms. The truth of it is there are various different highlighter implementations written by various authors over the years, who have each set out to improve on all the other ones. Each make their own trade-offs and behave with subtle differences. ---
**Author:** ![evoluc](https://avatars.discourse-cdn.com/v4/letter/e/e95f7d/32.png) [@evoluc](https://discuss.elastic.co/u/evoluc)\ **Post date:** [November 23, 2021, 3:26pm UTC](https://discuss.elastic.co/t/highlights-not-matching-between-annotated-text-and-other-fields/289937/5 "2021-11-23T15:26:06Z")
Oh, yeah, the specific type:annotated on the field overwrites the global type:fvh, so matched\_fields is ignored, I was kinda oblivious to that, now I saw it. I got to that because it's not possible to extract the offset of the highlight, so I tried to execute a query and then match the offset internally on another field. I don't know, I will try maybe another way, like querying two times annotatedText one with the italian analyzer and one with the standard analyzer. Thanks anyway. ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [December 21, 2021, 3:26pm UTC](https://discuss.elastic.co/t/highlights-not-matching-between-annotated-text-and-other-fields/289937/6 "2021-12-21T15:26:39Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.