Hi I am facing an issue and I may sound silly in asking this but really need to know if any solution to this is available. The condition being I have two fields title and statement. Title where as is a small field with not more words but statement is a multivalue field and can have any number of s…

Have you tried boosting the field you want to be more relevant? https://www.elastic.co/guide/en/elasticsearch/guide/current/_boosting_query_clauses.html

@rjernst yes we are boosting the field , we are using multimatch query to go in which both fields are boosted with boost factor of 4. As mentioned in problem statement even if both have same boost factor of 4, if there is same term match in both fields still the title field is getting higher releva…

Thanks @rjernst but I am already using BM25 similarity plugin and the field length and term frequency has been normalized. The only thing which is creating nuisance in my case is idf of the keywords searched for. And normalizing them is a big issue to which I have not got any answer.

[image] ashit_pupu: the field length and term frequency has been normalized But you say you don't want field length normalization. Set b to 0.0 if you don't want the length of the field (ie title being shorting on average than statement) to affect the score.

Ahh !!! My bad. b and k both values have been set to 0 in the setting.

Can we manipulate the idf calculation field in Elasticsearch?

Elastic Stack Elasticsearch

rjernst (Ryan Ernst) June 8, 2017, 6:09am 4

I think you should look at using BM25 similarity (which is the default starting in ES 5.0). It has parameters for controlling eg the influence of field length normalization.
https://www.elastic.co/guide/en/elasticsearch/guide/current/pluggable-similarites.html

Topic		Replies	Views
Custom scoring using IDF of _all field? Elasticsearch	2	920	July 5, 2017
Question regarding the IDF value for the optional fields in a document Elasticsearch	4	622	January 19, 2022
Calculating with Document Frequency, not Inverse Document Frequency Elasticsearch	7	1471	July 6, 2017
BM25 how to scoring ignore idf or set scope for total number of documents with search field Elasticsearch	1	689	January 26, 2022
Use IDF from _all field across other fields Elasticsearch	3	844	July 5, 2017

Can we manipulate the idf calculation field in Elasticsearch?

Related topics