Learning optimal boost weight [ML]


(nicolas) #1

Hi,

i have several fields playing in the query.

some fields are more important than other , requiring to set boost factors.

I would like to automatically learn the optimal boost weight for each field
based on a training data set.

is there a plugin or framework to do that nicely with ES?

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/83314839-18cf-4ff8-88d7-e870485cb5f5%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(Ivan Brusic) #2

I have something similar which uses search analytics to determine relevant
filters. No plugin or framework since everything works on the client side
during the creation of the query. The process is far from ideal and is
currently very conservative, providing only a slight boost. It does not
work only multiple fields, just on the different values for a single field.

For boosting, I use filtered subsets. The process works well and the boost
is applied after Lucene scoring:

http://www.elasticsearch.org/guide/en/elasticsearch/guide/current/function-score-filters.html

     "functions": [
        {
           "filter": {
              "term": {
                 "tag": 34252366377419
              }
           },
           "boost_factor": 1.1
        }
     ]

Cheers,

Ivan

On Thu, Sep 4, 2014 at 8:16 AM, NM n.maisonneuve@gmail.com wrote:

Hi,

i have several fields playing in the query.

some fields are more important than other , requiring to set boost factors.

I would like to automatically learn the optimal boost weight for each
field based on a training data set.

is there a plugin or framework to do that nicely with ES?

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/83314839-18cf-4ff8-88d7-e870485cb5f5%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/83314839-18cf-4ff8-88d7-e870485cb5f5%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQD7DY%3DFN%3DH%3DMsZThuo4b87X3Y6JsH-OzUPPiDtVh2116A%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


(system) #3