Query optimization

[hadrienrsq (Hadrien)]

Dear community,

I am pretty brand new to Elasticsearch and am looking to perform some sort of two steps query on one index. Indeed, the items in the index have what we call a cli_ID attribute, which I would like to pre-filter the data on, and then perform an embedding similarity calculation (that could take some time) only on the items that match the first query.

Plus I would need to retrieve the scores associated with the embedding calculation exclusively.

I have implemented a solution using the post-filter option of Elasticsearch, however, it does not provide the score associated with the second query (embedding similarity calculation)

query_body = {
    "query": {"wildcard": { "client_ID" : "*"+cli_ID+"*" }},
    "post_filter": { 
        "bool": {
          "must": [
            /: query for the embedding calculation goes here. :/
          ]
        }
    }
}

This is a test using the post_filter option but definitely does not fit our use case completely.

Function score inside the Post filter query.(elasticsearch)

This link indicates that the post-filter can't provide the score using a filter option.

So my question is a little open, but I would really appreciate some guidance towards whatever solution that :

• Helps me prefilter the items in the index by client-ID
• Then compute the embedding similarity on those items
• Let me access the scores that are produced in the second query;

Thank you for your help in advance;