Feedback requested: automatic query expansion

Relevance model 3 (RM3) is a traditional query expansion strategy based on language modeling. Several recent papers have shown that BM25 retrieval with RM3 expansion gives a very strong baseline, competitive even with more advanced approaches [1, 2]. Although RM3 often appears in the academic search literature, we haven't come across many examples of RM3 being used in practice.

We are hoping for community feedback to help inform our thinking on how we can better support query expansion in Elasticsearch:

  • Have you tried using RM3 in your applications? How was it integrated? Did you find it measurably improved the search experience?
  • Did you have a positive experience deploying any other automatic query expansion method? For example, this could include training a word embedding model, and selecting expansion terms by looking at the distance between word vectors.

As an important note, some new search features are being developed under the Elastic license (non-OSS). Your input may end up influencing an Elastic-licensed feature.

Thanks in advance!
Julie

1 Like

Consolidating some feedback I received in person:

  • One user is experimenting with using RM3 to perform a type of 'more like this' query. Their initial evaluation shows better results than a standard 'more like this' query.
  • Another user sees good results from RM3 for a question-answering task. Their pipeline is inspired by Anserini. It has not yet been deployed to production.
1 Like

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.