I'm trying to measure the effectiveness of query changes.
I am collecting data about what searches users are making and what was their target document.
To that end, I want to play back the searches later to find out whether a query modification helps or hurts the relevancy of the search results.
Is there a way to select the rank of a document in a specific search? That is, I want to perform a search and get the position of a specific document in the search results.
Is there an easy way to do this? Previously I paged through all results until I found the document in question, this was slow but feasible since there are not that many documents.