Is there any way to return the actual tokens generated by an
index_analyzer at search time? I am using the synonyms filter
(without expansion) to index a particular field, and would like to get
the standardized value (right-hand-side of the "=>" in my synonyms
file ) for each document that was retrieved.
synonym file includes, for example:
i-pod, i pod => ipod,
when user searches for "i-pod" or "i pod", I want to return the
indexed doc, but also want to return "ipod" as the token that was
created at index time as part of the analysis.
I have my synonyms analyzer up and running, and can get the proper
tokens using the Analyze API.
Many thanks in advance for your thoughts and time.