I have read about translate filter functionality in logstash which could be used for lookup event data with that of a file( csv, json) which we can define in destination_path yml file.
Can I use an elastisearch index ( containing the key-value lookup data) to be used instead of csv/json file?
This is due to the reason that my event data is in one index and my lookup data is in another index and I want to merge them based on key value. The lookup data is huge to be kept in a csv/json file.
if it's not possible with translate, is there any other way or other filter?