The issue that I ran into is that ssl_certificate_verification is not allowed as a parameter on the Elasticsearch filter hence it is not connecting to Elasticsearch. I tried generating the cert using the following link so that I can have a secure SSL connection but that also doesn't work
2)After which I tried the translate filter to achieve the same, I get no error but the lookup using the dictionary is not happening
Can you provide more context? It is no clear what you are trying to do now since you mentioned translate filter and elasticsearch filter in Logstash and Enrich pipeline in Elasticsearch which are two completely different things.
I would say that if you are using Logstash the easiest way to enrich data is using the translate filter.
You didn't share any sample message of how your data looks like, nor any log error you are getting, so it is not possible to know why the translate filter didn't worked.
Also, in the logstash configuration you shared you had your translate filter before your json filter, it needs to come after you parse your message or the source field will not exist and the translate filter will not work.
Thanks a lot for pointing that out I was able to get the translate working and instead of using dictionary I have used the dictionary path variable but I noticed that every time we update the values on the CSV file we need to restart logstash is that right ?
Also I am using multiple translate in the filter for performing multiple lookups.