Hi all,
I am parsing CDN logs, which contains a web url that serves images to users, and push these logs to Elasticsearch using Logstash. I want to add a field 'site region' in the logs which contains the region that web utl is being served from. There is an excel sheet that contains the information related to list of web urls and the region each url belongs to. Now, my question is that is there a way to fetch data from excel sheet (placed somewhere on a remote location) based on the key. Like, I have web url in the logs, so can I fetch the value against that url from the excel file. If no, then I am thinking to store all the info given in the excel sheet on Redis, and then fetch informaton against URLs from Redis, using Ruby code in Logstash (inside Grok filter plugin).
Please let me know what would be the best possible way to achieve this.
Thank you.