I am planning to read HDFS data using logstash ( & add geoip and other filters, etc) and then send the data to elasticsearch.
Earlier, I tried ES-hadoop plugin for moving the data by creating hive tables and it worked. Now, i want to add fields like geoip ( which it seems can be added by logstash). So, i need a input plugin for hdfs. Generic question: Is it possible to map a particular field as geoip if we are not using logstash ?
Does it make sense ? Any advise ?
Thanks
Sunil Saggar