Getting Json from a CSV

rnigam · August 20, 2015, 8:37pm

Hi,

I have a usecase where I have CSV files with a few columns with JSON values. How can I take the get the JSON column and store it in elasticsearch?

Thanks a lot! Much appreciate everyone's help.

Regards,
Rajat

ea_fox · August 20, 2015, 8:56pm

Hi, see github.com/AgileWorksOrg/elasticsearch-river-csv for example or www.elastic.co/guide/en/logstash/current/plugins-filters-csv.html will be interesting for you

rnigam · August 20, 2015, 9:46pm

Thank you for the response. I did explore the csv filter earlier but what is not clear to me is if the column value will automatically be recognized as a JSON and then further parsed before being saved to EMR.

magnusbaeck · August 21, 2015, 6:02am

Use a csv filter to split up the CSV strings, then use the json filter on the field(s) containing JSON data.

warkolm · August 21, 2015, 10:48am

Don't user rivers, they are deprecated!