How to convert input data to parquet using logstash.?

sdaruna · March 28, 2016, 9:06pm

Hi,

I have json/xml data as input and i need to move the data to parquet using logstash. Is there a way to output parquet data from logstash.?

warkolm · March 28, 2016, 9:08pm

Dunno if this would work, the CSV output doesn't let you define a delimiter. There may be another way to do it though with the ruby filter.

sdaruna · March 28, 2016, 9:12pm

does CSV output plugin will provide parquet data.? how.? is there any ruby filter that is known to convert the data to parquet.?

magnusbaeck · March 29, 2016, 5:31am

I don't think anyone has written a Parquet codec yet, no.