I am using S3 repository plugin to take snapshot of my ES Cluster to S3.
I have TB's of data on S3 ( roughly 5TB ) , I want to convert these snapshots to parquet files.
Is it possible to do so ?
Is it possible to configure ES itself, so that the snapshots are stored in parquet files format ?
No it's not.
Is it possible to convert these snapshots to parquet files ?
No.
But you can call the scroll API and get all the documents and do whatever needed transformation.
May be with logstash?
Thank you