what is the best design approach to load data from large parquet files of 500M records to ES.

Just use Logstash with the CSV filter.

Load data from parquet to elastic search

RSree (Remya Sreelal) October 20, 2016, 5:08am 3

Thank you . Is there any ideal design / configuartion consideration to get maximum performance gain

Topic		Replies	Views
How to load data from large parquet files of 500M records to ES using logstash Logstash	4	4168	January 30, 2019
Spark write parquet record to elasticsearch too slowly Elasticsearch es-hadoop	4	1948	July 6, 2017
How to ingest Parquet files into Elasticsearch Elasticsearch es-hadoop	1	7321	March 7, 2019
How to load 2 Million record of CSV file's data to Elasticsearch in CentosOs 7? Elasticsearch	7	2423	July 6, 2017
Staging Data for Elasticsearch bulk loading Elasticsearch es-hadoop	2	1763	July 6, 2017