Hi All,
We are using logstash for full data load from Azure SQL to Elasticsearch & that takes too much time. Currently its taking 12 hours to insert 16 million records(using Default configuration of logstash).
I have changed -Xms and -Xmx value in jvm.options file and pipeline.batch.size & pipeline.workers in logstash.yml file as per diff recommendations but no luck. So can anyone please help here how to minimize the full data ingestion time, Thanks.