Improve logstash performance

Hi All,

We are using logstash for full data load from Azure SQL to Elasticsearch & that takes too much time. Currently its taking 12 hours to insert 16 million records(using Default configuration of logstash).

I have changed -Xms and -Xmx value in jvm.options file and pipeline.batch.size & pipeline.workers in logstash.yml file as per diff recommendations but no luck. So can anyone please help here how to minimize the full data ingestion time, Thanks.

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.