How load big data from database using Logstash in elasticsearch index?

I want to learn how to load big data from database to elasticsearch using logstash jdbc input plugin. I could not find my answer from other forums.
I have 1billion data in databse. Logstash settings has 8 workers, 15000 batch size.

  • Does logstash gets all data from database and close connection, and sends 15000 part by order? Or connection does not close until all data send to elasticsearch.

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.