I want to learn how to load big data from database to elasticsearch using logstash jdbc input plugin. I could not find my answer from other forums.
I have 1billion data in databse. Logstash settings has 8 workers, 15000 batch size.
- Does logstash gets all data from database and close connection, and sends 15000 part by order? Or connection does not close until all data send to elasticsearch.