I started to index aprox. 1.000.000 json files into elastic seach using logstash.
The logstash config contains some lowercase, renaming operations and if-else statements.
I`m trying to index the data using 16 threads and batch size = 256.
The problem is that if I look in Kibana, at Index Management, I can`t see the index created yet and the logstas is running since 3 hours ago
From what I know, logstash should start the documents indexing after finnishing each batch. Is my understanding wrong?
Also, I tried with about 30k documents and everything was fine.
I want to know if something is wrong with my conf file/elastic search instance or it`s just normal to take that much.