So I'm currently running a 6.2 instance of Elasticsearch on a docker container using the official image. (Our CTO did the configuration so I don't have all the info)
I'm trying to bulk index documents but it always ends up in a bad Gateway.
There are 1357 documents to index. The total size of the JSON is around 12MB.
I tried to bulk index documents per 250 to keep the JSON size reasonable (2.4MB) and the bulk indexation crashes and returns "Bad Gateway" at the third bulk request. I tried to reduce the bulk size to 50 and it got worse. It now crashes at the second bulk request.
I thought it was an issue with the refresh_interval so I set it up to -1 to disable it. I also set number_of_replicas to 0 just for the test. It ends up in the same "Bad Gateway".
I went inside the docker container and ran htop to see what's going on. The memory is just fine but the CPU skyrockets to 100% and then the container crashes.
Honestly I'm clueless here. I've go no idea what's going on as I use Elasticsearch (who doesn't? ) but I don't usually configure it.
I hope I provided all necessary information, don't hesitate to ask more if this is not the case.
Thanks for your help!