Elasticsearch : cannot bulk index file larger than 6mb

Elastic Stack Elasticsearch
1

I want to index a contents of a file whose size is 20mb, but everytime I try to bulk import

rest - curl: (56) Recv failure: Connection was reset
but if I split the file into smaller files like 5-6mb I can index without any error.I am really confused if this is a server problem or elasticsearch problem I have http.max_content_length: 500mb so, it shouldnot be a problem to index just 20mb. Here's the code

curl -XPUT '<server-ip>:9200/bigmart/halfyear/_bulk' -H 'Content-Type: application/x-ndjson' --data-binary @week-1.json
my java_heap is set to 2gb . Previously on other server I had faced similar problem. In that case I could easily index 70mb file but I couldnot index >100mb even though http.max_content_length: 500mb. So i chunked large files into 70mb file and indexed, but on this server I couldnot even index 20mb file. I am seriously confused.

2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.