Bulk insert from file, SSL record too big

Elastic Search
1

Hello all,
I am trying to following along with an acloud.guru ES deep dive and there is a section that you bulk insert ndjson files.

I also tried the curl examples from elasic.co

I receive the follow from curl:


* About to connect() to localhost port 9200 (#0)
*   Trying ::1...
* Connected to localhost (::1) port 9200 (#0)
* Initializing NSS with certpath: sql:/etc/pki/nssdb
* NSS error -12263 (SSL_ERROR_RX_RECORD_TOO_LONG)
* SSL received a record that exceeded the maximum permissible length.
* Closing connection 0
curl: (35) SSL received a record that exceeded the maximum permissible length.

I moved the heap to 4gb and ran it on a data only node to rule out any memory issues with the master node and still the same error.

Any suggestions? Is this a curl issue maybe?
Thanks in advance for help

2

Hey,

Could you share how you're starting elasticsearch locally and your curl example please?

3

In a 3 node cluster and running curl from the nodes to localhost. Here is the curl command:

curl -u elastic --insecure -H 'Content-Type: application/x-ndjson' -X POST https://localhost:9200/bank/_bulk --data-binary @accounts.json -v

4

Can you perform a normal curl request to elasticsearch? Just to double check its not to do with the SSL cert here.

5

yes normal curls work including creating indicies so POST, PUT, and GET all working it is only when I try to do a bulk insert. I also tried to do a bullk with only a few records and I even shortened the records. I also tried the elastic.co example that was a small record and count of records.

6

could you try with a single node example and worth following our documentation to start this node. I get the feeling theres something up with the communication between the nodes as it propagates the change across nodes.

7

Any update on this @Terry_Lowery ?

8

No update. I am manly focused on a cluster

9

Are you still facing issues with SSL or is it something else?

10

Is your Elasticsearch running with SSL enabled?

What if you post to http:// instead of https://?

11

Only SSL is enabled http is not allowed. All calls and verbs work except for doing a bulk insert from file. I can preform any actions except this one.

12

I see.

What is the size of the file?

Have you tried breaking the file into halves and try to ingest them separately?

The error is confusing to me - it does not feel directly related to Elasticsearch

13

Yeah I even broke the record down to something smaller and removed a lot of the fields, I also tried using the ES examples on bulk and it didn't work. I was also leaning towards maybe it is a curl issue.

14

Interesting..

You can try debugging it by sending bulk requests from different clients: CURL, Postman, maybe a small python script.

When you send the payload, do you see anything interesting in Elasticsearch logs? You might need to enable debug logs for it.