I have an environment set up running ElasticSearch 0.90.2 with two master
nodes (each on their own server) and 8 data nodes (two nodes on 4 servers):
- master 1 - 4 vcpus, 32 GB RAM
- master 2 - 8 vcpus, 16 GB RAM
- data 1 - 4 each have 4 vcpus and 32 GB RAM
Initially, I was using a BulkRequestBuilder api to load json files to ES
but was having problems with the process hanging. So to isolate the
problem, I found the largest file (438MB) and attempted to upload via the
command line using curl. This also hung, so I tried the next largest file
that I had which was 183MB and curl was able to post this file without any
problems and only took about 12 minutes to complete.
The 453MB json file that I'm having trouble with contains binary data (the
183MB file also had binary data) and the curl command I am using:
@largebinaryfile.json > status.log
and after more than an hour, the progress meter shows:
% Total % Received % Xferd Average Speed Time
Dload Upload Total Current Left
0 437M 0 0 0 0 0 0 --:--:-- --:--:-- --:--:--
0< HTTP/1.1 100 Continue } [data not shown]
100 437M 0 0 100 437M 0 83466 1:31:41 1:31:41 --:--:--
I've let this process run for more than 5 hours but it never completes and
never errors. Any ideas why ES is hanging?
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to email@example.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/ac2d0500-8540-48ce-b0a2-23628ab01b0e%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.