BULK Indexing using JAVA API


(Rohit) #1

Guys, We are working on a POC for indexing 10 million plus document and also a delta update which might have 2-3 milliion data updates. We are seeing connection reset error between client and cluster and some times we get error like, No port available to accept.


(Adrien Grand) #2

Are you using the node or transport client? Can you be more specific about the error that you are getting?


(Rohit) #3

HI Adrien ,

I'm using TransportClient. I have 3 clients , 3 Master and 2 Data nodes. Basically 2 shard and 1 replica.
Using Spring batch to fetch 100 records using JDBCpaging to call bulk api to update existing data. Below is the error while calling delta update.

[Jeanne-Marie Beaubier] exception caught on transport layer [[id: 0x8a83ae52]], closing connection
java.net.BindException: Cannot assign requested address
at sun.nio.ch.Net.connect0(Native Method)

[Helio] exception caught on transport layer [[id: 0x84378b3f]], closing connection
java.net.BindException: Cannot assign requested address
at sun.nio.ch.Net.connect0(Native Method)
at sun.nio.ch.Net.connect(Net.java:458)
at sun.nio.ch.Net.connect(Net.java:450)
at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:648)


(Adrien Grand) #4

Sorry I'm not very familiar with this, but found this stackoverflow post that gives potential reasons for this error. Maybe this can help you find the cause of your problem?


(Rohit) #5

Thanks.Will check it out..


(system) #6