Response indexing using JAVA API


(kikuchan) #1

Hi, Guys.
We are using response JAVA API
We posted 50,000 line on Elasticsearch via Java API.
We are seeing Transport error some times.

We get following error some times.

org.elasticsearch.client.transport.NoNodeAvailableException: None of the configured nodes are available: []
at org.elasticsearch.client.transport.TransportClientNodesService.ensureNodesAreAvailable(TransportClientNodesService.java:305)
at org.elasticsearch.client.transport.TransportClientNodesService.execute(TransportClientNodesService.java:200)
at org.elasticsearch.client.transport.support.InternalTransportClient.execute(InternalTransportClient.java:106)
at org.elasticsearch.client.support.AbstractClient.index(AbstractClient.java:102)
at org.elasticsearch.client.transport.TransportClient.index(TransportClient.java:340)
at org.elasticsearch.action.index.IndexRequestBuilder.doExecute(IndexRequestBuilder.java:266)
at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:91)
at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:65)
at sample1.ESsample.response_Index(ESsample.java:191)
at sample1.Es_test.main(Es_test.java:732)

Why I got this error?
I assumed that this error occurred after excessive posting of indexing data.
This error rarely occurred after memory extension.

but then, I finished pushing all data on Elasticsearch via JAVA API.
following error ocured.

java.sql.SQLRecoverableException: KFPA11723-E Communication error occurred, reason=NETWORK[PrdbConnection.commit][HiRDB_CONNECTION_ID(fes:4316:12188)]
at JP.co.Hitachi.soft.HiRDB.JDBC.CltConnect.commit(CltConnect.java:1147)
at JP.co.Hitachi.soft.HiRDB.JDBC.PrdbConnection.commit(PrdbConnection.java:2782)
at JP.co.Hitachi.soft.HiRDB.JDBC.PrdbConnection.autocommit(PrdbConnection.java:4923)
at JP.co.Hitachi.soft.HiRDB.JDBC.PrdbResultSet.close(PrdbResultSet.java:393)
at JP.co.Hitachi.soft.HiRDB.JDBC.PrdbStatement.closeResultSet(PrdbStatement.java:3137)
at JP.co.Hitachi.soft.HiRDB.JDBC.PrdbStatement.close(PrdbStatement.java:689)
at sample1.hirdb_connect.close(hirdb_connect.java:56)
at sample1.Es_test.main(Es_test.java:738)

Why I got this error?
I assumed that this error occurred early close connection while posting date on Elasticsearch.
How can I posted all date on Elasticsearch without above error.

sincerely.


(Jörg Prante) #2

Yes, your cluster disconnected, mostly because it can not respond within 5 seconds. A larger cluster can handle your data better or you should reconsider if sending 50.000 lines at one is a good ides. If you send smaller amount and give the cluster time, it will work much better.

This is not the right forum to discuss SQL messages.

The message is a SQLRecoverableException so you can repeat the close action until it succeeds.


(system) #3