Hi,
After many hours, my java application shows stacktraces about cluster monitor infos timed out. I'm not sure why this is happening but my java application is running on the same server that hosts the Elasticsearch service.
Here's the stacktrace:
2015-07-21 07:34:46.433 [elasticsearch[Debra Whitman][generic][T#2]] INFO org.elasticsearch.client.transport - [Debra Whitman] failed to get node info for [#transport#-1][ELK01][inet[localhost/127.0.0.1:9300]], disconnecting...
org.elasticsearch.transport.ReceiveTimeoutTransportException: [][inet[localhost/127.0.0.1:9300]][cluster:monitor/nodes/info] request_id [82843309] timed out after [5000ms]
at org.elasticsearch.transport.TransportService$TimeoutHandler.run(TransportService.java:529) ~[Plateforme_Logs.jar:na]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_45]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_45]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_45]
2015-07-21 07:34:46.509 [f12af5d9-a865-4954-ad8d-f49536a5e88e_Worker-4] ERROR n.s.i.l.s.listeners.JobListener - Exception on job "ParseJobs.thread-0-3": org.quartz.SchedulerException: Job threw an unhandled exception. [See nested exception: org.elasticsearch.client.transport.NoNodeAvailableException: None of the configured nodes are available: []]
org.quartz.JobExecutionException: org.quartz.SchedulerException: Job threw an unhandled exception. [See nested exception: org.elasticsearch.client.transport.NoNodeAvailableException: None of the configured nodes are available: []]
at org.quartz.core.JobRunShell.run(JobRunShell.java:218) ~[Plateforme_Logs.jar:na]
at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:573) [Plateforme_Logs.jar:na]
Caused by: org.quartz.SchedulerException: Job threw an unhandled exception.
at org.quartz.core.JobRunShell.run(JobRunShell.java:213) ~[Plateforme_Logs.jar:na]
... 1 common frames omitted
Caused by: org.elasticsearch.client.transport.NoNodeAvailableException: None of the configured nodes are available: []
at org.elasticsearch.client.transport.TransportClientNodesService.ensureNodesAreAvailable(TransportClientNodesService.java:305) ~[Plateforme_Logs.jar:na]
at org.elasticsearch.client.transport.TransportClientNodesService.execute(TransportClientNodesService.java:200) ~[Plateforme_Logs.jar:na]
at org.elasticsearch.client.transport.support.InternalTransportClient.execute(InternalTransportClient.java:106) ~[Plateforme_Logs.jar:na]
at org.elasticsearch.client.transport.TransportClient.execute(TransportClient.java:330) ~[Plateforme_Logs.jar:na]
at org.elasticsearch.client.support.AbstractClient.clearScroll(AbstractClient.java:518) ~[Plateforme_Logs.jar:na]
at org.elasticsearch.action.search.ClearScrollRequestBuilder.doExecute(ClearScrollRequestBuilder.java:48) ~[Plateforme_Logs.jar:na]
at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:91) ~[Plateforme_Logs.jar:na]
at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:65) ~[Plateforme_Logs.jar:na]
at com.davmrtl.logs.parsers.Parser.parse(Parser.java:325) ~[Plateforme_Logs.jar:na]
at com.davmrtl.logs.jobs.worker.ParseJob.execute(ParseJob.java:81) ~[Plateforme_Logs.jar:na]
at org.quartz.core.JobRunShell.run(JobRunShell.java:202) ~[Plateforme_Logs.jar:na]
... 1 common frames omitted
2015-07-21 07:34:46.509 [f12af5d9-a865-4954-ad8d-f49536a5e88e_Worker-3] ERROR n.s.i.l.s.listeners.JobListener - Exception on job "ParseJobs.thread-0-2": org.quartz.SchedulerException: Job threw an unhandled exception. [See nested exception: org.elasticsearch.client.transport.NoNodeAvailableException: None of the configured nodes are available: []]
org.quartz.JobExecutionException: org.quartz.SchedulerException: Job threw an unhandled exception. [See nested exception: org.elasticsearch.client.transport.NoNodeAvailableException: None of the configured nodes are available: []]
at org.quartz.core.JobRunShell.run(JobRunShell.java:218) ~[Plateforme_Logs.jar:na]
at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:573) [Plateforme_Logs.jar:na]
Caused by: org.quartz.SchedulerException: Job threw an unhandled exception.
at org.quartz.core.JobRunShell.run(JobRunShell.java:213) ~[Plateforme_Logs.jar:na]
... 1 common frames omitted
Caused by: org.elasticsearch.client.transport.NoNodeAvailableException: None of the configured nodes are available: []
at org.elasticsearch.client.transport.TransportClientNodesService.ensureNodesAreAvailable(TransportClientNodesService.java:305) ~[Plateforme_Logs.jar:na]
at org.elasticsearch.client.transport.TransportClientNodesService.execute(TransportClientNodesService.java:200) ~[Plateforme_Logs.jar:na]
at org.elasticsearch.client.transport.support.InternalTransportClient.execute(InternalTransportClient.java:106) ~[Plateforme_Logs.jar:na]
at org.elasticsearch.client.support.AbstractClient.search(AbstractClient.java:338) ~[Plateforme_Logs.jar:na]
at org.elasticsearch.client.transport.TransportClient.search(TransportClient.java:430) ~[Plateforme_Logs.jar:na]
at org.elasticsearch.action.search.SearchRequestBuilder.doExecute(SearchRequestBuilder.java:1112) ~[Plateforme_Logs.jar:na]
at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:91) ~[Plateforme_Logs.jar:na]
at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:65) ~[Plateforme_Logs.jar:na]
at com.davmrtl.logs.parsers.Parser.parse(Parser.java:182) ~[Plateforme_Logs.jar:na]
at com.davmrtl.logs.jobs.worker.ParseJob.execute(ParseJob.java:81) ~[Plateforme_Logs.jar:na]
at org.quartz.core.JobRunShell.run(JobRunShell.java:202) ~[Plateforme_Logs.jar:na]
... 1 common frames omitted
I got this problem on Elasticsearch server/client 1.5.0 and 1.6.0, but I'm currently testing on both server/client 1.7.0.
Thanks,
David