Could not index '1' records: listener timeout after waiting for [30000] ms in Single node

Getting below ERROR in the single node ELK.

Configuration of elasticsearch.yml

cluster.name: ******-elasticsearch
node.name: ******Elastic-1
path.data: /data00/*****Elastic/data
path.logs: /data00/*****Elastic/log
network.host: 0.0.0.0
http.port: 9200
errorCode:ELASTICSEARCH_17
errorMessage:ELASTICSEARCH_17 - Could not index '1' records: listener timeout after waiting for [30000] ms
errorTimestamp:Dec 28, 2020 8:34:14 PM
errorStackTrace:com.streamsets.pipeline.api.StageException: ELASTICSEARCH_17 - Could not index '1' records: listener timeout after waiting for [30000] ms at com.streamsets.pipeline.stage.destination.elasticsearch.ElasticsearchTarget.write(ElasticsearchTarget.java:408) at com.streamsets.pipeline.api.base.configurablestage.DTarget.write(DTarget.java:34) at com.streamsets.datacollector.runner.StageRuntime.lambda$execute$2(StageRuntime.java:303) at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:244) at
com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:311) at 
com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:221) at 
com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:864) at 
com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.lambda$executeRunner$3(ProductionPipelineRunner.java:908) at com.streamsets.datacollector.runner.PipeRunner.acceptConsumer(PipeRunner.java:207) at com.streamsets.datacollector.runner.PipeRunner.forEachInternal(PipeRunner.java:152) at com.streamsets.datacollector.runner.PipeRunner.executeBatch(PipeRunner.java:132) at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.executeRunner(ProductionPipelineRunner.java:907) at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runSourceLessBatch(ProductionPipelineRunner.java:885) at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runPollSource(ProductionPipelineRunner.java:609) at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.run(ProductionPipelineRunner.java:400) at com.streamsets.datacollector.runner.Pipeline.run(Pipeline.java:535) at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:112) at 
com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:75) at 
com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.startInternal(StandaloneRunner.java:762) at 
com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.start(StandaloneRunner.java:755) at 
com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$start$3(AsyncRunner.java:157) at 
com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) at 
com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:34) at 
com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) at 
com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) at 
com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:34) at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) at 
java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100) at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at 
java.lang.Thread.run(Thread.java:748) Caused by: java.io.IOException: listener timeout after waiting for [30000] ms at 
org.elasticsearch.client.RestClient$SyncResponseListener.get(RestClient.java:660) at 
org.elasticsearch.client.RestClient.performRequest(RestClient.java:219) at 
org.elasticsearch.client.RestClient.performRequest(RestClient.java:191) at 
com.streamsets.pipeline.lib.elasticsearch.ElasticsearchStageDelegate.performRequest(ElasticsearchStageDelegate.java:582) at 
com.streamsets.pipeline.stage.destination.elasticsearch.ElasticsearchTarget.write(ElasticsearchTarget.java:370) ... 33 more 
kadmin.local -q 'addprinc -randkey krbtgt/OTHER-REALM.TEST@EXAMPLE.COM' -x ipa-setup-override-restrictions
kadmin.local -q 'ktadd -k /tmp/realm.keytab krbtgt/OTHER-REALM.TEST@EXAMPLE.COM' -x ipa-setup-override-restrictions
klist -ket /tmp/realm.keytab

Does that happen every time or just occasionally? Does it happen more often if the node is idle for a while first?

it is happening everytime for spark and for streamsets randomly it is coming

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.