..request retries exceeded max retry timeout [30000]

[juanaramis]

Hi team,

I'm receiving this error:

org.elasticsearch.common.util.concurrent.UncategorizedExecutionException: Failed execution
at org.elasticsearch.action.support.AdapterActionFuture.rethrowExecutionException(AdapterActionFuture.java:93)
at org.elasticsearch.action.support.AdapterActionFuture.actionGet(AdapterActionFuture.java:47)
at org.elasticsearch.action.bulk.Retry.withSyncBackoff(Retry.java:104)
at org.elasticsearch.action.bulk.BulkRequestHandler$SyncBulkRequestHandler.execute(BulkRequestHandler.java:86)
at org.elasticsearch.action.bulk.BulkProcessor.execute(BulkProcessor.java:350)
at org.elasticsearch.action.bulk.BulkProcessor.executeIfNeeded(BulkProcessor.java:341)
at org.elasticsearch.action.bulk.BulkProcessor.internalAdd(BulkProcessor.java:276)
at org.elasticsearch.action.bulk.BulkProcessor.add(BulkProcessor.java:259)
at org.elasticsearch.action.bulk.BulkProcessor.add(BulkProcessor.java:255)
at com.ms.esm.eva.tools.ElasticSearchUtil.addToBulk(ElasticSearchUtil.java:205)
at com.ms.esm.eva.tools.ElasticSearchUtil.lambda$sent$1(ElasticSearchUtil.java:144)
at java.util.concurrent.ConcurrentHashMap$ValueSpliterator.forEachRemaining(ConcurrentHashMap.java:3566)
at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:580)
at com.ms.esm.eva.tools.ElasticSearchUtil.sent(ElasticSearchUtil.java:144)
at com.ms.esm.thebus.metrics.Aggregator.storeInElasticsearch(Aggregator.java:154)
at com.ms.esm.thebus.metrics.Aggregator.main(Aggregator.java:93)
Caused by: java.util.concurrent.ExecutionException: java.io.IOException: request retries exceeded max retry timeout [30000]
at org.elasticsearch.common.util.concurrent.BaseFuture$Sync.getValue(BaseFuture.java:262)
at org.elasticsearch.common.util.concurrent.BaseFuture$Sync.get(BaseFuture.java:249)
at org.elasticsearch.common.util.concurrent.BaseFuture.get(BaseFuture.java:91)
at org.elasticsearch.action.support.AdapterActionFuture.actionGet(AdapterActionFuture.java:42)
... 14 common frames omitted
Caused by: java.io.IOException: request retries exceeded max retry timeout [30000]

using BulkProcessor with High-Level REST Client..:

  try(BulkProcessor bulkProcessor = new BulkProcessor.Builder(rHLClient::bulkAsync,
                                                                listener,
                                                                new ThreadPool(Settings.builder().put(Node.NODE_NAME_SETTING.getKey(), "high-level-client").build()))
                                                                .setConcurrentRequests(0)
                                                                .setBulkSize(new ByteSizeValue(20, ByteSizeUnit.MB))
                                                                .setBulkActions(500)
                                                                .build()

Any help on this please?

Thanks

J.

[steffens (Steffen Siering)]

In which way is this related to beats? Did you mean to ask this question in the Elasticseach Clients forum?

[juanaramis]

Sorry if this is not the right place.

I was running out of resource in the cluster so it took more time to process my bulk. I just added more cpu and memory and it's working well now.

Thanks