# Xpack.monitoring ExportException: failed to flush export bulks

**URL:** <https://discuss.elastic.co/t/xpack-monitoring-exportexception-failed-to-flush-export-bulks/174064>\
**Category:** Elasticsearch\
**Tags:** elastic-stack-monitoring\
**Created:** [March 27, 2019, 8:40am UTC](https://discuss.elastic.co/t/xpack-monitoring-exportexception-failed-to-flush-export-bulks/174064 "2019-03-27T08:40:01Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Michake](https://avatars.discourse-cdn.com/v4/letter/m/65b543/32.png) [@Michake](https://discuss.elastic.co/u/Michake)\
**Post date:** [March 27, 2019, 8:40am UTC](https://discuss.elastic.co/t/xpack-monitoring-exportexception-failed-to-flush-export-bulks/174064/1 "2019-03-27T08:40:02Z")

</div>

Hi team

```
 We have multiple clusters that export monitoring data to a remote cluster.

```

All nodes were reporting timeouts when connecting to the monitoring cluster, some of the nodes with hight CPU uage(close to 100%), the memory is normal, nothing changed.

```
I want to find the root cause, could you help me, thanks!

```

Node logs:  
[2019-03-27T09:04:18,070][WARN][o.e.x.m.e.h.NodeFailureListener] connection failed to node at [[http://X.X.X.X:9200](http://X.X.X.X:9200)]  
[2019-03-27T09:04:18,077][WARN][o.e.x.m.e.h.HttpExportBulkResponseListener] bulk request failed unexpectedly  
java.io.IOException: request retries exceeded max retry timeout [30000]  
at org.elasticsearch.client.RestClient$1.retryIfPossible(RestClient.java:574) [elasticsearch-rest-client-6.4.0.jar:6.4.0]  
at org.elasticsearch.client.RestClient$1.failed(RestClient.java:561) [elasticsearch-rest-client-6.4.0.jar:6.4.0]  
at org.apache.http.concurrent.BasicFuture.failed(BasicFuture.java:134) [httpcore-4.4.5.jar:4.4.5]  
at org.apache.http.impl.nio.client.AbstractClientExchangeHandler.failed(AbstractClientExchangeHandler.java:419) [httpasyncclient-4.1.2.jar:4.1.2]  
at org.apache.http.nio.protocol.HttpAsyncRequestExecutor.timeout(HttpAsyncRequestExecutor.java:375) [httpcore-nio-4.4.5.jar:4.4.5]  
at org.apache.http.impl.nio.client.InternalIODispatch.onTimeout(InternalIODispatch.java:92) [httpasyncclient-4.1.2.jar:4.1.2]  
at org.apache.http.impl.nio.client.InternalIODispatch.onTimeout(InternalIODispatch.java:39) [httpasyncclient-4.1.2.jar:4.1.2]  
at org.apache.http.impl.nio.reactor.AbstractIODispatch.timeout(AbstractIODispatch.java:175) [httpcore-nio-4.4.5.jar:4.4.5]  
at org.apache.http.impl.nio.reactor.BaseIOReactor.sessionTimedOut(BaseIOReactor.java:263) [httpcore-nio-4.4.5.jar:4.4.5]  
at org.apache.http.impl.nio.reactor.AbstractIOReactor.timeoutCheck(AbstractIOReactor.java:492) [httpcore-nio-4.4.5.jar:4.4.5]  
at org.apache.http.impl.nio.reactor.BaseIOReactor.validate(BaseIOReactor.java:213) [httpcore-nio-4.4.5.jar:4.4.5]  
at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:280) [httpcore-nio-4.4.5.jar:4.4.5]  
at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104) [httpcore-nio-4.4.5.jar:4.4.5]  
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:588) [httpcore-nio-4.4.5.jar:4.4.5]  
at java.lang.Thread.run(Thread.java:748) [?:1.8.0\_131]  
[2019-03-27T09:04:18,080][WARN][o.e.x.m.MonitoringService] [node-5] monitoring execution failed  
org.elasticsearch.xpack.monitoring.exporter.ExportException: Exception when closing export bulk  
at org.elasticsearch.xpack.monitoring.exporter.ExportBulk$1$1.(ExportBulk.java:95) ~[?:?]  
at org.elasticsearch.xpack.monitoring.exporter.ExportBulk$1.onFailure(ExportBulk.java:93) ~[?:?]  
at org.elasticsearch.xpack.monitoring.exporter.ExportBulk$Compound$1.onResponse(ExportBulk.java:206) ~[?:?]  
at org.elasticsearch.xpack.monitoring.exporter.ExportBulk$Compound$1.onResponse(ExportBulk.java:200) ~[?:?]  
at org.elasticsearch.xpack.core.common.IteratingActionListener.onResponse(IteratingActionListener.java:96) ~[?:?]  
at org.elasticsearch.xpack.monitoring.exporter.ExportBulk$Compound.lambda$doFlush$0(ExportBulk.java:164) ~[?:?]  
at org.elasticsearch.action.ActionListener$1.onFailure(ActionListener.java:68) [elasticsearch-6.4.0.jar:6.4.0]  
at org.elasticsearch.xpack.monitoring.exporter.http.HttpExportBulk$1.onFailure(HttpExportBulk.java:114) [x-pack-monitoring-6.4.0.jar:6.4.0]  
at org.elasticsearch.client.RestClient$FailureTrackingResponseListener.onDefinitiveFailure(RestClient.java:844) [elasticsearch-rest-client-6.4.0.jar:6.4.0]  
at org.elasticsearch.client.RestClient$1.retryIfPossible(RestClient.java:575) [elasticsearch-rest-client-6.4.0.jar:6.4.0]  
at org.elasticsearch.client.RestClient$1.failed(RestClient.java:561) [elasticsearch-rest-client-6.4.0.jar:6.4.0]  
at org.apache.http.concurrent.BasicFuture.failed(BasicFuture.java:134) [httpcore-4.4.5.jar:4.4.5]  
at org.apache.http.impl.nio.client.AbstractClientExchangeHandler.failed(AbstractClientExchangeHandler.java:419) [httpasyncclient-4.1.2.jar:4.1.2]  
at org.apache.http.nio.protocol.HttpAsyncRequestExecutor.timeout(HttpAsyncRequestExecutor.java:375) [httpcore-nio-4.4.5.jar:4.4.5]  
at org.apache.http.impl.nio.client.InternalIODispatch.onTimeout(InternalIODispatch.java:92) [httpasyncclient-4.1.2.jar:4.1.2]  
at org.apache.http.impl.nio.client.InternalIODispatch.onTimeout(InternalIODispatch.java:39) [httpasyncclient-4.1.2.jar:4.1.2]  
at org.apache.http.impl.nio.reactor.AbstractIODispatch.timeout(AbstractIODispatch.java:175) [httpcore-nio-4.4.5.jar:4.4.5]  
at org.apache.http.impl.nio.reactor.BaseIOReactor.sessionTimedOut(BaseIOReactor.java:263) [httpcore-nio-4.4.5.jar:4.4.5]  
at org.apache.http.impl.nio.reactor.AbstractIOReactor.timeoutCheck(AbstractIOReactor.java:492) [httpcore-nio-4.4.5.jar:4.4.5]  
at org.apache.http.impl.nio.reactor.BaseIOReactor.validate(BaseIOReactor.java:213) [httpcore-nio-4.4.5.jar:4.4.5]  
at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:280) [httpcore-nio-4.4.5.jar:4.4.5]  
at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104) [httpcore-nio-4.4.5.jar:4.4.5]  
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:588) [httpcore-nio-4.4.5.jar:4.4.5]  
at java.lang.Thread.run(Thread.java:748) [?:1.8.0\_131]  
Caused by: org.elasticsearch.xpack.monitoring.exporter.ExportException: failed to flush export bulks  
at org.elasticsearch.xpack.monitoring.exporter.ExportBulk$Compound.lambda$doFlush$0(ExportBulk.java:156) ~[?:?]  
... 18 more  
Caused by: java.io.IOException: request retries exceeded max retry timeout [30000]  
at org.elasticsearch.client.RestClient$1.retryIfPossible(RestClient.java:574) ~[?:?]  
... 14 more

Monitor cluster logs:  
[2019-03-27T09:08:29,062][ERROR][o.e.x.m.c.n.NodeStatsCollector] [node-2] collector [node\_stats] timed out when collecting data

---

<div class="post-metadata">

**Author:** ![Mike\_Place](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mike_place/32/39555_2.png) [@Mike\_Place](https://discuss.elastic.co/u/Mike_Place)\
**Post date:** [March 27, 2019, 2:37pm UTC](https://discuss.elastic.co/t/xpack-monitoring-exportexception-failed-to-flush-export-bulks/174064/2 "2019-03-27T14:37:51Z")

</div>

> [@Michake](#):
>
> failed to flush export bulks

Do you know anything more about the state of the monitoring cluster at the time this occurred? This looks like the monitoring cluster stopped responding but there isn't enough information here to really understand why that might have occurred.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [April 24, 2019, 2:37pm UTC](https://discuss.elastic.co/t/xpack-monitoring-exportexception-failed-to-flush-export-bulks/174064/3 "2019-04-24T14:37:53Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
