# Cluster Error: data too large - marking and sending shards

**URL:** <https://discuss.elastic.co/t/cluster-error-data-too-large-marking-and-sending-shards/206663>\
**Category:** Elasticsearch\
**Created:** [November 5, 2019, 6:51pm UTC](https://discuss.elastic.co/t/cluster-error-data-too-large-marking-and-sending-shards/206663 "2019-11-05T18:51:22Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Jorge\_Rodrigo\_Bogado](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jorge_rodrigo_bogado/32/47984_2.png) [@Jorge\_Rodrigo\_Bogado](https://discuss.elastic.co/u/Jorge_Rodrigo_Bogado)\
**Post date:** [November 5, 2019, 6:51pm UTC](https://discuss.elastic.co/t/cluster-error-data-too-large-marking-and-sending-shards/206663/1 "2019-11-05T18:51:22Z")

</div>

Hi, i had a power issue and the cluster had been down for nearly 10 hours.

Now I have the following outputs:

[http://serverip:9200/\_cluster/health](http://serverip:9200/_cluster/health)

| cluster\_name | "cluster-name" |
| --- | --- |
| status | "yellow" |
| timed\_out | false |
| number\_of\_nodes | 13 |
| number\_of\_data\_nodes | 12 |
| active\_primary\_shards | 434 |
| active\_shards | 716 |
| relocating\_shards | 9 |
| initializing\_shards | 0 |
| unassigned\_shards | 152 |
| delayed\_unassigned\_shards | 0 |
| number\_of\_pending\_tasks | 70 |
| number\_of\_in\_flight\_fetch | 0 |
| task\_max\_waiting\_in\_queue\_millis | 167 |
| active\_shards\_percent\_as\_number | 82.48847926267281 |

Checking the logs, i have found these issues:

Caused by: org.elasticsearch.transport.RemoteTransportException: [hostname6][10.240.36.150:9300][internal:index/shard/recovery/start\_recovery]  
Caused by: org.elasticsearch.common.breaker.CircuitBreakingException: [parent] Data too large, data for [\<transport\_request\>] would be [4077609546/3.7gb], which is larger than the limit of [4013975142/3.7gb], real usage: [4077577728/3.7gb], new bytes reserved: [31818/31kb], usages [request=0/0b, fielddata=1626172697/1.5gb, in\_flight\_requests=32648/31.8kb, accounting=776288601/740.3mb]  
at org.elasticsearch.indices.breaker.HierarchyCircuitBreakerService.checkParentLimit(HierarchyCircuitBreakerService.java:342) ~[elasticsearch-7.3.2.jar:7.3.2]  
at org.elasticsearch.common.breaker.ChildMemoryCircuitBreaker.addEstimateBytesAndMaybeBreak(ChildMemoryCircuitBreaker.java:128) ~[elasticsearch-7.3.2.jar:7.3.2]

...

[2019-11-05T15:15:57,947][WARN][o.e.i.c.IndicesClusterStateService] [hostnameB01] [clustername\_metrics-raw\_2019.09.13][0] marking and sending shard failed due to [failed recovery]  
org.elasticsearch.indices.recovery.RecoveryFailedException: [clustername\_metrics-raw\_2019.09.13][0]: Recovery failed from {hostnameb6}{-TNL0xnsTpuWDzooT9bJtw}{D5PdSuGhQfy3ELk2a7\_DZg}{10.240.36.150}{10.240.36.150:9300}{di}{ml.machine\_memory=8356679680, ml.max\_open\_jobs=20, datacenter=b, xpack.installed=true} into {hostnameb1}{qOzCQhsPSD-MjRCyt8oSew}{gbiKUpwKS3iGxPtcRJFh8A}{10.240.36.145}{10.240.36.145:9300}{dim}{ml.machine\_memory=8356687872, xpack.installed=true, ml.max\_open\_jobs=20, datacenter=b}

Could you help me solving this?  
Thanks, Rodrigo.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [December 3, 2019, 6:51pm UTC](https://discuss.elastic.co/t/cluster-error-data-too-large-marking-and-sending-shards/206663/2 "2019-12-03T18:51:27Z")

</div>

Closed on December 3, 2019, 6:51pm UTC

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.