# CircuitBreakingException when load huge data by bulk write

**URL:** https://discuss.elastic.co/t/circuitbreakingexception-when-load-huge-data-by-bulk-write/343410
**Category:** Elasticsearch
**Created:** [September 20, 2023, 2:36am UTC](https://discuss.elastic.co/t/circuitbreakingexception-when-load-huge-data-by-bulk-write/343410 "2023-09-20T02:36:21Z")
**Posts on this page:** 3
**Page:** 1

<div class="post-metadata">

### Author: ![ericsoul](https://avatars.discourse-cdn.com/v4/letter/e/eb9ed0/32.png) [@ericsoul](https://discuss.elastic.co/u/ericsoul)
#### Post date: [September 20, 2023, 2:36am UTC](https://discuss.elastic.co/t/circuitbreakingexception-when-load-huge-data-by-bulk-write/343410/1 "2023-09-20T02:36:21Z")

</div>

I got many errors like

```shell
Caused by: org.elasticsearch.common.breaker.CircuitBreakingException: [parent] Data too large, 
data for [indices:data/write/bulk[s]] would be [30897445494/28.7gb], which is larger than 
the limit of [30601641984/28.5gb], real usage: [30897441128/28.7gb], new bytes reserved: 
[4366/4.2kb], usages [request=311296/304kb, fielddata=70419/68.7kb, 
in_flight_requests=1006536/982.9kb, model_inference=0/0b, accounting=342409182/326.5mb]

```

,when loading huge data to 78 primary shards on 25 nodes in about 3 hours.  
The index has about 73,000,000 docs and 20,000,000 docs.deleted, primary shards total size is 200GB, every node has 256GB memory.

es version: 7.12

I deploy a crontab to record `_cat/nodes`. It's strange that, headCurrents are about 20GB, some ramPercent is 100 when the error is happenned.

---

<div class="post-metadata">

### Author: ![ericsoul](https://avatars.discourse-cdn.com/v4/letter/e/eb9ed0/32.png) [@ericsoul](https://discuss.elastic.co/u/ericsoul)
#### Post date: [September 27, 2023, 9:24am UTC](https://discuss.elastic.co/t/circuitbreakingexception-when-load-huge-data-by-bulk-write/343410/2 "2023-09-27T09:24:18Z")

</div>

Is there anyone who can help this?

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [October 25, 2023, 9:24am UTC](https://discuss.elastic.co/t/circuitbreakingexception-when-load-huge-data-by-bulk-write/343410/3 "2023-10-25T09:24:45Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.