# In\_flight\_request is too large and throw \[circuit\_breaking\_exception\] \[parent\] Data too large

**URL:** <https://discuss.elastic.co/t/in-flight-request-is-too-large-and-throw-circuit-breaking-exception-parent-data-too-large/246482>\
**Category:** Elasticsearch\
**Created:** [August 26, 2020, 3:46pm UTC](https://discuss.elastic.co/t/in-flight-request-is-too-large-and-throw-circuit-breaking-exception-parent-data-too-large/246482 "2020-08-26T15:46:04Z")\
**Posts on this page:** 7\
**Page:** 2

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [August 27, 2020, 11:31am UTC](https://discuss.elastic.co/t/in-flight-request-is-too-large-and-throw-circuit-breaking-exception-parent-data-too-large/246482/22 "2020-08-27T11:31:52Z")

</div>

A 500GB gp2 volume only gets 1500 IOPS if I remember correctly. Given that these are the most I/O intensive nodes it seems a bit low. I would recommend using i3 instances with ephemeral storage for the hot tier if feasible.

---

<div class="post-metadata">

**Author:** ![greyhats13](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/greyhats13/32/72807_2.png) [@greyhats13](https://discuss.elastic.co/u/greyhats13)\
**Post date:** [August 27, 2020, 12:34pm UTC](https://discuss.elastic.co/t/in-flight-request-is-too-large-and-throw-circuit-breaking-exception-parent-data-too-large/246482/23 "2020-08-27T12:34:11Z")

</div>

> [@greyhats13](#):
>
> ally by adding new nodes solved this issues? because JVM max memory can't go beyond 32gb as su

So storages throughput really matters? I learned from webinar that data nodes need extremely high thoughput. For your information Christian, we are using elastic cloud kubernetes, so it is not possible to use i3 instance in Amazon EKS (managed kubernetes). My previous experienced was attached EBS IOPS SSD(io1) to data hot and elastic running seamlessly backthen. FYI at the integration to our microservices is still around 65% at the time. But the bussiness owner asked me to use GP SSD instead of IOPS SSD becuase the price is so costly.So you suggested that low IOPS in data nodes(I/O intensive) that is serious bottleneck that might lead to in\_flight\_request too large & circuit\_breaking\_exception in production environment?

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [August 27, 2020, 12:57pm UTC](https://discuss.elastic.co/t/in-flight-request-is-too-large-and-throw-circuit-breaking-exception-parent-data-too-large/246482/25 "2020-08-27T12:57:19Z")

</div>

As the IOPS of gp2 EBS volumes is proportional to the size you can increase IOPS by increasing the size of the volumes. It can be cheaper than PIOPS even if you do not end up actually using all that storage.

---

<div class="post-metadata">

**Author:** ![greyhats13](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/greyhats13/32/72807_2.png) [@greyhats13](https://discuss.elastic.co/u/greyhats13)\
**Post date:** [August 27, 2020, 1:24pm UTC](https://discuss.elastic.co/t/in-flight-request-is-too-large-and-throw-circuit-breaking-exception-parent-data-too-large/246482/26 "2020-08-27T13:24:45Z")

</div>

I see I can reduce data hot nodes to 100gb per each nodes using IOPS SSD, but will it solved the issues of circuit\_breaking\_exception? because I have to rebuild the elasticsearch to do that, restore the backup snapshot from S3. Btw, thank you for the insight Christian.

---

<div class="post-metadata">

**Author:** ![greyhats13](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/greyhats13/32/72807_2.png) [@greyhats13](https://discuss.elastic.co/u/greyhats13)\
**Post date:** [August 29, 2020, 10:20am UTC](https://discuss.elastic.co/t/in-flight-request-is-too-large-and-throw-circuit-breaking-exception-parent-data-too-large/246482/27 "2020-08-29T10:20:49Z")

</div>

changing the heap memory to 29gb is solved the issue. Our elastic no longer received circuit\_breaking\_exception for two days.

---

<div class="post-metadata">

**Author:** ![greyhats13](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/greyhats13/32/72807_2.png) [@greyhats13](https://discuss.elastic.co/u/greyhats13)\
**Post date:** [September 1, 2020, 10:21am UTC](https://discuss.elastic.co/t/in-flight-request-is-too-large-and-throw-circuit-breaking-exception-parent-data-too-large/246482/29 "2020-09-01T10:21:05Z")

</div>

hi @warkolm, I havent solved my issues for this topic [Fail to send data to elastic unexpected EOF](https://discuss.elastic.co/t/fail-to-send-data-to-elastic-unexpected-eof/246732/2) , I just solved the issue of circuit breaking exception in this topic but not the issue of failed sending data to elastic. I think hat was entirely different topics

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [September 29, 2020, 10:21am UTC](https://discuss.elastic.co/t/in-flight-request-is-too-large-and-throw-circuit-breaking-exception-parent-data-too-large/246482/30 "2020-09-29T10:21:13Z")

</div>

Closed on September 29, 2020, 10:21am UTC

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.

[Previous page](https://discuss.elastic.co/t/in-flight-request-is-too-large-and-throw-circuit-breaking-exception-parent-data-too-large/246482.md?page=1)
