# Does Elastic Cloud have any hard limits on http.max\_content\_length

**URL:** <https://discuss.elastic.co/t/does-elastic-cloud-have-any-hard-limits-on-http-max-content-length/314285>\
**Category:** Elasticsearch\
**Created:** [September 13, 2022, 11:06am UTC](https://discuss.elastic.co/t/does-elastic-cloud-have-any-hard-limits-on-http-max-content-length/314285 "2022-09-13T11:06:26Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![stevesimpson](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/stevesimpson/32/41437_2.png) [@stevesimpson](https://discuss.elastic.co/u/stevesimpson)\
**Post date:** [September 13, 2022, 11:06am UTC](https://discuss.elastic.co/t/does-elastic-cloud-have-any-hard-limits-on-http-max-content-length/314285/1 "2022-09-13T11:06:26Z")

</div>

Hi, we are currently running AWS OpenSearch and are hitting some hard limits on `http.max_content_length`. This is a non-configurable 100mb limit. We are using Logstash to process events from Filebeat and hitting an endless loop of `413` errors. I understand from [this thread](https://discuss.elastic.co/t/batch-size-in-logstash/301487) that I can configure the `_bulk` size however this will impact the input and filter parts of the pipeline. I worry that this may cause processing delays, PQ size increase and eventually Filebeat backoff.

If we were to move to Elastic Cloud in AWS would we be able to configure the `http.max_content_length` to avoid the 413 error we are seeing? Would the Elasticsearch output be intelligent enough to break up the batches so we didn't hit this endless 413 loop?

I know the actual solution here is to not send huge payloads to Elastic/OpenSearch but we cannot change this due to the business need at present.

Thanks

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [September 13, 2022, 11:06am UTC](https://discuss.elastic.co/t/does-elastic-cloud-have-any-hard-limits-on-http-max-content-length/314285/2 "2022-09-13T11:06:26Z")

</div>

OpenSearch/OpenDistro are AWS run products and differ from the original Elasticsearch and Kibana products that Elastic builds and maintains. You may need to contact them directly for further assistance.

(This is an automated response from your friendly Elastic bot. Please report this post if you have any suggestions or concerns :elasticheart: )

---

<div class="post-metadata">

**Author:** ![DavidTurner](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/davidturner/32/22453_2.png) [@DavidTurner](https://discuss.elastic.co/u/DavidTurner)\
**Post date:** [September 13, 2022, 12:21pm UTC](https://discuss.elastic.co/t/does-elastic-cloud-have-any-hard-limits-on-http-max-content-length/314285/3 "2022-09-13T12:21:28Z")

</div>

Neither OpenSearch nor Elasticsearch are really designed to cope with individual docs that exceed 100MiB, so raising the `max_content_length` will just lead to other problems and hence isn't something you can do. Typically this only matters if you're storing enormous amounts of unsearchable binary data (image-heavy documents or videos) and in that case there's no real need to store it directly in the search engine. Instead, store it in a separate blob store and store only a link to the blob in your search engine.

Regarding whether Logstash can split large binary objects across multiple documents, you'll need to ask the Logstash folks about that. I suggest opening a separate topic in the [Logstash forum](https://discuss.elastic.co/c/elastic-stack/logstash/14).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [October 11, 2022, 12:22pm UTC](https://discuss.elastic.co/t/does-elastic-cloud-have-any-hard-limits-on-http-max-content-length/314285/5 "2022-10-11T12:22:26Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
