# Regarding Persistent Queues

**URL:** <https://discuss.elastic.co/t/regarding-persistent-queues/157637>\
**Category:** Logstash\
**Created:** [November 21, 2018, 7:33am UTC](https://discuss.elastic.co/t/regarding-persistent-queues/157637 "2018-11-21T07:33:18Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![dawiro](https://avatars.discourse-cdn.com/v4/letter/d/71e660/32.png) [@dawiro](https://discuss.elastic.co/u/dawiro)\
**Post date:** [November 21, 2018, 7:33am UTC](https://discuss.elastic.co/t/regarding-persistent-queues/157637/1 "2018-11-21T07:33:18Z")

</div>

Hi,  
Can I ask, is there a recommendation regarding the disk size that should be allocated to persistent queues? Or is it simply, the more the better?

Regards,  
D

---

<div class="post-metadata">

**Author:** ![Magnus\_Kessler](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnus_kessler/32/42001_2.png) [@Magnus\_Kessler](https://discuss.elastic.co/u/Magnus_Kessler)\
**Post date:** [November 22, 2018, 10:44am UTC](https://discuss.elastic.co/t/regarding-persistent-queues/157637/2 "2018-11-22T10:44:11Z")

</div>

The role of persistent queues is to provide a buffer for situations where Elasticsearch is not capable to ingest data at the rate it arrives.

If Elasticsearch is not available at all (worst case), the buffer should be big enough to cache the amount of data that would arrive during this down-time period. In other words, decide how long you can afford for Elasticsearch to be unavailable before losing new data.

The other scenario is that more data would arrive for a short amount of time than can be ingested immediately. This could happen as a result of a logging spike. Again, decide how long this condition should last before eventually data would no longer be forwarded.

Typically one would configure the persistent queues to cache data for several hours or a day. During this period, the operations team should attempt to fix the root cause for a high log volume. Load that is continually causing persistent queues to build up for longer periods should be addressed by providing additional Logstash or Elasticsearch resources.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [December 20, 2018, 10:44am UTC](https://discuss.elastic.co/t/regarding-persistent-queues/157637/3 "2018-12-20T10:44:16Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.