# Logstash persistent queue settings

**URL:** https://discuss.elastic.co/t/logstash-persistent-queue-settings/284144
**Category:** Logstash
**Created:** [September 14, 2021, 6:14am UTC](https://discuss.elastic.co/t/logstash-persistent-queue-settings/284144 "2021-09-14T06:14:58Z")
**Posts on this page:** 8
**Page:** 1

<div class="post-metadata">

### Author: ![Aniket\_Pant](https://avatars.discourse-cdn.com/v4/letter/a/77aa72/32.png) [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)
#### Post date: [September 14, 2021, 6:14am UTC](https://discuss.elastic.co/t/logstash-persistent-queue-settings/284144/1 "2021-09-14T06:14:58Z")

</div>

Using logstash 7.13  
We are running logstash on linux server which has _4 cpu(s) 15gb of ram of 100gb of ssd._ We are using persistent queue settings in logstash but we actually can't sure is this right configuration or can it be improve.  
**logstash.yml** file

```auto
# ------------ Queuing Settings --------------
#
# Internal queuing model, "memory" for legacy in-memory based queuing and
# "persisted" for disk-based acked queueing. Defaults is memory
#
queue.type: persisted
#
# If using queue.type: persisted, the directory path where the data files will be stored.
# Default is path.data/queue
#
path.queue: /var/lib/logstash/data_queue
#
# If using queue.type: persisted, the page data files size. The queue data consists of
# append-only data files separated into pages. Default is 64mb
#
#queue.page_capacity: 64mb
#
# If using queue.type: persisted, the maximum number of unread events in the queue.
# Default is 0 (unlimited)
#
# queue.max_events: 0
#
# If using queue.type: persisted, the total capacity of the queue in number of bytes.
# If you would like more unacked events to be buffered in Logstash, you can increase the
# capacity using this setting. Please make sure your disk drive has capacity greater than
# the size specified here. If both max_bytes and max_events are specified, Logstash will pick
# whichever criteria is reached first
# Default is 1024mb or 1gb
#
#queue.max_bytes: 1024mb
#
# If using queue.type: persisted, the maximum number of acked events before forcing a checkpoint
# Default is 1024, 0 for unlimited
#
# queue.checkpoint.acks: 1024
#
# If using queue.type: persisted, the maximum number of written events before forcing a checkpoint
# Default is 1024, 0 for unlimited
#
# queue.checkpoint.writes: 1024
#
# If using queue.type: persisted, the interval in milliseconds when a checkpoint is forced on the head page
# Default is 1000, 0 for no periodic checkpoint.
#
# queue.checkpoint.interval: 1000
#

```

**pipeline.yml**

```auto
[root@logstash-helk ~]# cat /etc/logstash/pipelines.yml
# This file is where you define your pipelines. You can define multiple.
# For more information on multiple pipelines, see the documentation:
# https://www.elastic.co/guide/en/logstash/current/multiple-pipelines.html

- pipeline.id: winlogbeat
  #pipeline.batch.size: 2000
  #pipeline.workers: 6
  path.config: "/usr/share/logstash/pipeline/winlogbeat/"
  queue.type: persisted

- pipeline.id: packetbeat
  #pipeline.batch.size: 2000
  #pipeline.workers: 6
  path.config: "/usr/share/logstash/pipeline/packetbeat/"
  queue.type: persisted

- pipeline.id: pfsense
  #pipeline.batch.size: 2000
  #pipeline.workers: 6
  path.config: "/usr/share/logstash/pipeline/pfsense/"
  queue.type: persisted

- pipeline.id: vpn
   #pipeline.batch.size: 2000
    # #pipeline.workers: 6
  path.config: "/usr/share/logstash/pipeline/vpn/"
  queue.type: persisted

```

Basically we want to use persistent queue what configuration do we need to configure.We are using by default configutration.We dont know page capacity.

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [September 14, 2021, 6:16am UTC](https://discuss.elastic.co/t/logstash-persistent-queue-settings/284144/2 "2021-09-14T06:16:43Z")

</div>

Did you read [Persistent queues (PQ) | Logstash Reference [7.14] | Elastic](https://www.elastic.co/guide/en/logstash/7.14/persistent-queues.html#configuring-persistent-queues)?

---

<div class="post-metadata">

### Author: ![Aniket\_Pant](https://avatars.discourse-cdn.com/v4/letter/a/77aa72/32.png) [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)
#### Post date: [September 14, 2021, 6:18am UTC](https://discuss.elastic.co/t/logstash-persistent-queue-settings/284144/3 "2021-09-14T06:18:25Z")

</div>

yes but we are using by default settings we just enable `queue.type: persisted`.

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [September 14, 2021, 6:20am UTC](https://discuss.elastic.co/t/logstash-persistent-queue-settings/284144/4 "2021-09-14T06:20:48Z")

</div>

Then I'd just use the defaults, unless there are other issues that you are seeing.

---

<div class="post-metadata">

### Author: ![Aniket\_Pant](https://avatars.discourse-cdn.com/v4/letter/a/77aa72/32.png) [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)
#### Post date: [September 14, 2021, 6:23am UTC](https://discuss.elastic.co/t/logstash-persistent-queue-settings/284144/5 "2021-09-14T06:23:58Z")

</div>

ya i agree with you..but we dont know what value can we provide in queue.page\_capacity.

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [September 14, 2021, 6:27am UTC](https://discuss.elastic.co/t/logstash-persistent-queue-settings/284144/6 "2021-09-14T06:27:40Z")

</div>

Well, from the docs, emphasis mine;

> - `queue.page_capacity` : The maximum size of a queue page in bytes. The queue data consists of append-only files called "pages". The default size is 64mb. **Changing this value is unlikely to have performance benefits.**

---

<div class="post-metadata">

### Author: ![Aniket\_Pant](https://avatars.discourse-cdn.com/v4/letter/a/77aa72/32.png) [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)
#### Post date: [September 14, 2021, 6:35am UTC](https://discuss.elastic.co/t/logstash-persistent-queue-settings/284144/7 "2021-09-14T06:35:32Z")

</div>

we didn't change this.Can we change this or upto what values it can be change

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [October 12, 2021, 6:36am UTC](https://discuss.elastic.co/t/logstash-persistent-queue-settings/284144/8 "2021-10-12T06:36:04Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
