Logstash - Improving speed of reading data from Redis queue

Elastic Stack Logstash
1

Hi,
can you please help how to increase speed of reading messages from redis queue by Logstash?

An application generates 100 mil. documents / day.
I have 3 logstash instances.

I've tried these input configuration:

input {
  redis {
    key => "filebeat-app-name"
    data_type => "list"
    host => "redis-as1.XXX"
  }
}

and

input {
  redis {
    key => "filebeat-app-name"
    data_type => "list"
    host => "redis-as1.XXX"
    threads => 8
  }
}

On each Logstash instance:
CPU has usage in range 50 - 70 % (4 cpu)
RAM has usage about 40 % (4 GB)

Do you have any ideas how to tune logstash instances to read events more quickly?

2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.