Logstash : High CPU usage and stop logging

Elastic Stack Logstash
1

my jsstack log: https://gist.github.com/yanpeipan/d9fd90f484d0cd0c9099#file-jsstack-txt
my logstash config: https://gist.github.com/yanpeipan/d9fd90f484d0cd0c9099#file-logstash-nginx-conf

This problem confuse me for a long time. logstash start for few days , it will block self, don't record any log

2

Logstash is generally CPU bound, so seeing high CPU usage when it is busy is expected. Why is this a problem?

3

logstash start for few days , it will block self, don't record any log

4

How many RAM/CPU Logstash has?

BTW I see you are using Redis, so it's not a problem to "restart" logstash every day if needed (memory leak maybe..).

5

799.3% CPU usage

6

What about memory?

Java needs memory to avoid GC intensive work (hence CPU consumption).

7

42% (8058940k total)

this is my /et/init.d/logstash config

name=logstash
pidfile="/var/run/$name.pid"

LS_USER=logstash
LS_GROUP=logstash
LS_HOME=/var/lib/logstash
LS_HEAP_SIZE="1g"
LS_LOG_DIR=/var/log/logstash
LS_LOG_FILE="${LS_LOG_DIR}/$name.log"
LS_CONF_DIR=/etc/logstash/conf.d
LS_OPEN_FILES=16384
LS_NICE=19
LS_OPTS=""