When the logstash process is consuming high CPU cycles and CPU usage shoots up to more than 100%. The server is a 2 core machine. The standard GROK filters have been used to process the log files. There are 3 set of GROK filter lines to parse 3 types of log events. Input is from Kafka broker.
Run logstash again and then do below
$ vmstat 1
Please show me the output
Please also show the configuration and what the grok expressions look like. Logstash is often limited by CPU, so having it max out CPU usage is not necessarily a problem, just a sign it is working hard. Inefficient grok patterns can however consume a lot of CPU, so you may want to go through and optimise them
1 Like
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.