Logstash 6.4.1 & 6.5.0 High CPU usage

Elastic Stack Logstash
1

Hi All,

I upgraded Elastic Stack from:

  • At first 6.3.0 --> 6.4.1 (whole stack)
  • Then from 6.4.1 --> 6.4.2 (only Logstash)
  • then from 6.4.2 --> 6.5.0 (only Logstash)

After first upgrade I have notice high CPU usage change on logstash nodes comparing to version 6.3.0.
In consequence Logstash stopped consume logs from Kafka.
29

Then decided to move to version 6.4.2 all goes back to normal (still higher comparing to 6.3.0 but in tolerance).

2

Then decided to update to new release - CPU usage goes up again!

0

What could be possible reason for high CPU usage? No error logs or warn logs which could point to the problem.

For comparison please see below CPU usage on node that runs 6.3.0 version:

0
CPU UTILIZATION ON 6.3.0.png3722×1318 630 KB

It seems to be similar problem to this one: Logstash 6.2.2 high CPU usage

Will appreciate your help,
Thanks,
Jan

2

Hi an todays update.

Logstash 6.5.0 is down, not consuming any logs from kafka & keeps 100% cpu utilization

Logstash%20Stop%20Working%20
Logstash Stop Working .png3706×1318 600 KB

31
Screenshot 2018-11-22 at 12.34.31.png3836×822 716 KB

For comparison on boxes with logstash 6.3.0 everything looks perfect:

30%20still%20Working
Logstash 6.30 still Working.png3686×1290 629 KB

From logs:

[2018-11-22T10:50:28,199][INFO ][org.apache.kafka.clients.consumer.internals.AbstractCoordinator] [Consumer clientId=xyz.kafka.uat.elastic.consumer-0, groupId=logstash] Attempt to heartbeat failed since group is rebalancing

Will appreciate your help,
Thanks,
Jan

3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.