Logstash elasticsearch filter causing high CPU usage

Elastic Stack Logstash
1

Hello,

like the title says I am using the elasticsearch filter in logstash and it is causing high CPU usage. I am wondering if there is a way to cache the looked up results so that it may reduce the CPU usage I am seeing

regards,

2

Have you used the performance API to verify that the problem is in the input?

3

Hello,

thank you for your response

i have enabled xpack monitoring on logstash but when i try to query for the pipeline stats like you recommended it says on the page you linked it tells me that [pipelines] is an unrecognized metric.

when i run top with the elasticsearch filter in logstash running i can see that elastic is using a lot of CPU and across all cpu's i am at 80% and when i turn it off the CPU usage of elasticsearh drops and i return to about 10-20%.

Regards,

4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.