My ELK Cluster is slow indexing Why? Please Help

Elastic Stack Elasticsearch
1

I am trying to send data to Elasticsearch, but elasticsearch indexing is soo slow. Some usefull outputs on below.

GET _/nodes/hot_threads?pretty is the output;

GET _cluster/stats is the output;

2

It seems to be busy with some heavy searches based on the hot threads data. What kind of search load is the cluster under?

What type of hardware and storage are you using?

3

As Christian mentioned, there's an insane load on your server right now, 102% CPU on that live thread?

If you're doing heavy index operations, either pause all ongoing operations to tune for indexing speed, or simply scale your cluster up (get better hardware).

4

Thanks for everyone fastly reply, I am sorry with lately answer because of weekend.
As you all guys said my cluster under heavy searched because it under the live application.

What type of hardware and storage are you using?

Raid0 mixture of Ssd and Sata disks,

5

I have a 11 data nodes and 3 master nodes. Maybe I can convert some data nodes to master node, you think is it okey?

Also I have 30gb java heap but I have 956 shards (primary and replica). Is this normal?

6

3 dedicated master nodes is great and there is no need to add more. Can you elaborate on the structure if your cluster and which nodes use what storage? Are you using a hot/warm deployment? What is the use case?

7

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.