Experiencing a delay in Elasticsearch index logs

Elastic Search
1

We are experiencing a delay in logs being ingested into the Elasticsearch. While investigating we are getting below mentioned Error in Elasticsearch logs.
Logs are being ingested from the application via Filebeat, processed through Logstash, and then sent to Elasticsearch.

[2024-10-2318:58:54,970][ERROR][o.e..m.c.c.ClusterStatsCollector] [yball1v355ca09] collector [cluster_stats] timed out when collecting data: node [OA1DKLJoT4yfNNW-p9kkJg] did not respond within [10s]

Kindly let me know how this can be resolved.

Thanks,
Shaista

2

Hi Shaista, Delay can be occur because of multiple reasons.

  1. Could you help us with your cluster (per node) configurations? No. of Indexes / Shards ?
  2. How is your hardware utilizations per node? Are they fully utilized?
  3. Could you share the result of _cluster/stats?human&pretty ?