Health check of [/usr/share/elasticsearch/data/nodes/0] took [10146ms] which is above the warn threshold of [5s]

[Farzad_Ebrahimi]

Hi everyone,
every day we faced to this log with level WARN:

{"type": "server", "timestamp": "2021-10-20T03:13:18,747Z", "level": "WARN", "component": "o.e.m.f.FsHealthService", "cluster.name": "elasticsearch_cluster", "node.name": "elasticsearch", "message": "health check of [/usr/share/elasticsearch/data/nodes/0] took [10146ms] which is above the warn threshold of [5s]", "cluster.uuid": "CBdfgKdfgwKxjkMgA", "node.id": "wfEVdfgre1_vdfgg"  }

we launched single-node Elasticsearch:7.12.0 with Docker and following configs:

environment:
      - node.name=elasticsearch
      - discovery.type=single-node
      - cluster.name=elasticsearch_cluster
      - bootstrap.memory_lock=true
      - "ES_JAVA_OPTS=-Xms31G -Xmx31G"
      - http.max_content_length=1536mb
      - cluster.routing.allocation.disk.threshold_enabled=false

and indexing rate is very high and for a day, size of index became over than 600 GB with at least 40 millions documents.
What is the reason for this WARN log?
I want to thank you in advance.

[DavidTurner]

It means that it took more than 10 seconds to write a 20-byte file, which indicates that your disks are performing very poorly, perhaps overloaded.