ELK stack - Kibana fails time to time giving the same error ( Elasticsearch failed Search rejected due to missing shards [)[.kibana_task_manager_7.17.7_001][0]])

I am using the ELK stack deployed in a docker swarm for logging. From time to time I get the below error and Kibana service fails.

[Elasticsearch failed Search rejected due to missing shards [[.kibana_task_manager_7.17.7_001][0]]]

when I delete the index .kibana_task_manager_7.17.7_001 and restart Elasticsearch, it works again but after 3, or 4 days it fails with the same error.

Additionally, I am using persistent volume mounting for Elasticsearch.

Has anyone come across this issue or have a permanent solution?

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.