I am using the ELK stack deployed in a docker swarm for logging. From time to time I get the below error and Kibana service fails.
[Elasticsearch failed Search rejected due to missing shards [[.kibana_task_manager_7.17.7_001][0]]]
when I delete the index .kibana_task_manager_7.17.7_001
and restart Elasticsearch, it works again but after 3, or 4 days it fails with the same error.
Additionally, I am using persistent volume mounting for Elasticsearch.
Has anyone come across this issue or have a permanent solution?