Kibana crashes

[rashmi (kulkarni)]

@jordan_sumitomo

TOO_MANY_REQUESTS/12/disk usage exceeded flood-stage watermark, index has read-only-allow-delete block];

I see TOO_MANY_REQUESTS/12/disk usage exceeded flood-stage watermark, index has read-only-allow-delete block];
Elasticsearch considers the available disk space before deciding whether to allocate new shards, relocate shards away or block all index write operations on a data node based on a different threshold of this error. This is because Elasticsearch indices consist of different shards which are persisted on data nodes and low disk space can cause issues.Try these steps:

1. Delete unused indices.
2. Attach external disk or increase the disk used by the data node.
3. Manually move shards away from the node using cluster reroute API.
4. Reduce replicas count to 1 (if replicas > 1).
5. Add new data nodes.

Thanks
Rashmi