I have an ES cluster, made from 3 nodes, all are master/ingest/data. The cluster is configured with 5 shards and 1 replica, so 5 primary shards and 5 replica shards.
After a restart of the cluster, I have a lot of unassigned shards, theoretically all of the replica shards are unallocated. The thing is I don't have space anymore on the nodes and as far as I understand it cannot allocate again the replicas because of this.
When the nodes were restarted I didn't had the
index.unassigned.node_left.delayed_timeout option set so the cluster started to put the shards as unassigned.
At the moment I see that the ES used spaced is smaller then disk used:
shards disk.indices disk.used disk.avail disk.total disk.percent host ip node 119 119.1gb 587.1gb 67.3gb 654.5gb 89 10.224.10.85 10.224.10.85 elasticsearch-2 424 519.8gb 559.7gb 94.7gb 654.5gb 85 10.224.10.84 10.224.10.84 elasticsearch-1 251 267.9gb 556.8gb 97.6gb 654.5gb 85 10.224.10.167 10.224.10.167 elasticsearch-3 782 UNASSIGNED
How can I free the space In order to be the cluster able to assign again the replicas?