# ELK data/shard allocation is not happening properly

**URL:** https://discuss.elastic.co/t/elk-data-shard-allocation-is-not-happening-properly/281784
**Category:** Elasticsearch
**Created:** [August 18, 2021, 8:00am UTC](https://discuss.elastic.co/t/elk-data-shard-allocation-is-not-happening-properly/281784 "2021-08-18T08:00:21Z")
**Posts on this page:** 10
**Page:** 1

<div class="post-metadata">

### Author: ![karthik\_kiccha](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/karthik_kiccha/32/51812_2.png) [@karthik\_kiccha](https://discuss.elastic.co/u/karthik_kiccha)
#### Post date: [August 18, 2021, 8:00am UTC](https://discuss.elastic.co/t/elk-data-shard-allocation-is-not-happening-properly/281784/1 "2021-08-18T08:00:21Z")

</div>

Hello Team,

We have 6 node ELK cluster and all of them are configured to act as master and data node. Out of 6 nodes two nodes are consuming more disk space which is at 93%, other nodes are at 70% to 80%. We have tried configuring cluster.shard.route.rebalancing but no luck. So basically disk/shard allocation is not happening properly. We are using ELK 7.8.1 version.

Let me know if anyone has any suggestions.

Regards,  
Karthik

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [August 18, 2021, 10:04pm UTC](https://discuss.elastic.co/t/elk-data-shard-allocation-is-not-happening-properly/281784/2 "2021-08-18T22:04:23Z")

</div>

Can you share the output from `_cat/allocation?v`?

---

<div class="post-metadata">

### Author: ![karthik\_kiccha](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/karthik_kiccha/32/51812_2.png) [@karthik\_kiccha](https://discuss.elastic.co/u/karthik_kiccha)
#### Post date: [August 19, 2021, 10:02am UTC](https://discuss.elastic.co/t/elk-data-shard-allocation-is-not-happening-properly/281784/3 "2021-08-19T10:02:29Z")

</div>

Here you go,

shards disk.indices disk.used disk.avail disk.total disk.percent host ip node  
508 8.6tb 8.6tb 1.7tb 10.3tb 83 ap0es1-4.m0.sysint.local 172.21.6.59 ap0es1-4.m0.sysint.local  
508 5.4tb 5.4tb 4.8tb 10.3tb 52 ap0es1-5.m0.sysint.local 172.21.6.65 ap0es1-5.m0.sysint.local  
509 5.9tb 5.9tb 4.4tb 10.3tb 57 ap0es1-0.m0.sysint.local 172.21.6.48 ap0es1-0.m0.sysint.local  
509 8.1tb 8.1tb 2.2tb 10.3tb 78 ap0es1-2.m0.sysint.local 172.21.6.50 ap0es1-2.m0.sysint.local  
469 9.5tb 9.5tb 826.8gb 10.3tb 92 ap0es1-1.m0.sysint.local 172.21.6.56 ap0es1-1.m0.sysint.local  
509 8.1tb 8.1tb 2.2tb 10.3tb 78 ap0es1-3.m0.sysint.local 172.21.6.58 ap0es1-3.m0.sysint.local

---

<div class="post-metadata">

### Author: ![karthik\_kiccha](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/karthik_kiccha/32/51812_2.png) [@karthik\_kiccha](https://discuss.elastic.co/u/karthik_kiccha)
#### Post date: [August 19, 2021, 10:08am UTC](https://discuss.elastic.co/t/elk-data-shard-allocation-is-not-happening-properly/281784/4 "2021-08-19T10:08:05Z")

</div>

some closed index are there in ap0es1-1/1-4 nodes, I just want to move them to the other nodes, but not getting proper command to do it.

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [August 19, 2021, 10:11pm UTC](https://discuss.elastic.co/t/elk-data-shard-allocation-is-not-happening-properly/281784/5 "2021-08-19T22:11:55Z")

</div>

You cannot just move closed indices, you need to reopen them, move and then close again.

What is the output from the `_cluster/stats?pretty&human` API as well please?

---

<div class="post-metadata">

### Author: ![karthik\_kiccha](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/karthik_kiccha/32/51812_2.png) [@karthik\_kiccha](https://discuss.elastic.co/u/karthik_kiccha)
#### Post date: [August 23, 2021, 9:52am UTC](https://discuss.elastic.co/t/elk-data-shard-allocation-is-not-happening-properly/281784/6 "2021-08-23T09:52:07Z")

</div>

ok I can't just move the closed index I got that, but how to rebalance the shards/index, looks like most of the newly created index are going to ap0es1-1 and ap0es1-4, it is not just loadbalancing properly between the clusters.

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [August 23, 2021, 9:54am UTC](https://discuss.elastic.co/t/elk-data-shard-allocation-is-not-happening-properly/281784/7 "2021-08-23T09:54:18Z")

</div>

Elasticsearch balances by the shard count. It will move shards off nodes that cross the watermarks.

So what you are seeing is probably not unexpected and shouldn't be an issue.

---

<div class="post-metadata">

### Author: ![karthik\_kiccha](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/karthik_kiccha/32/51812_2.png) [@karthik\_kiccha](https://discuss.elastic.co/u/karthik_kiccha)
#### Post date: [August 23, 2021, 10:07am UTC](https://discuss.elastic.co/t/elk-data-shard-allocation-is-not-happening-properly/281784/8 "2021-08-23T10:07:46Z")

</div>

can you give me the command to move the index from one node to other node within the cluster?

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [August 23, 2021, 10:09am UTC](https://discuss.elastic.co/t/elk-data-shard-allocation-is-not-happening-properly/281784/9 "2021-08-23T10:09:38Z")

</div>

You can try [Cluster reroute API | Elasticsearch Guide [7.14] | Elastic](https://www.elastic.co/guide/en/elasticsearch/reference/current/cluster-reroute.html)

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [September 20, 2021, 10:10am UTC](https://discuss.elastic.co/t/elk-data-shard-allocation-is-not-happening-properly/281784/10 "2021-09-20T10:10:34Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
